2024-09-17T08:27:59.100 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T08:27:59.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T08:27:59.202 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230 branch: reef description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} email: ceph-qa@ceph.com first_in_suite: false job_id: '7908230' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root install: ceph: flavor: default sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 workunit: branch: reef sha1: 1cbdc9211df088cccbd94423c7cf3a2b85fe432b owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 5234 sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 sleep_before_teardown: 0 subset: 46/64 suite: orch suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1cbdc9211df088cccbd94423c7cf3a2b85fe432b targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRnhNx4DZLrAg7UyxBmhXNi2a81EqEVU54bG10SQ1CLT/KuaBJvEJdIl/jqaMiPcFjmsPhwXPRL0PqxAryKX74= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyImUWvLww0OxKFUKDfWZYhlmHStpcyfv0GaTtcBoAcOxtsY9bojOAj++gRXEHodxPIok6M9tEg9uSgyqJgcpI= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_22:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T08:27:59.202 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa; will attempt to use it 2024-09-17T08:27:59.203 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks 2024-09-17T08:27:59.203 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T08:27:59.205 INFO:teuthology.task.internal:Checking packages... 2024-09-17T08:27:59.228 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9' 2024-09-17T08:27:59.228 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T08:27:59.228 INFO:teuthology.packaging:ref: None 2024-09-17T08:27:59.228 INFO:teuthology.packaging:tag: None 2024-09-17T08:27:59.228 INFO:teuthology.packaging:branch: reef 2024-09-17T08:27:59.228 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:27:59.228 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-09-17T08:27:59.478 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:27:59.480 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T08:27:59.488 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T08:27:59.489 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T08:27:59.533 INFO:teuthology.task.internal:Saving configuration 2024-09-17T08:27:59.544 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T08:27:59.568 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T08:27:59.594 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 08:22:25.361154', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEDFfm4p7wvXcARQx9L6JPT5JIHorh5XvTyc3eOwYtTI'} 2024-09-17T08:27:59.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 08:22:25.359373', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICFfuaYjZaI50D3T+k5hD3o8laPp4584qtT5E4sKG9AO'} 2024-09-17T08:27:59.620 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T08:27:59.626 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-17T08:27:59.626 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-09-17T08:27:59.626 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T08:27:59.723 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f427ea1ee60>, signals=[15]) 2024-09-17T08:27:59.723 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T08:27:59.742 INFO:teuthology.task.internal:Opening connections... 2024-09-17T08:27:59.742 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T08:27:59.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:27:59.825 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-09-17T08:27:59.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:27:59.906 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T08:27:59.912 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-17T08:27:59.917 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-17T08:27:59.918 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-17T08:27:59.965 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T08:27:59.965 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2024-09-17T08:27:59.965 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2024-09-17T08:27:59.965 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T08:27:59.965 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2024-09-17T08:27:59.965 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2024-09-17T08:27:59.966 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2024-09-17T08:27:59.966 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T08:27:59.966 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T08:27:59.966 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T08:27:59.966 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T08:27:59.966 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2024-09-17T08:27:59.966 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-17T08:27:59.985 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-09-17T08:27:59.991 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-09-17T08:27:59.991 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-09-17T08:28:00.035 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T08:28:00.035 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2024-09-17T08:28:00.035 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04" 2024-09-17T08:28:00.035 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T08:28:00.035 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy 2024-09-17T08:28:00.036 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2024-09-17T08:28:00.036 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2024-09-17T08:28:00.036 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T08:28:00.036 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T08:28:00.036 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T08:28:00.036 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T08:28:00.036 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy 2024-09-17T08:28:00.036 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-09-17T08:28:00.060 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T08:28:00.069 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T08:28:00.104 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T08:28:00.105 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-17T08:28:00.107 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-09-17T08:28:00.112 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T08:28:00.134 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T08:28:00.134 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-17T08:28:00.155 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-09-17T08:28:00.171 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T08:28:00.224 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T08:28:00.242 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T08:28:00.242 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T08:28:00.242 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T08:28:00.243 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T08:28:00.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T08:28:00.247 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-17T08:28:00.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T08:28:00.248 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-09-17T08:28:00.294 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2024-09-17T08:28:00.294 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.15.0-56-generic 2024-09-17T08:28:00.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-09-17T08:28:00.296 INFO:teuthology.orchestra.run.smithi136.stdout:5.15.0-56-generic 2024-09-17T08:28:00.296 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.15.0-56-generic 2024-09-17T08:28:00.296 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2024-09-17T08:28:00.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-09-17T08:28:00.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-17T08:28:00.558 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T08:28:00.591 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T08:28:00.656 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T08:28:00.677 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T08:28:00.717 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T08:28:00.719 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T08:28:00.762 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T08:28:00.773 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T08:28:00.828 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T08:28:00.863 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T08:28:00.870 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T08:28:00.871 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T08:28:00.900 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T08:28:00.901 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T08:28:00.905 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T08:28:00.907 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T08:28:00.912 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T08:28:00.920 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T08:28:00.922 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T08:28:00.923 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T08:28:00.946 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T08:28:00.947 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T08:28:00.947 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T08:28:00.947 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T08:28:00.948 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T08:28:00.948 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T08:28:00.955 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T08:28:00.955 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T08:28:00.972 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T08:28:00.973 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T08:28:00.973 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T08:28:01.123 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T08:28:01.129 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T08:28:01.149 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T08:28:01.268 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T08:28:01.443 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T08:28:01.463 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T08:28:01.544 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T08:28:01.560 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T08:28:01.568 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T08:28:01.569 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T08:28:01.616 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T08:28:01.624 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T08:28:01.628 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T08:28:01.629 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T08:28:01.638 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T08:28:01.639 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T08:28:01.665 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T08:28:01.666 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T08:28:01.678 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T08:28:01.678 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T08:28:01.701 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T08:28:01.712 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T08:28:01.713 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T08:28:01.723 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T08:28:01.726 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T08:28:01.730 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T08:28:01.730 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T08:28:01.730 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T08:28:01.730 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T08:28:01.731 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T08:28:01.767 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T08:28:01.767 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T08:28:01.774 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T08:28:01.774 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T08:28:01.779 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T08:28:01.784 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T08:28:01.788 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T08:28:01.789 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T08:28:01.790 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T08:28:01.801 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T08:28:01.804 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T08:28:01.804 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T08:28:01.805 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T08:28:01.810 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T08:28:01.810 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T08:28:01.861 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T08:28:01.862 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T08:28:01.864 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T08:28:01.865 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T08:28:01.867 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T08:28:01.870 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T08:28:01.875 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T08:28:01.878 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T08:28:01.881 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T08:28:01.886 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T08:28:01.951 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T08:28:01.951 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T08:28:07.252 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 16.1 MB in 2s (7,673 kB/s) 2024-09-17T08:28:07.920 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 16.1 MB in 3s (5,892 kB/s) 2024-09-17T08:28:08.700 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-09-17T08:28:08.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T08:28:08.775 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-09-17T08:28:08.968 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-09-17T08:28:08.969 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-09-17T08:28:09.134 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T08:28:09.134 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T08:28:09.134 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T08:28:09.135 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T08:28:09.135 INFO:teuthology.orchestra.run.smithi136.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T08:28:09.135 INFO:teuthology.orchestra.run.smithi136.stdout: python2.7-minimal 2024-09-17T08:28:09.135 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T08:28:09.136 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2024-09-17T08:28:09.136 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T08:28:09.136 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T08:28:09.137 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T08:28:09.138 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2024-09-17T08:28:09.138 INFO:teuthology.orchestra.run.smithi136.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T08:28:09.138 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2024-09-17T08:28:09.138 INFO:teuthology.orchestra.run.smithi136.stdout: thermald 2024-09-17T08:28:09.188 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2024-09-17T08:28:09.188 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T08:28:09.188 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T08:28:09.189 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T08:28:09.190 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2024-09-17T08:28:09.190 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T08:28:09.242 INFO:teuthology.orchestra.run.smithi136.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T08:28:09.242 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 113 MB of archives. 2024-09-17T08:28:09.242 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T08:28:09.242 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T08:28:09.486 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-17T08:28:09.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T08:28:09.569 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-17T08:28:09.651 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T08:28:09.741 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T08:28:09.781 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-17T08:28:09.782 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-17T08:28:09.969 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T08:28:09.969 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T08:28:09.969 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T08:28:09.970 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T08:28:09.970 INFO:teuthology.orchestra.run.smithi078.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T08:28:09.970 INFO:teuthology.orchestra.run.smithi078.stdout: python2.7-minimal 2024-09-17T08:28:09.970 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T08:28:09.971 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-17T08:28:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T08:28:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T08:28:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T08:28:09.973 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-17T08:28:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T08:28:09.973 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-09-17T08:28:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: thermald 2024-09-17T08:28:10.015 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-17T08:28:10.016 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T08:28:10.016 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T08:28:10.016 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T08:28:10.017 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2024-09-17T08:28:10.018 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T08:28:10.068 INFO:teuthology.orchestra.run.smithi078.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T08:28:10.069 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 113 MB of archives. 2024-09-17T08:28:10.069 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T08:28:10.069 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T08:28:10.477 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T08:28:10.550 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T08:28:10.550 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T08:28:10.550 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T08:28:10.571 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T08:28:10.668 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T08:28:10.765 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T08:28:11.162 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 113 MB in 2s (72.5 MB/s) 2024-09-17T08:28:11.336 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T08:28:11.355 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T08:28:11.356 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T08:28:11.356 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T08:28:11.473 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T08:28:11.574 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T08:28:11.976 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 113 MB in 2s (73.1 MB/s) 2024-09-17T08:28:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T08:28:13.272 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T08:28:13.276 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:13.342 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:14.228 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T08:28:14.232 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:14.332 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:15.512 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T08:28:15.533 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:15.624 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:16.057 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T08:28:16.077 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:16.115 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:16.558 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T08:28:16.579 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:16.662 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:17.119 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T08:28:17.140 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:17.169 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:22.979 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T08:28:23.096 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T08:28:23.420 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T08:28:23.541 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T08:28:23.852 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T08:28:23.874 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T08:28:23.919 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T08:28:24.372 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T08:28:24.505 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T08:28:24.842 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T08:28:24.967 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T08:28:25.295 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T08:28:25.318 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T08:28:25.362 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T08:28:29.884 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T08:28:29.921 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:29.959 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:31.078 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T08:28:31.115 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T08:28:31.153 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:32.749 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T08:28:32.865 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T08:28:33.198 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T08:28:33.303 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:33.404 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T08:28:33.508 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:34.319 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T08:28:34.450 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T08:28:34.807 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T08:28:34.853 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T08:28:34.853 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T08:28:34.853 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T08:28:34.853 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T08:28:34.938 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:35.019 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:35.064 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T08:28:35.234 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:36.652 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T08:28:36.652 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T08:28:36.653 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T08:28:36.653 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T08:28:37.029 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T08:28:37.163 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T08:28:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:37.297 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:38.637 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T08:28:38.702 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:38.757 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T08:28:38.757 INFO:teuthology.orchestra.run.smithi136.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T08:28:38.855 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T08:28:38.981 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:40.408 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T08:28:40.475 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T08:28:40.475 INFO:teuthology.orchestra.run.smithi078.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T08:28:53.219 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T08:28:53.219 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub' 2024-09-17T08:28:53.237 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T08:28:53.259 INFO:teuthology.orchestra.run.smithi136.stdout:Generating grub configuration file ... 2024-09-17T08:28:53.517 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T08:28:53.541 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T08:28:53.820 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T08:28:53.826 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T08:28:53.891 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T08:28:53.896 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T08:28:54.064 INFO:teuthology.orchestra.run.smithi136.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T08:28:54.064 INFO:teuthology.orchestra.run.smithi136.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T08:28:54.064 INFO:teuthology.orchestra.run.smithi136.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T08:28:54.127 INFO:teuthology.orchestra.run.smithi136.stdout:done 2024-09-17T08:28:54.622 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2024-09-17T08:28:54.639 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 21 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.15.0.122.122 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2024-09-17T08:28:54.640 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2024-09-17T08:28:54.641 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2024-09-17T08:28:54.641 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2024-09-17T08:28:54.641 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T08:28:54.641 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T08:28:54.641 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T08:28:54.641 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T08:28:54.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T08:28:54.642 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2024-09-17T08:28:54.645 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T08:28:54.645 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub' 2024-09-17T08:28:54.669 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T08:28:54.691 INFO:teuthology.orchestra.run.smithi078.stdout:Generating grub configuration file ... 2024-09-17T08:28:54.808 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-09-17T08:28:54.981 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T08:28:54.999 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T08:28:55.059 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T08:28:55.131 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T08:28:55.133 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T08:28:55.213 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T08:28:55.302 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T08:28:55.308 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T08:28:55.380 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T08:28:55.385 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T08:28:55.557 INFO:teuthology.orchestra.run.smithi078.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T08:28:55.557 INFO:teuthology.orchestra.run.smithi078.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T08:28:55.557 INFO:teuthology.orchestra.run.smithi078.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T08:28:55.607 INFO:teuthology.orchestra.run.smithi078.stdout:done 2024-09-17T08:28:56.094 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-09-17T08:28:56.111 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-09-17T08:28:56.111 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-09-17T08:28:56.111 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-09-17T08:28:56.111 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-09-17T08:28:56.111 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-09-17T08:28:56.111 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.122.122 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-09-17T08:28:56.112 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-09-17T08:28:56.112 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T08:28:56.112 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T08:28:56.112 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T08:28:56.112 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T08:28:56.113 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T08:28:56.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-09-17T08:28:56.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-17T08:28:56.365 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T08:28:56.425 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-09-17T08:28:56.442 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T08:28:56.486 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T08:28:56.506 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-09-17T08:28:56.566 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T08:28:56.648 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T08:28:56.714 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-09-17T08:28:56.714 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T08:28:56.886 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T08:28:56.924 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T08:28:56.926 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2024-09-17T08:28:56.942 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2024-09-17T08:28:56.942 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2024-09-17T08:28:56.942 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2024-09-17T08:28:56.942 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2024-09-17T08:28:56.942 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 21 2024-09-17T08:28:56.942 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T08:28:56.942 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.15.0.122.122 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2024-09-17T08:28:56.943 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2024-09-17T08:28:56.944 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-09-17T08:28:56.988 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.MQjpT2WQMT 2024-09-17T08:28:56.988 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MQjpT2WQMT 2024-09-17T08:28:57.043 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.MQjpT2WQMT 2024-09-17T08:28:57.159 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.MQjpT2WQMT is 10KB 2024-09-17T08:28:57.172 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.MQjpT2WQMT 2024-09-17T08:28:57.177 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T08:28:57.229 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:28:57.230 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T08:28:57.230 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T08:28:57.301 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T08:28:57.301 DEBUG:teuthology.orchestra.run.smithi136:> sudo update-grub 2024-09-17T08:28:57.768 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-17T08:28:57.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T08:28:57.842 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-17T08:28:58.038 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-17T08:28:58.039 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-17T08:28:58.210 INFO:teuthology.orchestra.run.smithi078.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T08:28:58.211 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T08:28:58.211 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T08:28:58.211 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T08:28:58.211 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T08:28:58.211 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T08:28:58.212 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T08:28:58.212 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T08:28:58.251 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T08:28:58.253 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-09-17T08:28:58.308 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.122.122 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-09-17T08:28:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-09-17T08:28:58.310 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-09-17T08:28:58.310 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-09-17T08:28:58.310 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-17T08:28:58.357 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.5XyG1Owv1W 2024-09-17T08:28:58.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5XyG1Owv1W 2024-09-17T08:28:58.413 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.5XyG1Owv1W 2024-09-17T08:28:58.533 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.5XyG1Owv1W is 10KB 2024-09-17T08:28:58.546 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.5XyG1Owv1W 2024-09-17T08:28:58.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T08:28:58.560 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub' 2024-09-17T08:28:58.561 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T08:28:58.566 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-09-17T08:28:58.604 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:28:58.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T08:28:58.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T08:28:58.669 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T08:28:58.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo update-grub 2024-09-17T08:28:58.743 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T08:28:58.749 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T08:28:58.970 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T08:28:58.976 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T08:28:59.016 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T08:28:59.021 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T08:28:59.136 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T08:28:59.137 INFO:teuthology.orchestra.run.smithi136.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T08:28:59.137 INFO:teuthology.orchestra.run.smithi136.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T08:28:59.157 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-09-17T08:28:59.166 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-09-17T08:29:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2024-09-17T08:29:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T08:29:00.073 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-17T08:29:00.263 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T08:29:00.268 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T08:29:00.528 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T08:29:00.533 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T08:29:00.574 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T08:29:00.579 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T08:29:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T08:29:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T08:29:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T08:29:00.758 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-17T08:29:00.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-17T08:29:29.197 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T08:29:29.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-17T08:29:29.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:29:30.767 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T08:29:30.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T08:29:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:29:47.713 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-09-17T08:29:49.249 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-17T08:29:56.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-17T08:29:56.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:29:58.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T08:29:58.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:29:59.777 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-09-17T08:30:01.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-17T08:30:11.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-17T08:30:11.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:30:13.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T08:30:13.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:30:30.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-09-17T08:30:31.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-17T08:30:45.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-17T08:30:45.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:30:46.339 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-09-17T08:30:46.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T08:30:46.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:30:47.016 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-17T08:30:47.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T08:30:47.620 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-17T08:30:47.621 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-17T08:30:47.665 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-122-generic 2024-09-17T08:30:47.666 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T08:30:47.666 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T08:30:47.666 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T08:30:48.666 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T08:30:48.667 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T08:30:48.740 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-09-17T08:30:48.768 DEBUG:teuthology.parallel:result is None 2024-09-17T08:30:50.479 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-17T08:30:51.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-17T08:30:51.438 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-17T08:30:51.438 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-09-17T08:30:51.485 INFO:teuthology.orchestra.run.smithi136.stdout:5.15.0-122-generic 2024-09-17T08:30:51.485 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T08:30:51.485 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T08:30:51.485 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T08:30:52.486 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T08:30:52.487 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T08:30:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-09-17T08:30:52.599 DEBUG:teuthology.parallel:result is None 2024-09-17T08:30:52.599 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T08:30:52.606 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T08:30:52.606 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T08:30:52.608 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T08:30:52.614 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T08:30:52.644 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T08:30:52.695 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T08:30:52.696 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T08:30:52.698 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T08:30:52.714 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T08:30:52.745 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T08:30:52.745 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T08:30:52.751 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T08:30:52.773 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T08:30:52.780 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T08:30:52.781 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T08:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T08:30:52.790 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T08:30:52.800 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T08:30:52.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T08:30:52.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T08:30:52.853 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T08:30:52.862 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T08:30:52.862 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T08:30:52.903 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T08:30:52.909 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T08:30:52.954 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T08:30:53.002 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:30:53.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T08:30:53.070 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T08:30:53.075 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T08:30:53.122 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:30:53.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T08:30:53.184 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-17T08:30:53.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-09-17T08:30:53.308 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T08:30:53.316 INFO:teuthology.task.internal:Starting timer... 2024-09-17T08:30:53.316 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T08:30:53.349 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T08:30:53.398 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2024-09-17T08:30:53.398 DEBUG:teuthology.task.selinux:Excluding smithi136: OS 'ubuntu' does not support SELinux 2024-09-17T08:30:53.398 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T08:30:53.398 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T08:30:53.398 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T08:30:53.398 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T08:30:53.448 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T08:30:53.459 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T08:30:53.460 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T08:38:22.984 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-09-17T08:38:22.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T08:38:22.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:38:23.069 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-17T08:38:23.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T08:38:23.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-17T08:38:23.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:38:23.229 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-17T08:38:23.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-17T08:38:23.305 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T08:38:23.319 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T08:38:23.319 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T08:38:23.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T08:38:23.322 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T08:38:23.323 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T08:38:23.348 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T08:38:23.348 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Command line: ntpd -gq 2024-09-17T08:38:23.348 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: ---------------------------------------------------- 2024-09-17T08:38:23.349 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T08:38:23.349 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T08:38:23.349 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: corporation. Support and training for ntp-4 are 2024-09-17T08:38:23.349 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: available at https://www.nwtime.org/support 2024-09-17T08:38:23.349 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: ---------------------------------------------------- 2024-09-17T08:38:23.351 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: proto: precision = 0.052 usec (-24) 2024-09-17T08:38:23.351 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: basedate set to 2022-02-04 2024-09-17T08:38:23.351 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: gps base set to 2022-02-06 (week 2196) 2024-09-17T08:38:23.351 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T08:38:23.351 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T08:38:23.352 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T08:38:23.353 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T08:38:23.353 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T08:38:23.353 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T08:38:23.353 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T08:38:23.353 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2024-09-17T08:38:23.353 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Listen normally on 4 lo [::1]:123 2024-09-17T08:38:23.354 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2024-09-17T08:38:23.354 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:23 ntpd[18483]: Listening on routing socket on fd #22 for interface updates 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Command line: ntpd -gq 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: ---------------------------------------------------- 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: corporation. Support and training for ntp-4 are 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: available at https://www.nwtime.org/support 2024-09-17T08:38:23.377 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: ---------------------------------------------------- 2024-09-17T08:38:23.378 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: proto: precision = 0.045 usec (-24) 2024-09-17T08:38:23.378 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: basedate set to 2022-02-04 2024-09-17T08:38:23.378 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: gps base set to 2022-02-06 (week 2196) 2024-09-17T08:38:23.378 INFO:teuthology.orchestra.run.smithi136.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T08:38:23.379 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T08:38:23.379 INFO:teuthology.orchestra.run.smithi136.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Listen normally on 3 enp3s0f1 172.21.15.136:123 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Listen normally on 4 lo [::1]:123 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e43%5]:123 2024-09-17T08:38:23.380 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:23 ntpd[18457]: Listening on routing socket on fd #22 for interface updates 2024-09-17T08:38:24.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:24 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:24.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:24 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:24.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:24 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:24.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:24 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:24.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:24 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:24.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:24 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:24.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:24 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:25.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:25 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:25.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:25 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:25.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:25 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:25.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:25 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:25.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:25 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:25.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:25 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:26 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:26.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:26.379 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:26.379 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:26 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:27.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:27.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:27 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:27.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:27 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:27.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:27 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:27.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:27 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:27.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:27 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:27.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:27 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:27.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:27 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:28.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:28 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:28.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:28.379 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:28.379 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:28.379 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:28 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:29.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:29 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:29.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:29 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:29.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:29 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:29.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:29 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:29.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:29 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:29.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:29 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:29.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:29 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:29.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:29 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:29.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:29 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:29.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:29 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:29.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:29 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:29.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:29 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:30.349 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stdout:17 Sep 08:38:30 ntpd[18483]: ntpd: time slew -0.002984 s 2024-09-17T08:38:30.350 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew -0.002984s 2024-09-17T08:38:30.351 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T08:38:30.351 INFO:teuthology.orchestra.run.smithi078.stderr:17 Sep 08:38:30 ntpd[18483]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T08:38:30.377 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T08:38:30.378 INFO:teuthology.orchestra.run.smithi136.stdout:17 Sep 08:38:30 ntpd[18457]: ntpd: time slew -0.005853 s 2024-09-17T08:38:30.379 INFO:teuthology.orchestra.run.smithi136.stdout:ntpd: time slew -0.005853s 2024-09-17T08:38:30.379 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T08:38:30.379 INFO:teuthology.orchestra.run.smithi136.stderr:17 Sep 08:38:30 ntpd[18457]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T08:38:30.408 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T08:38:30.408 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-09-17T08:38:30.408 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.409 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.409 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.409 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.426 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T08:38:30.426 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2024-09-17T08:38:30.426 INFO:teuthology.orchestra.run.smithi136.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.426 INFO:teuthology.orchestra.run.smithi136.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.426 INFO:teuthology.orchestra.run.smithi136.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.427 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T08:38:30.427 INFO:teuthology.run_tasks:Running task install... 2024-09-17T08:38:30.435 DEBUG:teuthology.task.install:project ceph 2024-09-17T08:38:30.436 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}} 2024-09-17T08:38:30.436 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'} 2024-09-17T08:38:30.436 INFO:teuthology.task.install:Using flavor: default 2024-09-17T08:38:30.446 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T08:38:30.446 INFO:teuthology.task.install:extra packages: [] 2024-09-17T08:38:30.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2024-09-17T08:38:30.447 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-key list | grep Ceph 2024-09-17T08:38:30.504 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T08:38:30.526 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T08:38:30.531 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T08:38:30.531 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T08:38:30.532 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T08:38:30.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:38:30.551 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T08:38:30.551 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T08:38:30.552 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T08:38:30.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:38:30.676 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/ 2024-09-17T08:38:30.676 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:38:30.691 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/ 2024-09-17T08:38:30.691 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:38:30.787 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:38:30.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T08:38:30.799 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:38:30.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T08:38:30.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-17T08:38:30.815 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-09-17T08:38:30.992 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T08:38:31.028 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T08:38:31.038 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T08:38:31.052 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T08:38:31.059 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T08:38:31.073 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T08:38:31.081 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T08:38:31.101 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T08:38:31.101 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,437 B] 2024-09-17T08:38:31.102 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,437 B] 2024-09-17T08:38:31.108 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T08:38:31.111 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T08:38:31.130 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-17T08:38:31.130 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-17T08:38:31.174 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T08:38:31.187 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T08:38:31.255 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T08:38:31.269 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T08:38:31.409 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 28.8 kB in 0s (69.4 kB/s) 2024-09-17T08:38:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 28.8 kB in 0s (59.4 kB/s) 2024-09-17T08:38:32.404 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-09-17T08:38:32.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1jammy cephadm=18.2.4-855-g19e2a2be-1jammy ceph-mds=18.2.4-855-g19e2a2be-1jammy ceph-mgr=18.2.4-855-g19e2a2be-1jammy ceph-common=18.2.4-855-g19e2a2be-1jammy ceph-fuse=18.2.4-855-g19e2a2be-1jammy ceph-test=18.2.4-855-g19e2a2be-1jammy ceph-volume=18.2.4-855-g19e2a2be-1jammy radosgw=18.2.4-855-g19e2a2be-1jammy python3-rados=18.2.4-855-g19e2a2be-1jammy python3-rgw=18.2.4-855-g19e2a2be-1jammy python3-cephfs=18.2.4-855-g19e2a2be-1jammy python3-rbd=18.2.4-855-g19e2a2be-1jammy libcephfs2=18.2.4-855-g19e2a2be-1jammy libcephfs-dev=18.2.4-855-g19e2a2be-1jammy librados2=18.2.4-855-g19e2a2be-1jammy librbd1=18.2.4-855-g19e2a2be-1jammy rbd-fuse=18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:38:32.462 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-17T08:38:32.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1jammy cephadm=18.2.4-855-g19e2a2be-1jammy ceph-mds=18.2.4-855-g19e2a2be-1jammy ceph-mgr=18.2.4-855-g19e2a2be-1jammy ceph-common=18.2.4-855-g19e2a2be-1jammy ceph-fuse=18.2.4-855-g19e2a2be-1jammy ceph-test=18.2.4-855-g19e2a2be-1jammy ceph-volume=18.2.4-855-g19e2a2be-1jammy radosgw=18.2.4-855-g19e2a2be-1jammy python3-rados=18.2.4-855-g19e2a2be-1jammy python3-rgw=18.2.4-855-g19e2a2be-1jammy python3-cephfs=18.2.4-855-g19e2a2be-1jammy python3-rbd=18.2.4-855-g19e2a2be-1jammy libcephfs2=18.2.4-855-g19e2a2be-1jammy libcephfs-dev=18.2.4-855-g19e2a2be-1jammy librados2=18.2.4-855-g19e2a2be-1jammy librbd1=18.2.4-855-g19e2a2be-1jammy rbd-fuse=18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:38:32.482 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-09-17T08:38:32.548 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-17T08:38:32.694 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-09-17T08:38:32.695 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-09-17T08:38:32.759 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-17T08:38:32.760 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-17T08:38:32.905 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T08:38:32.906 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T08:38:32.906 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T08:38:32.906 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T08:38:32.906 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T08:38:32.906 INFO:teuthology.orchestra.run.smithi136.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T08:38:32.906 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T08:38:32.907 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2024-09-17T08:38:32.907 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T08:38:32.907 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T08:38:32.908 INFO:teuthology.orchestra.run.smithi136.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-17T08:38:32.908 INFO:teuthology.orchestra.run.smithi136.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T08:38:32.908 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-17T08:38:32.908 INFO:teuthology.orchestra.run.smithi136.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T08:38:32.908 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T08:38:32.909 INFO:teuthology.orchestra.run.smithi136.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-17T08:38:32.910 INFO:teuthology.orchestra.run.smithi136.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-17T08:38:32.911 INFO:teuthology.orchestra.run.smithi136.stdout: python3-watchdog 2024-09-17T08:38:32.911 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2024-09-17T08:38:32.911 INFO:teuthology.orchestra.run.smithi136.stdout: btrfs-tools 2024-09-17T08:38:32.965 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T08:38:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T08:38:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T08:38:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T08:38:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T08:38:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T08:38:32.966 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T08:38:32.967 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-17T08:38:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T08:38:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T08:38:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-17T08:38:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T08:38:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-17T08:38:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T08:38:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T08:38:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T08:38:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T08:38:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T08:38:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T08:38:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: python3-watchdog 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-09-17T08:38:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2024-09-17T08:38:33.011 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2024-09-17T08:38:33.011 INFO:teuthology.orchestra.run.smithi136.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T08:38:33.012 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T08:38:33.012 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T08:38:33.012 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-17T08:38:33.012 INFO:teuthology.orchestra.run.smithi136.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T08:38:33.012 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T08:38:33.013 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T08:38:33.014 INFO:teuthology.orchestra.run.smithi136.stdout: socat xmlstarlet 2024-09-17T08:38:33.072 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-17T08:38:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T08:38:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T08:38:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T08:38:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-17T08:38:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T08:38:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-17T08:38:33.073 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T08:38:33.073 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 163 MB of archives. 2024-09-17T08:38:33.074 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-17T08:38:33.074 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-17T08:38:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-17T08:38:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T08:38:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T08:38:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-17T08:38:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T08:38:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T08:38:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T08:38:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T08:38:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: socat xmlstarlet 2024-09-17T08:38:33.130 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T08:38:33.131 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T08:38:33.131 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 163 MB of archives. 2024-09-17T08:38:33.131 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-17T08:38:33.131 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-17T08:38:33.156 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1jammy [3,452 kB] 2024-09-17T08:38:33.165 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T08:38:33.168 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T08:38:33.183 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T08:38:33.190 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T08:38:33.213 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1jammy [3,452 kB] 2024-09-17T08:38:33.227 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T08:38:33.229 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T08:38:33.234 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T08:38:33.239 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T08:38:33.244 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T08:38:33.250 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T08:38:33.254 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T08:38:33.255 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T08:38:33.255 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T08:38:33.264 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T08:38:33.264 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T08:38:33.265 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T08:38:33.266 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T08:38:33.273 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T08:38:33.273 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T08:38:33.273 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T08:38:33.290 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T08:38:33.290 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T08:38:33.291 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T08:38:33.293 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T08:38:33.294 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T08:38:33.294 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T08:38:33.294 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T08:38:33.297 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T08:38:33.302 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T08:38:33.310 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T08:38:33.310 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T08:38:33.310 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T08:38:33.313 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T08:38:33.317 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T08:38:33.317 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T08:38:33.317 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T08:38:33.325 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T08:38:33.326 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T08:38:33.326 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T08:38:33.327 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T08:38:33.327 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T08:38:33.328 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T08:38:33.328 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T08:38:33.334 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T08:38:33.334 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T08:38:33.334 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T08:38:33.335 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T08:38:33.335 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T08:38:33.336 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T08:38:33.343 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1jammy [3,108 kB] 2024-09-17T08:38:33.344 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T08:38:33.346 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T08:38:33.347 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T08:38:33.352 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T08:38:33.353 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T08:38:33.353 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T08:38:33.354 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T08:38:33.356 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T08:38:33.357 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T08:38:33.357 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T08:38:33.358 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T08:38:33.361 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T08:38:33.362 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T08:38:33.365 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T08:38:33.365 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T08:38:33.366 INFO:teuthology.orchestra.run.smithi136.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T08:38:33.368 INFO:teuthology.orchestra.run.smithi136.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T08:38:33.370 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T08:38:33.371 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T08:38:33.387 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T08:38:33.389 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T08:38:33.389 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T08:38:33.390 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T08:38:33.396 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T08:38:33.396 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T08:38:33.396 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T08:38:33.397 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T08:38:33.405 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T08:38:33.407 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T08:38:33.407 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1jammy [3,108 kB] 2024-09-17T08:38:33.415 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T08:38:33.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T08:38:33.418 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T08:38:33.420 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T08:38:33.421 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T08:38:33.422 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T08:38:33.422 INFO:teuthology.orchestra.run.smithi136.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T08:38:33.423 INFO:teuthology.orchestra.run.smithi136.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T08:38:33.424 INFO:teuthology.orchestra.run.smithi136.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T08:38:33.424 INFO:teuthology.orchestra.run.smithi136.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T08:38:33.425 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T08:38:33.425 INFO:teuthology.orchestra.run.smithi136.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T08:38:33.425 INFO:teuthology.orchestra.run.smithi136.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T08:38:33.426 INFO:teuthology.orchestra.run.smithi136.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T08:38:33.428 INFO:teuthology.orchestra.run.smithi136.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T08:38:33.428 INFO:teuthology.orchestra.run.smithi136.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T08:38:33.449 INFO:teuthology.orchestra.run.smithi136.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T08:38:33.449 INFO:teuthology.orchestra.run.smithi136.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1jammy [683 kB] 2024-09-17T08:38:33.463 INFO:teuthology.orchestra.run.smithi136.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1jammy [357 kB] 2024-09-17T08:38:33.466 INFO:teuthology.orchestra.run.smithi136.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T08:38:33.468 INFO:teuthology.orchestra.run.smithi136.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T08:38:33.468 INFO:teuthology.orchestra.run.smithi136.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T08:38:33.470 INFO:teuthology.orchestra.run.smithi136.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1jammy [32.8 kB] 2024-09-17T08:38:33.471 INFO:teuthology.orchestra.run.smithi136.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1jammy [180 kB] 2024-09-17T08:38:33.475 INFO:teuthology.orchestra.run.smithi136.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1jammy [63.8 kB] 2024-09-17T08:38:33.476 INFO:teuthology.orchestra.run.smithi136.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1jammy [334 kB] 2024-09-17T08:38:33.477 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T08:38:33.477 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T08:38:33.478 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T08:38:33.479 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T08:38:33.480 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T08:38:33.480 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T08:38:33.480 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T08:38:33.482 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T08:38:33.482 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T08:38:33.483 INFO:teuthology.orchestra.run.smithi136.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1jammy [5,934 kB] 2024-09-17T08:38:33.484 INFO:teuthology.orchestra.run.smithi136.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T08:38:33.484 INFO:teuthology.orchestra.run.smithi136.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T08:38:33.484 INFO:teuthology.orchestra.run.smithi136.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T08:38:33.485 INFO:teuthology.orchestra.run.smithi136.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T08:38:33.485 INFO:teuthology.orchestra.run.smithi136.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T08:38:33.486 INFO:teuthology.orchestra.run.smithi136.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T08:38:33.492 INFO:teuthology.orchestra.run.smithi136.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T08:38:33.493 INFO:teuthology.orchestra.run.smithi136.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T08:38:33.495 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T08:38:33.496 INFO:teuthology.orchestra.run.smithi136.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T08:38:33.508 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1jammy [683 kB] 2024-09-17T08:38:33.509 INFO:teuthology.orchestra.run.smithi136.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T08:38:33.511 INFO:teuthology.orchestra.run.smithi136.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T08:38:33.512 INFO:teuthology.orchestra.run.smithi136.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T08:38:33.513 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T08:38:33.514 INFO:teuthology.orchestra.run.smithi136.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T08:38:33.516 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T08:38:33.516 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T08:38:33.516 INFO:teuthology.orchestra.run.smithi136.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T08:38:33.520 INFO:teuthology.orchestra.run.smithi136.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T08:38:33.522 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1jammy [357 kB] 2024-09-17T08:38:33.523 INFO:teuthology.orchestra.run.smithi136.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T08:38:33.526 INFO:teuthology.orchestra.run.smithi136.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T08:38:33.528 INFO:teuthology.orchestra.run.smithi136.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T08:38:33.531 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T08:38:33.531 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T08:38:33.531 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T08:38:33.532 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T08:38:33.532 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T08:38:33.532 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T08:38:33.533 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T08:38:33.534 INFO:teuthology.orchestra.run.smithi136.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T08:38:33.543 INFO:teuthology.orchestra.run.smithi136.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T08:38:33.544 INFO:teuthology.orchestra.run.smithi136.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T08:38:33.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1jammy [32.8 kB] 2024-09-17T08:38:33.549 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1jammy [180 kB] 2024-09-17T08:38:33.550 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T08:38:33.553 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1jammy [63.8 kB] 2024-09-17T08:38:33.554 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T08:38:33.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1jammy [334 kB] 2024-09-17T08:38:33.556 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T08:38:33.557 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T08:38:33.557 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T08:38:33.561 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1jammy [5,934 kB] 2024-09-17T08:38:33.567 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T08:38:33.570 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T08:38:33.573 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T08:38:33.576 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T08:38:33.576 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T08:38:33.584 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T08:38:33.591 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T08:38:33.591 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T08:38:33.592 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T08:38:33.666 INFO:teuthology.orchestra.run.smithi136.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1jammy [112 kB] 2024-09-17T08:38:33.677 INFO:teuthology.orchestra.run.smithi136.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1jammy [445 kB] 2024-09-17T08:38:33.686 INFO:teuthology.orchestra.run.smithi136.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1jammy [22.0 MB] 2024-09-17T08:38:33.772 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1jammy [112 kB] 2024-09-17T08:38:33.775 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1jammy [445 kB] 2024-09-17T08:38:33.784 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1jammy [22.0 MB] 2024-09-17T08:38:34.491 INFO:teuthology.orchestra.run.smithi136.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1jammy [5,006 kB] 2024-09-17T08:38:34.561 INFO:teuthology.orchestra.run.smithi136.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1jammy [241 kB] 2024-09-17T08:38:34.564 INFO:teuthology.orchestra.run.smithi136.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1jammy [130 kB] 2024-09-17T08:38:34.566 INFO:teuthology.orchestra.run.smithi136.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1jammy [1,494 kB] 2024-09-17T08:38:34.602 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1jammy [5,006 kB] 2024-09-17T08:38:34.610 INFO:teuthology.orchestra.run.smithi136.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1jammy [6,085 kB] 2024-09-17T08:38:34.723 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1jammy [241 kB] 2024-09-17T08:38:34.728 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1jammy [130 kB] 2024-09-17T08:38:34.731 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1jammy [1,494 kB] 2024-09-17T08:38:34.777 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1jammy [6,085 kB] 2024-09-17T08:38:34.790 INFO:teuthology.orchestra.run.smithi136.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1jammy [22.4 MB] 2024-09-17T08:38:35.002 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1jammy [22.4 MB] 2024-09-17T08:38:35.548 INFO:teuthology.orchestra.run.smithi136.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1jammy [14.2 kB] 2024-09-17T08:38:35.549 INFO:teuthology.orchestra.run.smithi136.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1jammy [835 kB] 2024-09-17T08:38:35.562 INFO:teuthology.orchestra.run.smithi136.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1jammy [2,159 kB] 2024-09-17T08:38:35.594 INFO:teuthology.orchestra.run.smithi136.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1jammy [240 kB] 2024-09-17T08:38:35.597 INFO:teuthology.orchestra.run.smithi136.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1jammy [145 kB] 2024-09-17T08:38:35.599 INFO:teuthology.orchestra.run.smithi136.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1jammy [2,233 kB] 2024-09-17T08:38:35.641 INFO:teuthology.orchestra.run.smithi136.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1jammy [8,625 kB] 2024-09-17T08:38:35.895 INFO:teuthology.orchestra.run.smithi136.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1jammy [14.3 kB] 2024-09-17T08:38:35.896 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1jammy [14.2 kB] 2024-09-17T08:38:35.897 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1jammy [835 kB] 2024-09-17T08:38:35.917 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1jammy [2,159 kB] 2024-09-17T08:38:35.934 INFO:teuthology.orchestra.run.smithi136.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1jammy [42.8 MB] 2024-09-17T08:38:35.951 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1jammy [240 kB] 2024-09-17T08:38:35.955 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1jammy [145 kB] 2024-09-17T08:38:35.958 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1jammy [2,233 kB] 2024-09-17T08:38:36.003 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1jammy [8,625 kB] 2024-09-17T08:38:36.294 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1jammy [14.3 kB] 2024-09-17T08:38:36.295 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1jammy [42.8 MB] 2024-09-17T08:38:37.391 INFO:teuthology.orchestra.run.smithi136.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1jammy [122 kB] 2024-09-17T08:38:37.394 INFO:teuthology.orchestra.run.smithi136.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1jammy [38.3 kB] 2024-09-17T08:38:37.395 INFO:teuthology.orchestra.run.smithi136.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1jammy [11.7 MB] 2024-09-17T08:38:37.681 INFO:teuthology.orchestra.run.smithi136.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1jammy [93.1 kB] 2024-09-17T08:38:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1jammy [122 kB] 2024-09-17T08:38:37.908 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1jammy [38.3 kB] 2024-09-17T08:38:37.909 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1jammy [11.7 MB] 2024-09-17T08:38:38.068 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1jammy [93.1 kB] 2024-09-17T08:38:38.251 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 163 MB in 5s (34.9 MB/s) 2024-09-17T08:38:38.361 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-17T08:38:38.417 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T08:38:38.422 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-17T08:38:38.502 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-17T08:38:38.630 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 163 MB in 5s (32.6 MB/s) 2024-09-17T08:38:38.765 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-17T08:38:38.805 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T08:38:38.832 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T08:38:38.858 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T08:38:38.863 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-17T08:38:38.872 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T08:38:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-17T08:38:39.184 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T08:38:39.210 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T08:38:39.259 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T08:38:39.284 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T08:38:39.310 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T08:38:39.350 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T08:38:39.562 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T08:38:39.588 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T08:38:39.628 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T08:38:39.662 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T08:38:39.688 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T08:38:39.720 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T08:38:40.032 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T08:38:40.058 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T08:38:40.065 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T08:38:40.092 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T08:38:40.098 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T08:38:40.157 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:38:40.510 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T08:38:40.535 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T08:38:40.536 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T08:38:40.562 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T08:38:40.568 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:38:40.610 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:38:40.880 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T08:38:40.906 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T08:38:40.946 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:38:41.047 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T08:38:41.074 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T08:38:41.113 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:38:41.308 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T08:38:41.335 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T08:38:41.374 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T08:38:41.442 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T08:38:41.468 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T08:38:41.500 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:38:41.638 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librados2. 2024-09-17T08:38:41.664 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:41.704 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:41.820 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T08:38:41.846 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T08:38:41.887 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T08:38:42.132 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librbd1. 2024-09-17T08:38:42.158 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../009-librbd1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:42.198 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:42.215 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2024-09-17T08:38:42.241 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:42.281 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:42.635 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T08:38:42.661 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:42.701 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2024-09-17T08:38:42.702 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:42.727 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-librbd1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:42.767 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:42.962 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rados. 2024-09-17T08:38:42.977 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../011-python3-rados_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:43.012 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:43.195 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T08:38:43.210 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:43.245 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:43.307 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T08:38:43.333 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:38:43.373 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:43.498 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2024-09-17T08:38:43.524 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-python3-rados_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:43.565 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:43.625 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T08:38:43.641 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:43.684 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:43.876 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T08:38:43.902 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:38:43.942 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:44.003 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T08:38:44.030 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:38:44.087 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:44.195 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T08:38:44.221 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:44.261 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:44.390 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T08:38:44.405 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T08:38:44.456 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T08:38:44.539 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T08:38:44.554 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:38:44.589 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:44.742 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T08:38:44.769 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T08:38:44.801 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T08:38:44.884 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T08:38:44.910 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T08:38:44.951 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T08:38:45.062 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T08:38:45.077 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:45.120 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:45.262 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T08:38:45.289 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T08:38:45.329 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T08:38:45.465 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T08:38:45.491 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T08:38:45.531 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T08:38:45.590 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T08:38:45.605 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:45.648 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:45.826 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librgw2. 2024-09-17T08:38:45.852 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:45.884 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:45.951 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T08:38:45.966 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T08:38:46.001 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T08:38:46.338 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2024-09-17T08:38:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:46.379 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T08:38:46.404 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:46.405 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:46.445 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:46.781 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T08:38:46.807 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T08:38:46.848 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T08:38:46.898 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T08:38:46.914 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:46.965 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:47.167 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T08:38:47.193 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:47.234 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:47.251 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T08:38:47.277 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T08:38:47.309 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T08:38:47.562 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-common. 2024-09-17T08:38:47.587 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T08:38:47.588 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:47.614 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:47.629 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:47.654 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:48.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2024-09-17T08:38:48.109 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:48.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:48.935 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-base. 2024-09-17T08:38:48.961 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:49.011 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:49.439 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2024-09-17T08:38:49.465 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:38:49.514 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:38:49.581 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T08:38:49.607 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T08:38:49.647 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T08:38:49.950 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T08:38:49.976 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T08:38:50.016 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T08:38:50.093 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T08:38:50.119 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T08:38:50.159 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T08:38:50.320 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T08:38:50.346 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T08:38:50.386 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T08:38:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T08:38:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T08:38:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T08:38:50.791 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T08:38:50.817 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T08:38:50.856 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T08:38:50.857 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T08:38:50.883 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T08:38:51.089 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T08:38:51.160 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T08:38:51.186 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T08:38:51.227 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T08:38:51.575 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T08:38:51.602 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T08:38:51.639 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T08:38:51.642 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T08:38:51.666 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T08:38:51.813 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T08:38:51.928 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T08:38:51.954 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T08:38:51.995 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T08:38:52.074 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T08:38:52.101 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T08:38:52.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T08:38:52.256 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-portend. 2024-09-17T08:38:52.282 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-17T08:38:52.323 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T08:38:52.452 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2024-09-17T08:38:52.478 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-17T08:38:52.535 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T08:38:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T08:38:52.652 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T08:38:52.692 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T08:38:52.838 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T08:38:52.864 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T08:38:52.905 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T08:38:53.003 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T08:38:53.030 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T08:38:53.070 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T08:38:53.166 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T08:38:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T08:38:53.216 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T08:38:53.440 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T08:38:53.466 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T08:38:53.507 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T08:38:53.562 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T08:38:53.588 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T08:38:53.628 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T08:38:53.818 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T08:38:53.844 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T08:38:53.885 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T08:38:53.906 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T08:38:53.932 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T08:38:53.964 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T08:38:54.162 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T08:38:54.177 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T08:38:54.212 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T08:38:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T08:38:54.269 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T08:38:54.309 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T08:38:54.474 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-mako. 2024-09-17T08:38:54.500 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T08:38:54.540 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T08:38:54.612 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2024-09-17T08:38:54.639 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T08:38:54.695 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T08:38:54.877 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T08:38:54.903 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T08:38:54.943 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T08:38:55.024 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T08:38:55.050 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T08:38:55.090 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T08:38:55.255 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T08:38:55.281 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T08:38:55.321 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T08:38:55.352 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T08:38:55.378 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T08:38:55.410 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T08:38:55.599 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webob. 2024-09-17T08:38:55.625 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T08:38:55.657 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T08:38:55.696 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2024-09-17T08:38:55.722 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T08:38:55.762 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T08:38:55.960 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T08:38:55.987 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T08:38:56.022 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T08:38:56.107 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T08:38:56.134 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T08:38:56.185 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T08:38:56.288 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T08:38:56.315 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T08:38:56.355 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T08:38:56.519 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T08:38:56.545 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T08:38:56.658 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-paste. 2024-09-17T08:38:56.684 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T08:38:56.710 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T08:38:56.724 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T08:38:56.994 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T08:38:57.009 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T08:38:57.061 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T08:38:57.130 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2024-09-17T08:38:57.157 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T08:38:57.188 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T08:38:57.372 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T08:38:57.398 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T08:38:57.438 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T08:38:57.517 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T08:38:57.543 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T08:38:57.583 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T08:38:57.767 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T08:38:57.793 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T08:38:57.833 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T08:38:57.853 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T08:38:57.879 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T08:38:57.911 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T08:38:58.119 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T08:38:58.146 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T08:38:58.177 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T08:38:58.214 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T08:38:58.241 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T08:38:58.281 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T08:38:58.482 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T08:38:58.509 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T08:38:58.541 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T08:38:58.601 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T08:38:58.627 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T08:38:58.667 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T08:38:58.852 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-idna. 2024-09-17T08:38:58.878 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T08:38:58.918 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T08:38:59.022 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T08:38:59.049 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T08:38:59.089 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T08:38:59.230 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T08:38:59.256 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T08:38:59.296 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T08:38:59.400 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2024-09-17T08:38:59.427 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T08:38:59.467 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T08:38:59.616 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-requests. 2024-09-17T08:38:59.643 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T08:38:59.682 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T08:38:59.745 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T08:38:59.771 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T08:38:59.803 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T08:38:59.994 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T08:39:00.020 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T08:39:00.060 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T08:39:00.115 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2024-09-17T08:39:00.141 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T08:39:00.206 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T08:39:00.356 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T08:39:00.371 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:00.413 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:00.484 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T08:39:00.499 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T08:39:00.534 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T08:39:00.727 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T08:39:00.753 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:00.793 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:00.837 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T08:39:00.860 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:00.904 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:01.245 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T08:39:01.271 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T08:39:01.284 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T08:39:01.311 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:01.313 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T08:39:01.350 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:01.624 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T08:39:01.628 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T08:39:01.650 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T08:39:01.655 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T08:39:01.691 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T08:39:01.695 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T08:39:01.998 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T08:39:02.018 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T08:39:02.024 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T08:39:02.045 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:02.064 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T08:39:02.076 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:02.401 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T08:39:02.427 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:02.455 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T08:39:02.468 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:02.482 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:02.522 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:02.813 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T08:39:02.839 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:02.879 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:03.109 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T08:39:03.135 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:03.475 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T08:39:03.501 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:03.541 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:04.179 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph. 2024-09-17T08:39:04.205 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../060-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:04.237 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:04.556 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T08:39:04.570 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2024-09-17T08:39:04.583 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:04.596 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:04.623 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:04.636 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:04.906 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T08:39:04.932 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:04.972 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:04.984 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T08:39:05.011 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:05.051 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:05.351 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T08:39:05.378 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:05.404 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package cephadm. 2024-09-17T08:39:05.417 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:05.431 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../063-cephadm_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:05.462 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:05.749 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T08:39:05.775 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T08:39:05.787 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2024-09-17T08:39:05.814 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-cephadm_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:05.815 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T08:39:05.854 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:06.115 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T08:39:06.118 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T08:39:06.130 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T08:39:06.133 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T08:39:06.165 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T08:39:06.176 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:07.169 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T08:39:07.195 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T08:39:07.235 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:07.940 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-babel. 2024-09-17T08:39:07.967 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T08:39:08.006 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2024-09-17T08:39:08.242 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T08:39:08.282 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:08.301 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T08:39:08.328 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T08:39:08.368 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T08:39:08.585 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T08:39:08.612 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T08:39:08.652 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T08:39:08.688 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T08:39:08.714 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:08.754 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:08.964 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T08:39:08.990 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:09.030 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:09.091 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T08:39:09.118 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T08:39:09.158 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T08:39:09.342 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T08:39:09.369 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T08:39:09.409 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T08:39:09.469 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-py. 2024-09-17T08:39:09.496 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-17T08:39:09.536 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T08:39:09.720 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2024-09-17T08:39:09.747 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-17T08:39:09.787 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T08:39:09.881 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T08:39:09.908 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T08:39:09.947 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T08:39:10.099 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T08:39:10.126 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T08:39:10.165 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T08:39:10.209 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-toml. 2024-09-17T08:39:10.235 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-17T08:39:10.267 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T08:39:10.460 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2024-09-17T08:39:10.487 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-17T08:39:10.526 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T08:39:10.536 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T08:39:10.563 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T08:39:10.611 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T08:39:10.829 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T08:39:10.856 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T08:39:10.896 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T08:39:10.915 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T08:39:10.942 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T08:39:10.973 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T08:39:11.243 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-routes. 2024-09-17T08:39:11.250 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T08:39:11.269 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T08:39:11.276 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T08:39:11.309 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T08:39:11.316 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T08:39:11.604 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T08:39:11.620 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2024-09-17T08:39:11.620 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:11.647 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T08:39:11.654 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T08:39:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T08:39:12.058 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:12.893 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T08:39:12.921 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T08:39:12.959 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T08:39:13.355 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T08:39:13.371 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T08:39:13.413 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T08:39:13.447 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T08:39:13.473 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T08:39:13.513 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T08:39:13.867 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T08:39:13.892 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T08:39:13.894 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T08:39:13.908 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T08:39:13.933 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T08:39:13.942 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T08:39:14.228 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T08:39:14.255 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T08:39:14.294 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T08:39:14.313 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T08:39:14.340 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T08:39:14.379 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T08:39:14.682 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T08:39:14.710 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T08:39:14.749 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T08:39:15.011 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T08:39:15.039 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:15.078 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:15.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T08:39:15.436 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:15.474 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:16.047 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T08:39:16.074 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T08:39:16.114 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T08:39:16.402 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T08:39:16.429 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T08:39:16.468 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T08:39:16.485 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T08:39:16.512 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T08:39:16.551 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T08:39:16.840 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T08:39:16.867 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T08:39:16.907 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T08:39:17.072 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T08:39:17.099 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T08:39:17.141 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T08:39:17.194 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T08:39:17.209 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T08:39:17.243 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T08:39:17.450 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T08:39:17.477 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-17T08:39:17.516 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T08:39:17.780 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T08:39:17.807 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-17T08:39:17.812 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T08:39:17.839 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T08:39:17.846 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T08:39:17.878 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T08:39:18.168 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T08:39:18.194 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T08:39:18.199 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T08:39:18.225 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T08:39:18.233 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T08:39:18.265 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T08:39:18.562 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T08:39:18.576 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T08:39:18.589 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T08:39:18.603 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T08:39:18.628 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T08:39:18.642 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T08:39:18.906 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T08:39:18.922 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T08:39:18.956 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T08:39:18.979 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T08:39:19.006 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T08:39:19.045 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T08:39:19.260 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T08:39:19.287 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T08:39:19.326 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T08:39:19.710 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T08:39:19.737 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:19.768 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:19.991 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T08:39:20.019 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:20.057 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:20.071 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T08:39:20.098 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T08:39:20.137 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T08:39:20.385 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T08:39:20.413 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T08:39:20.451 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T08:39:20.457 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T08:39:20.484 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T08:39:20.523 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T08:39:20.763 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T08:39:20.767 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package jq. 2024-09-17T08:39:20.783 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T08:39:20.791 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T08:39:20.817 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T08:39:20.832 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T08:39:21.056 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package socat. 2024-09-17T08:39:21.066 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2024-09-17T08:39:21.071 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T08:39:21.082 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T08:39:21.114 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T08:39:21.124 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T08:39:21.376 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2024-09-17T08:39:21.393 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T08:39:21.408 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T08:39:21.424 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T08:39:21.434 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T08:39:21.467 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T08:39:21.747 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T08:39:21.774 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T08:39:21.813 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T08:39:21.829 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-test. 2024-09-17T08:39:21.845 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../096-ceph-test_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:21.887 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:22.167 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2024-09-17T08:39:22.183 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-ceph-test_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:22.226 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:23.782 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T08:39:23.806 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:23.840 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:24.136 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T08:39:24.163 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:24.202 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:24.573 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T08:39:24.581 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T08:39:24.600 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T08:39:24.605 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-17T08:39:24.639 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T08:39:24.639 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:24.921 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T08:39:24.934 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:24.968 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:24.976 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T08:39:25.004 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T08:39:25.043 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T08:39:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T08:39:25.374 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T08:39:25.413 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T08:39:25.446 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T08:39:25.474 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T08:39:25.512 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T08:39:25.751 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T08:39:25.767 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T08:39:25.809 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T08:39:25.833 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T08:39:25.860 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T08:39:25.899 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T08:39:26.221 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T08:39:26.235 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T08:39:26.248 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T08:39:26.263 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T08:39:26.288 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T08:39:26.301 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T08:39:26.608 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T08:39:26.636 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T08:39:26.674 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T08:39:26.747 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T08:39:26.774 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T08:39:26.813 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T08:39:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T08:39:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T08:39:27.069 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T08:39:27.124 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T08:39:27.152 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T08:39:27.191 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T08:39:27.468 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T08:39:27.484 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T08:39:27.526 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T08:39:27.690 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T08:39:27.717 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T08:39:27.765 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T08:39:28.309 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T08:39:28.337 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T08:39:28.376 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T08:39:28.389 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package radosgw. 2024-09-17T08:39:28.416 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../107-radosgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:28.455 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:28.654 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T08:39:28.669 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T08:39:28.711 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T08:39:29.208 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T08:39:29.236 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:29.274 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:29.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2024-09-17T08:39:29.435 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-radosgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:29.570 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T08:39:29.812 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T08:39:29.938 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T08:39:30.186 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T08:39:30.200 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T08:39:30.213 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-17T08:39:30.252 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:30.529 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T08:39:30.548 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T08:39:30.823 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T08:39:30.933 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T08:39:30.942 INFO:teuthology.orchestra.run.smithi136.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T08:39:31.007 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:31.197 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T08:39:31.539 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user cephadm....done 2024-09-17T08:39:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T08:39:31.687 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T08:39:31.963 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T08:39:32.021 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T08:39:32.093 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:32.214 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T08:39:32.491 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T08:39:32.610 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2024-09-17T08:39:32.766 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T08:39:32.933 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T08:39:33.026 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T08:39:33.192 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T08:39:33.285 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T08:39:33.302 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T08:39:33.412 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T08:39:33.620 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T08:39:33.680 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T08:39:33.931 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T08:39:33.963 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T08:39:34.032 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T08:39:34.231 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T08:39:34.317 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T08:39:34.507 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T08:39:34.669 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T08:39:34.760 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T08:39:34.920 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T08:39:35.000 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T08:39:35.221 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T08:39:35.243 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:35.481 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T08:39:35.502 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T08:39:35.604 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T08:39:35.715 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T08:39:35.846 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T08:39:35.949 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:35.972 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T08:39:36.201 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T08:39:36.332 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:36.335 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T08:39:36.457 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T08:39:36.594 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T08:39:36.708 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T08:39:36.721 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T08:39:36.959 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T08:39:37.080 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:37.181 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T08:39:37.269 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T08:39:37.424 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T08:39:37.692 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T08:39:37.954 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T08:39:37.993 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T08:39:38.213 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T08:39:38.339 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T08:39:38.465 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T08:39:38.695 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T08:39:38.758 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T08:39:38.963 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T08:39:39.081 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T08:39:39.125 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T08:39:39.182 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T08:39:39.368 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T08:39:39.483 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T08:39:39.729 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T08:39:39.868 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T08:39:40.030 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T08:39:40.119 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T08:39:40.381 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T08:39:40.496 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T08:39:40.648 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T08:39:40.758 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:40.780 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T08:39:41.034 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T08:39:41.116 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T08:39:41.343 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T08:39:41.358 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T08:39:41.484 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:41.785 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T08:39:42.111 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T08:39:42.557 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:39:42.666 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T08:39:42.909 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T08:39:43.018 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T08:39:43.144 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T08:39:43.276 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:39:43.410 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T08:39:43.462 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T08:39:43.713 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T08:39:43.961 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T08:39:43.964 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:39:44.087 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T08:39:44.090 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-17T08:39:44.199 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T08:39:44.213 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T08:39:44.492 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T08:39:44.498 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T08:39:44.726 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T08:39:44.732 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T08:39:44.961 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T08:39:44.975 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:39:45.101 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-17T08:39:45.220 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T08:39:45.227 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T08:39:45.480 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T08:39:45.554 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T08:39:45.755 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T08:39:45.822 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T08:39:45.899 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T08:39:46.057 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T08:39:46.174 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T08:39:46.291 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T08:39:46.300 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T08:39:46.550 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T08:39:46.584 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T08:39:46.810 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T08:39:46.886 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T08:39:46.936 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T08:39:47.128 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:47.212 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T08:39:47.338 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T08:39:47.515 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T08:39:47.631 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T08:39:47.764 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T08:39:47.890 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T08:39:47.924 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T08:39:48.175 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T08:39:48.483 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T08:39:48.581 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T08:39:48.726 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T08:39:48.828 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T08:39:48.963 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T08:39:48.969 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:39:49.095 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T08:39:49.364 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T08:39:49.413 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T08:39:49.599 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T08:39:49.722 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T08:39:49.850 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T08:39:49.976 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T08:39:50.006 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T08:39:50.124 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T08:39:50.302 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T08:39:50.375 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T08:39:50.617 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T08:39:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T08:39:50.877 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T08:39:50.921 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T08:39:51.039 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T08:39:51.262 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T08:39:51.298 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T08:39:51.549 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T08:39:51.563 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T08:39:51.817 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T08:39:51.915 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T08:39:52.041 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:52.166 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:52.202 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T08:39:52.267 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:52.369 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:52.486 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:52.503 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T08:39:52.697 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T08:39:52.864 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T08:39:52.965 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:52.990 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.091 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.092 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.192 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.217 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.343 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.405 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T08:39:53.405 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T08:39:53.469 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.673 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T08:39:53.932 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:53.935 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:54.059 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:54.103 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:54.210 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:54.246 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T08:39:54.419 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T08:39:54.419 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T08:39:54.911 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:55.037 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:55.172 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T08:39:55.443 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:55.552 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:55.678 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:55.804 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:55.930 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:56.326 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:56.438 INFO:teuthology.orchestra.run.smithi136.stdout:Adding group ceph....done 2024-09-17T08:39:56.452 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:56.579 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:56.713 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:56.816 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user ceph....done 2024-09-17T08:39:56.831 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:56.984 INFO:teuthology.orchestra.run.smithi136.stdout:Setting system user ceph properties....done 2024-09-17T08:39:56.996 INFO:teuthology.orchestra.run.smithi136.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T08:39:57.137 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T08:39:57.315 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2024-09-17T08:39:57.496 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T08:39:57.650 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2024-09-17T08:39:57.803 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2024-09-17T08:39:57.819 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T08:39:57.922 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:57.957 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T08:39:58.023 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:58.316 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T08:39:58.473 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T08:39:58.473 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T08:39:58.816 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:58.908 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:58.942 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:59.253 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T08:39:59.417 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T08:39:59.417 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T08:39:59.743 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:59.920 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:39:59.967 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T08:39:59.967 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T08:40:00.267 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T08:40:00.370 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:00.584 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T08:40:00.584 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T08:40:00.811 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:01.098 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T08:40:01.098 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T08:40:01.129 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:01.398 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T08:40:01.399 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T08:40:01.634 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:01.843 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T08:40:01.843 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T08:40:01.872 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:01.998 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:02.141 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:02.302 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:02.334 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T08:40:02.334 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T08:40:02.589 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T08:40:02.589 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T08:40:02.784 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:02.935 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:03.061 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:03.096 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:03.221 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:03.356 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:03.559 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T08:40:03.559 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T08:40:03.581 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T08:40:04.041 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:04.353 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:04.478 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:04.615 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T08:40:04.629 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-17T08:40:04.974 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T08:40:05.089 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T08:40:05.095 DEBUG:teuthology.parallel:result is None 2024-09-17T08:40:05.782 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T08:40:06.249 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T08:40:06.254 DEBUG:teuthology.parallel:result is None 2024-09-17T08:40:06.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:40:06.429 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2024-09-17T08:40:06.447 INFO:teuthology.orchestra.run.smithi078.stdout:18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:40:06.448 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:40:06.448 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1jammy is installed. 2024-09-17T08:40:06.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:40:06.594 DEBUG:teuthology.orchestra.run.smithi136:> dpkg-query -W -f '${Version}' ceph 2024-09-17T08:40:06.613 INFO:teuthology.orchestra.run.smithi136.stdout:18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:40:06.613 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1jammy 2024-09-17T08:40:06.613 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1jammy is installed. 2024-09-17T08:40:06.615 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T08:40:06.615 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:40:06.615 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T08:40:06.629 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:40:06.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T08:40:06.669 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T08:40:06.670 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:40:06.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T08:40:06.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T08:40:06.740 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:40:06.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T08:40:06.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T08:40:06.807 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T08:40:06.808 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:40:06.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T08:40:06.820 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T08:40:06.875 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:40:06.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T08:40:06.889 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T08:40:06.944 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T08:40:06.945 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:40:06.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T08:40:06.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T08:40:07.012 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:40:07.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T08:40:07.025 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T08:40:07.081 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T08:40:07.183 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'cephadm_mode': 'root'} 2024-09-17T08:40:07.183 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:40:07.184 INFO:tasks.cephadm:Cluster fsid is 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:40:07.184 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T08:40:07.184 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.78', 'mon.c': '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]', 'mon.b': '172.21.15.136'} 2024-09-17T08:40:07.184 INFO:tasks.cephadm:First mon is mon.a on smithi078 2024-09-17T08:40:07.184 INFO:tasks.cephadm:First mgr is y 2024-09-17T08:40:07.185 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T08:40:07.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname $(hostname -s) 2024-09-17T08:40:07.200 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2024-09-17T08:40:07.213 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-17T08:40:07.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:40:07.358 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/56094/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-855-g19e2a2be', 'node_name': '172.21.2.17+braggi17', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-855-g19e2a2be-1jammy'}, 'url': 'https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-16 16:50:43.846409', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'reef', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-17T08:40:07.500 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:40:07.501 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-17T08:40:07.501 DEBUG:teuthology.orchestra.run.smithi078:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T08:40:08.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-rw-r-- 1 ubuntu ubuntu 218649 Sep 17 08:40 /home/ubuntu/cephtest/cephadm 2024-09-17T08:40:08.107 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T08:40:08.694 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-rw-r-- 1 ubuntu ubuntu 218649 Sep 17 08:40 /home/ubuntu/cephtest/cephadm 2024-09-17T08:40:08.694 DEBUG:teuthology.orchestra.run.smithi078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T08:40:08.702 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T08:40:08.722 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 on all hosts... 2024-09-17T08:40:08.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 pull 2024-09-17T08:40:08.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 pull 2024-09-17T08:40:08.864 INFO:teuthology.orchestra.run.smithi078.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T08:40:08.872 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T08:41:06.135 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-17T08:41:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T08:41:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-17T08:41:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2024-09-17T08:41:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-17T08:41:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-09-17T08:41:06.136 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-17T08:41:15.159 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T08:41:15.160 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T08:41:15.160 INFO:teuthology.orchestra.run.smithi078.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-17T08:41:15.160 INFO:teuthology.orchestra.run.smithi078.stdout: "repo_digests": [ 2024-09-17T08:41:15.160 INFO:teuthology.orchestra.run.smithi078.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-17T08:41:15.160 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-17T08:41:15.160 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T08:41:15.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph 2024-09-17T08:41:15.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2024-09-17T08:41:15.225 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /etc/ceph 2024-09-17T08:41:15.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2024-09-17T08:41:15.280 INFO:tasks.cephadm:Writing seed config... 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [global] ms type = async 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T08:41:15.282 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-09-17T08:41:15.283 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-09-17T08:41:15.283 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-17T08:41:15.283 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:41:15.283 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T08:41:15.312 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7121dba6-74d0-11ef-bceb-c7b262605968 mon election default strategy = 3 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-09-17T08:41:15.313 DEBUG:teuthology.orchestra.run.smithi078:mon.a> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a.service 2024-09-17T08:41:15.360 DEBUG:teuthology.orchestra.run.smithi078:mgr.y> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y.service 2024-09-17T08:41:15.405 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T08:41:15.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -v bootstrap --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.78 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T08:41:15.565 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-17T08:41:15.565 INFO:teuthology.orchestra.run.smithi078.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', '-v', 'bootstrap', '--fsid', '7121dba6-74d0-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.78', '--skip-admin-label'] 2024-09-17T08:41:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T08:41:15.566 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying podman|docker is present... 2024-09-17T08:41:15.567 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying lvm2 is present... 2024-09-17T08:41:15.567 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying time synchronization is in place... 2024-09-17T08:41:15.572 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T08:41:15.572 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T08:41:15.576 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T08:41:15.576 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.580 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-17T08:41:15.580 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-17T08:41:15.584 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-17T08:41:15.584 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.587 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-17T08:41:15.587 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout masked 2024-09-17T08:41:15.591 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-17T08:41:15.591 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.594 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-17T08:41:15.595 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-17T08:41:15.598 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-17T08:41:15.598 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.602 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout enabled 2024-09-17T08:41:15.606 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout active 2024-09-17T08:41:15.606 INFO:teuthology.orchestra.run.smithi078.stdout:Unit ntp.service is enabled and running 2024-09-17T08:41:15.606 INFO:teuthology.orchestra.run.smithi078.stdout:Repeating the final host check... 2024-09-17T08:41:15.606 INFO:teuthology.orchestra.run.smithi078.stdout:docker (/usr/bin/docker) is present 2024-09-17T08:41:15.607 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl is present 2024-09-17T08:41:15.607 INFO:teuthology.orchestra.run.smithi078.stdout:lvcreate is present 2024-09-17T08:41:15.610 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T08:41:15.610 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T08:41:15.613 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T08:41:15.613 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.616 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-17T08:41:15.617 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-17T08:41:15.620 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-17T08:41:15.620 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.623 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-17T08:41:15.623 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout masked 2024-09-17T08:41:15.626 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-17T08:41:15.626 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.630 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-17T08:41:15.630 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-17T08:41:15.633 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-17T08:41:15.633 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-17T08:41:15.637 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout enabled 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout active 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Unit ntp.service is enabled and running 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Host looks OK 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Cluster fsid: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Acquiring lock 140431597997024 on /run/cephadm/7121dba6-74d0-11ef-bceb-c7b262605968.lock 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Lock 140431597997024 acquired on /run/cephadm/7121dba6-74d0-11ef-bceb-c7b262605968.lock 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying IP 172.21.15.78 port 3300 ... 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying IP 172.21.15.78 port 6789 ... 2024-09-17T08:41:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:Base mon IP(s) is [172.21.15.78:3300, 172.21.15.78:6789], mon addrv is [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-17T08:41:15.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-09-17T08:41:15.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.78 metric 100 2024-09-17T08:41:15.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 158.69.67.47 via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.78 metric 100 2024-09-17T08:41:15.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-17T08:41:15.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.78 metric 100 2024-09-17T08:41:15.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.78 metric 100 2024-09-17T08:41:15.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.78 metric 100 2024-09-17T08:41:15.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.78 metric 100 2024-09-17T08:41:15.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T08:41:15.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-09-17T08:41:15.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1796sec pref medium 2024-09-17T08:41:15.648 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T08:41:15.648 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T08:41:15.648 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T08:41:15.648 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-17T08:41:15.648 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2024-09-17T08:41:15.648 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.0/20` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.0/20` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.1/32` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.1/32` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.2/32` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.2/32` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.15.254/32` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.15.254/32` 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.0.1/32', '172.21.0.1/32', '172.21.0.2/32', '172.21.0.2/32', '172.21.15.254/32', '172.21.15.254/32'] 2024-09-17T08:41:15.650 INFO:teuthology.orchestra.run.smithi078.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T08:41:15.651 INFO:teuthology.orchestra.run.smithi078.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T08:41:15.861 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/docker: stdout 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9: Pulling from ceph-ci/ceph 2024-09-17T08:41:15.861 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/docker: stdout Digest: sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T08:41:15.861 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:41:15.861 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:41:17.440 INFO:teuthology.orchestra.run.smithi078.stdout:ceph: stdout ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-17T08:41:17.440 INFO:teuthology.orchestra.run.smithi078.stdout:Ceph version: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-17T08:41:17.440 INFO:teuthology.orchestra.run.smithi078.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T08:41:18.837 INFO:teuthology.orchestra.run.smithi078.stdout:stat: stdout 167 167 2024-09-17T08:41:18.837 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial keys... 2024-09-17T08:41:20.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQCvQOlmfgarKRAA+0k3Lmdo7Y1CsCDVCulxhw== 2024-09-17T08:41:21.791 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQCxQOlmdK7CDhAA/SIkEHx5b2eS/CSjX7vnGg== 2024-09-17T08:41:23.207 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQCyQOlmqx6bJhAAaW9sfTSUALFphRgBw/oXzw== 2024-09-17T08:41:23.208 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial monmap... 2024-09-17T08:41:24.771 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool for a [v2:172.21.15.78:3300,v1:172.21.15.78:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = pacific 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: set fsid to 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:41:24.772 INFO:teuthology.orchestra.run.smithi078.stdout:Creating mon... 2024-09-17T08:41:26.330 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.745+0000 7ff93c66eb00 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-17T08:41:26.330 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.745+0000 7ff93c66eb00 1 imported monmap: 2024-09-17T08:41:26.330 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-17T08:41:26.330 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr fsid 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:26.330 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-17T08:41:24.274037+0000 2024-09-17T08:41:26.330 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr created 2024-09-17T08:41:24.274037+0000 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr min_mon_release 16 (pacific) 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.745+0000 7ff93c66eb00 0 /usr/bin/ceph-mon: set fsid to 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: RocksDB version: 7.9.2 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Git sha 0 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: DB SUMMARY 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.331 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: DB Session ID: 96KQQNH7OD172S2RK73S 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.error_if_exists: 0 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.create_if_missing: 1 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.paranoid_checks: 1 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.env: 0x56331d7e8bc0 2024-09-17T08:41:26.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.fs: PosixFileSystem 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.info_log: 0x56331e916800 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.statistics: (nil) 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.use_fsync: 0 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_log_file_size: 0 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.allow_fallocate: 1 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-17T08:41:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.use_direct_reads: 0 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.create_missing_column_families: 0 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.db_log_dir: 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.wal_dir: 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.advise_random_on_open: 1 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-17T08:41:26.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.write_buffer_manager: 0x56331e91ce60 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.rate_limiter: (nil) 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.unordered_write: 0 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T08:41:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.row_cache: None 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.wal_filter: None 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.two_write_queues: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.manual_wal_flush: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.wal_compression: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.atomic_flush: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.log_readahead_size: 0 2024-09-17T08:41:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_background_jobs: 2 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_background_compactions: -1 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_subcompactions: 1 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T08:41:26.337 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_total_wal_size: 0 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_open_files: -1 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bytes_per_sync: 0 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_background_flushes: -1 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Compression algorithms supported: 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kZSTD supported: 0 2024-09-17T08:41:26.338 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kXpressCompression supported: 0 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kBZip2Compression supported: 0 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kLZ4Compression supported: 1 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kZlibCompression supported: 1 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: kSnappyCompression supported: 1 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.merge_operator: 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_filter: None 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_filter_factory: None 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56331e90fd40) 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T08:41:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x56331e9031f0 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-17T08:41:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-17T08:41:26.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression: NoCompression 2024-09-17T08:41:26.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.num_levels: 7 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T08:41:26.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.level: 32767 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.enabled: false 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T08:41:26.345 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T08:41:26.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.arena_block_size: 1048576 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T08:41:26.348 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.inplace_update_support: 0 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.bloom_locality: 0 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.max_successive_merges: 0 2024-09-17T08:41:26.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.force_consistency_checks: 1 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.ttl: 2592000 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.enable_blob_files: false 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.min_blob_size: 0 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.blob_file_size: 268435456 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T08:41:26.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5b8cde81-ee1a-49df-845e-9553bb7f5c83 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.749+0000 7ff93c66eb00 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.753+0000 7ff93c66eb00 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56331e92ee00 2024-09-17T08:41:26.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.753+0000 7ff93c66eb00 4 rocksdb: DB pointer 0x56331ea00000 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.753+0000 7ff933dfa640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.753+0000 7ff933dfa640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-17T08:41:26.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T08:41:26.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x56331e9031f0#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.753+0000 7ff93c66eb00 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.753+0000 7ff93c66eb00 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-17T08:41:26.354 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T08:41:25.753+0000 7ff93c66eb00 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-17T08:41:26.355 INFO:teuthology.orchestra.run.smithi078.stdout:create mon.a on 2024-09-17T08:41:26.610 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-09-17T08:41:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-17T08:41:27.036 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7121dba6-74d0-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968.target. 2024-09-17T08:41:27.037 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7121dba6-74d0-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968.target. 2024-09-17T08:41:27.306 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a 2024-09-17T08:41:27.306 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-17T08:41:27.514 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968.target.wants/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service. 2024-09-17T08:41:27.522 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld does not appear to be present 2024-09-17T08:41:27.522 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T08:41:27.522 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mon to start... 2024-09-17T08:41:27.522 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mon... 2024-09-17T08:41:27.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:27 smithi078 systemd[1]: Started Ceph mon.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:41:29.267 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:29 smithi078 bash[22183]: cluster 2024-09-17T08:41:29.091495+0000 mon.a (mon.0) 0 : cluster [INF] mkfs 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:29.267 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:29 smithi078 bash[22183]: cluster 2024-09-17T08:41:29.087108+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout id: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout services: 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.163409s) 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T08:41:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout data: 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dec7b1640 1 Processor -- start 2024-09-17T08:41:29.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dec7b1640 1 -- start start 2024-09-17T08:41:29.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dec7b1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4103da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:29.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dec7b1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4104370 con 0x7f2de41039a0 2024-09-17T08:41:29.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dea54d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:29.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dea54d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4103da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52656/0 (socket says 172.21.15.78:52656) 2024-09-17T08:41:29.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dea54d640 1 -- 172.21.15.78:0/1842447990 learned_addr learned my addr 172.21.15.78:0/1842447990 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:29.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.121+0000 7f2dea54d640 1 -- 172.21.15.78:0/1842447990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4104ba0 con 0x7f2de41039a0 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dea54d640 1 --2- 172.21.15.78:0/1842447990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4103da0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009820 tx=0x7f2de002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7ac1b8aa9e6ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2de954b640 1 -- 172.21.15.78:0/1842447990 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de002ae70 con 0x7f2de41039a0 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2de954b640 1 -- 172.21.15.78:0/1842447990 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0032440 con 0x7f2de41039a0 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2de954b640 1 -- 172.21.15.78:0/1842447990 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de0032700 con 0x7f2de41039a0 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- 172.21.15.78:0/1842447990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 msgr2=0x7f2de4103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 --2- 172.21.15.78:0/1842447990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4103da0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009820 tx=0x7f2de002a270 comp rx=0 tx=0).stop 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- 172.21.15.78:0/1842447990 shutdown_connections 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 --2- 172.21.15.78:0/1842447990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4103da0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- 172.21.15.78:0/1842447990 >> 172.21.15.78:0/1842447990 conn(0x7f2de40ff1b0 msgr2=0x7f2de41015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- 172.21.15.78:0/1842447990 shutdown_connections 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- 172.21.15.78:0/1842447990 wait complete. 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 Processor -- start 2024-09-17T08:41:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- start start 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4197470 con 0x7f2de41039a0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dea54d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dea54d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52660/0 (socket says 172.21.15.78:52660) 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dea54d640 1 -- 172.21.15.78:0/3292235989 learned_addr learned my addr 172.21.15.78:0/3292235989 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dea54d640 1 -- 172.21.15.78:0/3292235989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00094d0 con 0x7f2de41039a0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dea54d640 1 --2- 172.21.15.78:0/3292235989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4196f30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2de00090b0 tx=0x7f2de00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2ddb7fe640 1 -- 172.21.15.78:0/3292235989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de00308d0 con 0x7f2de41039a0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2ddb7fe640 1 -- 172.21.15.78:0/3292235989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0030a30 con 0x7f2de41039a0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de4197670 con 0x7f2de41039a0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2ddb7fe640 1 -- 172.21.15.78:0/3292235989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de0030cf0 con 0x7f2de41039a0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.125+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de4197b10 con 0x7f2de41039a0 2024-09-17T08:41:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.129+0000 7f2ddb7fe640 1 -- 172.21.15.78:0/3292235989 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2de0039040 con 0x7f2de41039a0 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.129+0000 7f2ddb7fe640 1 -- 172.21.15.78:0/3292235989 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2de0046910 con 0x7f2de41039a0 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.129+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4105750 con 0x7f2de41039a0 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.129+0000 7f2ddb7fe640 1 -- 172.21.15.78:0/3292235989 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f2de0037070 con 0x7f2de41039a0 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.249+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f2de419a3f0 con 0x7f2de41039a0 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.249+0000 7f2ddb7fe640 1 -- 172.21.15.78:0/3292235989 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f2de0046b20 con 0x7f2de41039a0 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.253+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 msgr2=0x7f2de4196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.253+0000 7f2dec7b1640 1 --2- 172.21.15.78:0/3292235989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4196f30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2de00090b0 tx=0x7f2de00046c0 comp rx=0 tx=0).stop 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.253+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 shutdown_connections 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.253+0000 7f2dec7b1640 1 --2- 172.21.15.78:0/3292235989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de41039a0 0x7f2de4196f30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.253+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 >> 172.21.15.78:0/3292235989 conn(0x7f2de40ff1b0 msgr2=0x7f2de418b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.253+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 shutdown_connections 2024-09-17T08:41:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:29.253+0000 7f2dec7b1640 1 -- 172.21.15.78:0/3292235989 wait complete. 2024-09-17T08:41:29.826 INFO:teuthology.orchestra.run.smithi078.stdout:mon is available 2024-09-17T08:41:29.826 INFO:teuthology.orchestra.run.smithi078.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T08:41:30.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:30 smithi078 bash[22183]: cluster 2024-09-17T08:41:29.090577+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T08:41:30.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:30 smithi078 bash[22183]: cluster 2024-09-17T08:41:29.090760+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:41:30.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:30 smithi078 bash[22183]: cluster 2024-09-17T08:41:29.092852+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-09-17T08:41:30.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:30 smithi078 bash[22183]: cluster 2024-09-17T08:41:29.095214+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-17T08:41:30.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:30 smithi078 bash[22183]: cluster 2024-09-17T08:41:29.095639+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-09-17T08:41:30.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:30 smithi078 bash[22183]: audit 2024-09-17T08:41:29.253951+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.78:0/3292235989' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-17T08:41:31.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:31 smithi078 bash[22183]: audit 2024-09-17T08:41:31.065141+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.78:0/4099985803' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T08:41:31.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:31 smithi078 bash[22183]: audit 2024-09-17T08:41:31.070903+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.78:0/4099985803' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T08:41:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout fsid = 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 Processor -- start 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 -- start start 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520106830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520076e50 con 0x7f2520104440 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f2524e29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f2524e29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52676/0 (socket says 172.21.15.78:52676) 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f2524e29640 1 -- 172.21.15.78:0/1270768248 learned_addr learned my addr 172.21.15.78:0/1270768248 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f2524e29640 1 -- 172.21.15.78:0/1270768248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520106d70 con 0x7f2520104440 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f2524e29640 1 --2- 172.21.15.78:0/1270768248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520106830 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2510009e80 tx=0x7f251002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119d06ddf1e7e9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f251f7fe640 1 -- 172.21.15.78:0/1270768248 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2510031400 con 0x7f2520104440 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f251f7fe640 1 -- 172.21.15.78:0/1270768248 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251002d050 con 0x7f2520104440 2024-09-17T08:41:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f251f7fe640 1 -- 172.21.15.78:0/1270768248 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25100316b0 con 0x7f2520104440 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 -- 172.21.15.78:0/1270768248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 msgr2=0x7f2520106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 --2- 172.21.15.78:0/1270768248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520106830 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2510009e80 tx=0x7f251002a7a0 comp rx=0 tx=0).stop 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 -- 172.21.15.78:0/1270768248 shutdown_connections 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 --2- 172.21.15.78:0/1270768248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520106830 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 -- 172.21.15.78:0/1270768248 >> 172.21.15.78:0/1270768248 conn(0x7f25200fe040 msgr2=0x7f2520100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 -- 172.21.15.78:0/1270768248 shutdown_connections 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.941+0000 7f252708d640 1 -- 172.21.15.78:0/1270768248 wait complete. 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f252708d640 1 Processor -- start 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f252708d640 1 -- start start 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f252708d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f252708d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520104200 con 0x7f2520104440 2024-09-17T08:41:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f2524e29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f2524e29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520103cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52692/0 (socket says 172.21.15.78:52692) 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f2524e29640 1 -- 172.21.15.78:0/4099985803 learned_addr learned my addr 172.21.15.78:0/4099985803 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f2524e29640 1 -- 172.21.15.78:0/4099985803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009b30 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f2524e29640 1 --2- 172.21.15.78:0/4099985803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520103cc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2510034040 tx=0x7f2510004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f251003c690 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251003c7f0 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25201023f0 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f251003cab0 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2520102890 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2510038040 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f251003b720 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.945+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2520103290 con 0x7f2520104440 2024-09-17T08:41:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:30.949+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f251004c060 con 0x7f2520104440 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.061+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f25201048a0 con 0x7f2520104440 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 7 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f251003bdb0 con 0x7f2520104440 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f251dffb640 1 -- 172.21.15.78:0/4099985803 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+338 (secure 0 0 0) 0x7f2510042070 con 0x7f2520104440 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 msgr2=0x7f2520103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f252708d640 1 --2- 172.21.15.78:0/4099985803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520103cc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2510034040 tx=0x7f2510004a40 comp rx=0 tx=0).stop 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 shutdown_connections 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f252708d640 1 --2- 172.21.15.78:0/4099985803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2520104440 0x7f2520103cc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 >> 172.21.15.78:0/4099985803 conn(0x7f25200fe040 msgr2=0x7f25200ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 shutdown_connections 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:31.069+0000 7f252708d640 1 -- 172.21.15.78:0/4099985803 wait complete. 2024-09-17T08:41:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:Generating new minimal ceph.conf... 2024-09-17T08:41:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:32 smithi078 bash[22183]: audit 2024-09-17T08:41:32.718369+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.78:0/1453525702' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:41:33.279 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 Processor -- start 2024-09-17T08:41:33.279 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- start start 2024-09-17T08:41:33.279 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:33.279 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301065b0 con 0x7ffb30105be0 2024-09-17T08:41:33.279 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb35420640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:33.279 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb35420640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52698/0 (socket says 172.21.15.78:52698) 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb35420640 1 -- 172.21.15.78:0/3682790342 learned_addr learned my addr 172.21.15.78:0/3682790342 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb35420640 1 -- 172.21.15.78:0/3682790342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb30106d90 con 0x7ffb30105be0 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb35420640 1 --2- 172.21.15.78:0/3682790342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30105fe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009820 tx=0x7ffb2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9eecf87736189b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb27fff640 1 -- 172.21.15.78:0/3682790342 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c02ae70 con 0x7ffb30105be0 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb27fff640 1 -- 172.21.15.78:0/3682790342 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7ffb2c032870 con 0x7ffb30105be0 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb27fff640 1 -- 172.21.15.78:0/3682790342 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c030690 con 0x7ffb30105be0 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- 172.21.15.78:0/3682790342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 msgr2=0x7ffb30105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 --2- 172.21.15.78:0/3682790342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30105fe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009820 tx=0x7ffb2c02a270 comp rx=0 tx=0).stop 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- 172.21.15.78:0/3682790342 shutdown_connections 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 --2- 172.21.15.78:0/3682790342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30105fe0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- 172.21.15.78:0/3682790342 >> 172.21.15.78:0/3682790342 conn(0x7ffb300791d0 msgr2=0x7ffb30103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:33.282 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- 172.21.15.78:0/3682790342 shutdown_connections 2024-09-17T08:41:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- 172.21.15.78:0/3682790342 wait complete. 2024-09-17T08:41:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 Processor -- start 2024-09-17T08:41:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- start start 2024-09-17T08:41:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.597+0000 7ffb37684640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30199cd0 con 0x7ffb30105be0 2024-09-17T08:41:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb35420640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb35420640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52710/0 (socket says 172.21.15.78:52710) 2024-09-17T08:41:33.285 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb35420640 1 -- 172.21.15.78:0/1453525702 learned_addr learned my addr 172.21.15.78:0/1453525702 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:33.285 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb35420640 1 -- 172.21.15.78:0/1453525702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0094d0 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb35420640 1 --2- 172.21.15.78:0/1453525702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30199790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c02a790 tx=0x7ffb2c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb267fc640 1 -- 172.21.15.78:0/1453525702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c030c90 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb267fc640 1 -- 172.21.15.78:0/1453525702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7ffb2c030df0 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb30199ed0 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb267fc640 1 -- 172.21.15.78:0/1453525702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c03a520 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3019a370 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb267fc640 1 -- 172.21.15.78:0/1453525702 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ffb2c039040 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb267fc640 1 -- 172.21.15.78:0/1453525702 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffb2c044c90 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.601+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb30105fe0 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.605+0000 7ffb267fc640 1 -- 172.21.15.78:0/1453525702 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ffb2c049060 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.713+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ffb30109fc0 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb267fc640 1 -- 172.21.15.78:0/1453525702 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7ffb2c03f070 con 0x7ffb30105be0 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 msgr2=0x7ffb30199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:33.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb37684640 1 --2- 172.21.15.78:0/1453525702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30199790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c02a790 tx=0x7ffb2c032d50 comp rx=0 tx=0).stop 2024-09-17T08:41:33.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 shutdown_connections 2024-09-17T08:41:33.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb37684640 1 --2- 172.21.15.78:0/1453525702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb30105be0 0x7ffb30199790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:33.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 >> 172.21.15.78:0/1453525702 conn(0x7ffb300791d0 msgr2=0x7ffb30103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:33.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 shutdown_connections 2024-09-17T08:41:33.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:32.717+0000 7ffb37684640 1 -- 172.21.15.78:0/1453525702 wait complete. 2024-09-17T08:41:33.287 INFO:teuthology.orchestra.run.smithi078.stdout:Restarting the monitor... 2024-09-17T08:41:33.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 systemd[1]: Stopping Ceph mon.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T08:41:33.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 bash[22183]: debug 2024-09-17T08:41:33.409+0000 7f7a477f3640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-17T08:41:33.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 bash[22183]: debug 2024-09-17T08:41:33.409+0000 7f7a477f3640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T08:41:33.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 bash[22569]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-mon-a 2024-09-17T08:41:33.971 INFO:teuthology.orchestra.run.smithi078.stdout:Setting public_network to 172.21.0.1/32,172.21.0.0/20,172.21.0.2/32,172.21.15.254/32 in mon config section 2024-09-17T08:41:34.248 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 bash[22630]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-mon-a 2024-09-17T08:41:34.249 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T08:41:34.249 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 systemd[1]: Stopped Ceph mon.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:41:34.249 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:33 smithi078 systemd[1]: Started Ceph mon.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:41:35.588 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.397+0000 7f9213170b00 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-17T08:41:35.588 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.397+0000 7f9213170b00 0 ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 7 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.397+0000 7f9213170b00 0 pidfile_write: ignore empty --pid-file 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 0 load: jerasure load: lrc 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: RocksDB version: 7.9.2 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Git sha 0 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: DB SUMMARY 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: DB Session ID: 3T7LJVBMIBL9QWR3VQHL 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: CURRENT file: CURRENT 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: IDENTITY file: IDENTITY 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T08:41:35.589 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 85922 ; 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.error_if_exists: 0 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.create_if_missing: 0 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.paranoid_checks: 1 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.env: 0x55d8322a9bc0 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.fs: PosixFileSystem 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.info_log: 0x55d833ff4be0 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.statistics: (nil) 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.use_fsync: 0 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_log_file_size: 0 2024-09-17T08:41:35.590 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.allow_fallocate: 1 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.use_direct_reads: 0 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.create_missing_column_families: 0 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.db_log_dir: 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.wal_dir: 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T08:41:35.591 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.advise_random_on_open: 1 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.write_buffer_manager: 0x55d834002320 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.rate_limiter: (nil) 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T08:41:35.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.unordered_write: 0 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.row_cache: None 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.wal_filter: None 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.two_write_queues: 0 2024-09-17T08:41:35.593 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.manual_wal_flush: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.wal_compression: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.atomic_flush: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.log_readahead_size: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-17T08:41:35.594 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_background_jobs: 2 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_background_compactions: -1 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_subcompactions: 1 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_total_wal_size: 0 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T08:41:35.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_open_files: -1 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.bytes_per_sync: 0 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Options.max_background_flushes: -1 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Compression algorithms supported: 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kZSTD supported: 0 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kXpressCompression supported: 0 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kBZip2Compression supported: 0 2024-09-17T08:41:35.596 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T08:41:35.597 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kLZ4Compression supported: 1 2024-09-17T08:41:35.597 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kZlibCompression supported: 1 2024-09-17T08:41:35.597 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-17T08:41:35.597 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: kSnappyCompression supported: 1 2024-09-17T08:41:35.597 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T08:41:35.597 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.401+0000 7f9213170b00 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T08:41:35.597 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-17T08:41:35.598 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T08:41:35.598 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T08:41:35.598 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.merge_operator: 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_filter: None 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_filter_factory: None 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d833ff47e0) 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: cache_index_and_filter_blocks: 1 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: pin_top_level_index_and_filter: 1 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: index_type: 0 2024-09-17T08:41:35.599 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: data_block_index_type: 0 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: index_shortening: 1 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: data_block_hash_table_util_ratio: 0.750000 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: checksum: 4 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: no_block_cache: 0 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_cache: 0x55d833feb1f0 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_cache_name: BinnedLRUCache 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_cache_options: 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: capacity : 536870912 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: num_shard_bits : 4 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: strict_capacity_limit : 0 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: high_pri_pool_ratio: 0.000 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_cache_compressed: (nil) 2024-09-17T08:41:35.600 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: persistent_cache: (nil) 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_size: 4096 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_size_deviation: 10 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_restart_interval: 16 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: index_block_restart_interval: 1 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: metadata_block_size: 4096 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: partition_filters: 0 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: use_delta_encoding: 1 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: filter_policy: bloomfilter 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: whole_key_filtering: 1 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: verify_compression: 0 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: read_amp_bytes_per_bit: 0 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: format_version: 5 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: enable_index_compression: 1 2024-09-17T08:41:35.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: block_align: 0 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: max_auto_readahead_size: 262144 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: prepopulate_block_cache: 0 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: initial_auto_readahead_size: 8192 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: num_file_reads_for_auto_readahead: 2 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression: NoCompression 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.num_levels: 7 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T08:41:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.level: 32767 2024-09-17T08:41:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.enabled: false 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-17T08:41:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T08:41:35.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.arena_block_size: 1048576 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T08:41:35.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.inplace_update_support: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.bloom_locality: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.max_successive_merges: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.force_consistency_checks: 1 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-17T08:41:35.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.ttl: 2592000 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.enable_blob_files: false 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.min_blob_size: 0 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.blob_file_size: 268435456 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T08:41:35.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5b8cde81-ee1a-49df-845e-9553bb7f5c83 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562495408420, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562495409433, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 82415, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 260, "table_properties": {"data_size": 80577, "index_size": 222, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10461, "raw_average_key_size": 47, "raw_value_size": 74649, "raw_average_value_size": 340, "num_data_blocks": 10, "num_entries": 219, "num_filter_entries": 219, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726562495, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5b8cde81-ee1a-49df-845e-9553bb7f5c83", "db_session_id": "3T7LJVBMIBL9QWR3VQHL", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562495409559, "job": 1, "event": "recovery_finished"} 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.405+0000 7f9213170b00 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.409+0000 7f9213170b00 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.409+0000 7f9213170b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d834014e00 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.409+0000 7f9213170b00 4 rocksdb: DB pointer 0x55d83410c000 2024-09-17T08:41:35.609 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.409+0000 7f9208f3b640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.409+0000 7f9208f3b640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: ** DB Stats ** 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:41:35.610 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: ** Compaction Stats [default] ** 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: L0 2/0 82.34 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Sum 2/0 82.34 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: ** Compaction Stats [default] ** 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T08:41:35.611 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: AddFile(Keys): cumulative 0, interval 0 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Cumulative compaction: 0.00 GB write, 18.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Interval compaction: 0.00 GB write, 18.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Block cache BinnedLRUCache@0x55d833feb1f0#7 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: ** File Read Latency Histogram By Level [default] ** 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: debug 2024-09-17T08:41:35.409+0000 7f9213170b00 0 starting mon.a rank 0 at public addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] at bind addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: cluster 2024-09-17T08:41:35.435019+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: cluster 2024-09-17T08:41:35.435072+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: cluster 2024-09-17T08:41:35.435451+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-09-17T08:41:35.612 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: cluster 2024-09-17T08:41:35.435475+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-17T08:41:35.613 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:35 smithi078 bash[22670]: cluster 2024-09-17T08:41:35.435849+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-09-17T08:41:36.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9d5b9c640 1 Processor -- start 2024-09-17T08:41:36.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9d5b9c640 1 -- start start 2024-09-17T08:41:36.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9d5b9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0102600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:36.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9d5b9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0076e70 con 0x7ff9d0102200 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0102600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0102600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51724/0 (socket says 172.21.15.78:51724) 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9cf7fe640 1 -- 172.21.15.78:0/110101765 learned_addr learned my addr 172.21.15.78:0/110101765 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9cf7fe640 1 -- 172.21.15.78:0/110101765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0102b40 con 0x7ff9d0102200 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9cf7fe640 1 --2- 172.21.15.78:0/110101765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0102600 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009820 tx=0x7ff9c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f50ff04e0213d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9ce7fc640 1 -- 172.21.15.78:0/110101765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c002ae70 con 0x7ff9d0102200 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9ce7fc640 1 -- 172.21.15.78:0/110101765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7ff9c0032870 con 0x7ff9d0102200 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.445+0000 7ff9ce7fc640 1 -- 172.21.15.78:0/110101765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c0030690 con 0x7ff9d0102200 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/110101765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 msgr2=0x7ff9d0102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 --2- 172.21.15.78:0/110101765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0102600 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009820 tx=0x7ff9c002a270 comp rx=0 tx=0).stop 2024-09-17T08:41:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/110101765 shutdown_connections 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 --2- 172.21.15.78:0/110101765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0102600 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/110101765 >> 172.21.15.78:0/110101765 conn(0x7ff9d00fe010 msgr2=0x7ff9d0100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/110101765 shutdown_connections 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/110101765 wait complete. 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 Processor -- start 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- start start 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0199cb0 con 0x7ff9d0102200 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51738/0 (socket says 172.21.15.78:51738) 2024-09-17T08:41:36.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9cf7fe640 1 -- 172.21.15.78:0/3963356072 learned_addr learned my addr 172.21.15.78:0/3963356072 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9cf7fe640 1 -- 172.21.15.78:0/3963356072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00094d0 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9cf7fe640 1 --2- 172.21.15.78:0/3963356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0199770 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000c00 tx=0x7ff9c0032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9ccff9640 1 -- 172.21.15.78:0/3963356072 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c0030c90 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0199eb0 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9ccff9640 1 -- 172.21.15.78:0/3963356072 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7ff9c0030df0 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9ccff9640 1 -- 172.21.15.78:0/3963356072 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c003a520 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d019a350 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9ccff9640 1 -- 172.21.15.78:0/3963356072 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff9c0039040 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9ccff9640 1 -- 172.21.15.78:0/3963356072 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff9c0044ce0 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.449+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d01040d0 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.453+0000 7ff9ccff9640 1 -- 172.21.15.78:0/3963356072 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff9c0049060 con 0x7ff9d0102200 2024-09-17T08:41:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.565+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7ff9d0103900 con 0x7ff9d0102200 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9ccff9640 1 -- 172.21.15.78:0/3963356072 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff9c00530f0 con 0x7ff9d0102200 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 msgr2=0x7ff9d0199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9d5b9c640 1 --2- 172.21.15.78:0/3963356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0199770 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000c00 tx=0x7ff9c0032c80 comp rx=0 tx=0).stop 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 shutdown_connections 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9d5b9c640 1 --2- 172.21.15.78:0/3963356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d0102200 0x7ff9d0199770 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 >> 172.21.15.78:0/3963356072 conn(0x7ff9d00fe010 msgr2=0x7ff9d0190670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 shutdown_connections 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:35.573+0000 7ff9d5b9c640 1 -- 172.21.15.78:0/3963356072 wait complete. 2024-09-17T08:41:36.182 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T08:41:36.200 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T08:41:36.201 INFO:teuthology.orchestra.run.smithi078.stdout:Creating mgr... 2024-09-17T08:41:36.201 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T08:41:36.201 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T08:41:36.547 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y 2024-09-17T08:41:36.547 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y.service: Unit ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y.service not loaded. 2024-09-17T08:41:36.769 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968.target.wants/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y.service -> /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service. 2024-09-17T08:41:36.775 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:41:36.775 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:41:36.775 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:36 smithi078 bash[22670]: audit 2024-09-17T08:41:35.574794+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.78:0/3963356072' entity='client.admin' 2024-09-17T08:41:36.776 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:41:36.778 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld does not appear to be present 2024-09-17T08:41:36.778 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T08:41:36.778 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld does not appear to be present 2024-09-17T08:41:36.778 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-17T08:41:36.778 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr to start... 2024-09-17T08:41:36.778 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr... 2024-09-17T08:41:37.050 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:36 smithi078 systemd[1]: Started Ceph mgr.y for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:41:38.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:38 smithi078 bash[22670]: audit 2024-09-17T08:41:38.631712+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.78:0/2105386614' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T08:41:38.857 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:38 smithi078 bash[22923]: debug 2024-09-17T08:41:38.581+0000 7f59c17be040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "7121dba6-74d0-11ef-bceb-c7b262605968", 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T08:41:39.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T08:41:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:39.149 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T08:41:39.149 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T08:41:39.149 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T08:41:39.157 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T08:41:39.157 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T08:41:39.157 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T08:41:39.157 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:39.157 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T08:41:39.157 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T08:41:39.157 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T08:41:39.158 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T08:41:39.158 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T08:41:39.158 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T08:41:39.158 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T08:41:39.158 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T08:41:39.158 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T08:41:39.159 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T08:41:29.091887+0000", 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:39.160 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d52e50640 1 Processor -- start 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d52e50640 1 -- start start 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d52e50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d52e50640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c076ed0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d50bec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d50bec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51780/0 (socket says 172.21.15.78:51780) 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d50bec640 1 -- 172.21.15.78:0/2291118533 learned_addr learned my addr 172.21.15.78:0/2291118533 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d50bec640 1 -- 172.21.15.78:0/2291118533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c102af0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.161 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d50bec640 1 --2- 172.21.15.78:0/2291118533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1025b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009820 tx=0x7f3d4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a7a5e6365e02be server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/2291118533 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d4002ae70 con 0x7f3d4c1021b0 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/2291118533 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f3d40032870 con 0x7f3d4c1021b0 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/2291118533 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d40030690 con 0x7f3d4c1021b0 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d52e50640 1 -- 172.21.15.78:0/2291118533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 msgr2=0x7f3d4c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.505+0000 7f3d52e50640 1 --2- 172.21.15.78:0/2291118533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1025b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009820 tx=0x7f3d4002a270 comp rx=0 tx=0).stop 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- 172.21.15.78:0/2291118533 shutdown_connections 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 --2- 172.21.15.78:0/2291118533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1025b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- 172.21.15.78:0/2291118533 >> 172.21.15.78:0/2291118533 conn(0x7f3d4c0fe040 msgr2=0x7f3d4c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- 172.21.15.78:0/2291118533 shutdown_connections 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- 172.21.15.78:0/2291118533 wait complete. 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 Processor -- start 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- start start 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c199ce0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d50bec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d50bec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51786/0 (socket says 172.21.15.78:51786) 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d50bec640 1 -- 172.21.15.78:0/2105386614 learned_addr learned my addr 172.21.15.78:0/2105386614 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d50bec640 1 -- 172.21.15.78:0/2105386614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400094d0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d50bec640 1 --2- 172.21.15.78:0/2105386614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1997a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097f0 tx=0x7f3d40032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d49ffb640 1 -- 172.21.15.78:0/2105386614 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d40030bb0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d49ffb640 1 -- 172.21.15.78:0/2105386614 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f3d40030d10 con 0x7f3d4c1021b0 2024-09-17T08:41:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c199ee0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d49ffb640 1 -- 172.21.15.78:0/2105386614 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d4003a520 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c19a380 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d49ffb640 1 -- 172.21.15.78:0/2105386614 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3d40039040 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d49ffb640 1 -- 172.21.15.78:0/2105386614 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3d40044cd0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.509+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c104080 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.513+0000 7f3d49ffb640 1 -- 172.21.15.78:0/2105386614 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3d40049060 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3d4c103ab0 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d49ffb640 1 -- 172.21.15.78:0/2105386614 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f3d4003f070 con 0x7f3d4c1021b0 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 msgr2=0x7f3d4c1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 --2- 172.21.15.78:0/2105386614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1997a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097f0 tx=0x7f3d40032c10 comp rx=0 tx=0).stop 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 shutdown_connections 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 --2- 172.21.15.78:0/2105386614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d4c1021b0 0x7f3d4c1997a0 secure :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097f0 tx=0x7f3d40032c10 comp rx=0 tx=0).stop 2024-09-17T08:41:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 >> 172.21.15.78:0/2105386614 conn(0x7f3d4c0fe040 msgr2=0x7f3d4c18dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:39.165 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 shutdown_connections 2024-09-17T08:41:39.165 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:38.629+0000 7f3d52e50640 1 -- 172.21.15.78:0/2105386614 wait complete. 2024-09-17T08:41:39.165 INFO:teuthology.orchestra.run.smithi078.stdout:mgr not available, waiting (1/15)... 2024-09-17T08:41:40.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:39 smithi078 bash[22923]: debug 2024-09-17T08:41:39.757+0000 7f59c17be040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T08:41:40.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:39 smithi078 bash[22923]: debug 2024-09-17T08:41:39.821+0000 7f59c17be040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T08:41:40.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:39 smithi078 bash[22923]: debug 2024-09-17T08:41:39.965+0000 7f59c17be040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T08:41:40.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:40 smithi078 bash[22923]: debug 2024-09-17T08:41:40.593+0000 7f59c17be040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T08:41:40.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:40 smithi078 bash[22923]: debug 2024-09-17T08:41:40.657+0000 7f59c17be040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T08:41:40.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:40 smithi078 bash[22923]: debug 2024-09-17T08:41:40.725+0000 7f59c17be040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T08:41:41.253 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:40 smithi078 bash[22923]: debug 2024-09-17T08:41:40.905+0000 7f59c17be040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T08:41:41.253 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:40 smithi078 bash[22923]: debug 2024-09-17T08:41:40.977+0000 7f59c17be040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T08:41:41.253 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:41 smithi078 bash[22923]: debug 2024-09-17T08:41:41.045+0000 7f59c17be040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T08:41:41.559 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:41 smithi078 bash[22923]: debug 2024-09-17T08:41:41.297+0000 7f59c17be040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T08:41:41.559 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:41 smithi078 bash[22923]: debug 2024-09-17T08:41:41.365+0000 7f59c17be040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T08:41:41.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:41 smithi078 bash[22923]: debug 2024-09-17T08:41:41.553+0000 7f59c17be040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T08:41:41.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:41 smithi078 bash[22923]: debug 2024-09-17T08:41:41.629+0000 7f59c17be040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T08:41:42.154 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:41 smithi078 bash[22923]: debug 2024-09-17T08:41:41.877+0000 7f59c17be040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T08:41:42.154 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:42 smithi078 bash[22923]: debug 2024-09-17T08:41:42.049+0000 7f59c17be040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:41:42.445 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:42 smithi078 bash[22923]: debug 2024-09-17T08:41:42.217+0000 7f59c17be040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T08:41:42.445 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:42 smithi078 bash[22923]: debug 2024-09-17T08:41:42.297+0000 7f59c17be040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T08:41:42.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:42 smithi078 bash[22923]: debug 2024-09-17T08:41:42.477+0000 7f59c17be040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:41:42.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:42 smithi078 bash[22670]: audit 2024-09-17T08:41:42.433394+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.78:0/1061973027' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T08:41:43.009 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:43.009 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "7121dba6-74d0-11ef-bceb-c7b262605968", 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T08:41:43.010 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T08:41:43.011 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T08:41:43.019 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T08:41:43.020 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T08:41:29.091887+0000", 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.309+0000 7fd8c9ed5640 1 Processor -- start 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.309+0000 7fd8c9ed5640 1 -- start start 2024-09-17T08:41:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.309+0000 7fd8c9ed5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c4106820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.309+0000 7fd8c9ed5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4077760 con 0x7fd8c4104430 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.309+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c4106820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.309+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c4106820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51796/0 (socket says 172.21.15.78:51796) 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.309+0000 7fd8c37fe640 1 -- 172.21.15.78:0/666455058 learned_addr learned my addr 172.21.15.78:0/666455058 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c37fe640 1 -- 172.21.15.78:0/666455058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4106d60 con 0x7fd8c4104430 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c37fe640 1 --2- 172.21.15.78:0/666455058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c4106820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009820 tx=0x7fd8b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8ec4ad79ebff66 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c27fc640 1 -- 172.21.15.78:0/666455058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b402ae70 con 0x7fd8c4104430 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c27fc640 1 -- 172.21.15.78:0/666455058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fd8b4032870 con 0x7fd8c4104430 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c27fc640 1 -- 172.21.15.78:0/666455058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4030690 con 0x7fd8c4104430 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/666455058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 msgr2=0x7fd8c4106820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 --2- 172.21.15.78:0/666455058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c4106820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009820 tx=0x7fd8b402a270 comp rx=0 tx=0).stop 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/666455058 shutdown_connections 2024-09-17T08:41:43.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 --2- 172.21.15.78:0/666455058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c4106820 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/666455058 >> 172.21.15.78:0/666455058 conn(0x7fd8c40fe0b0 msgr2=0x7fd8c41004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/666455058 shutdown_connections 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/666455058 wait complete. 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 Processor -- start 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- start start 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4199cf0 con 0x7fd8c4104430 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51804/0 (socket says 172.21.15.78:51804) 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c37fe640 1 -- 172.21.15.78:0/1061973027 learned_addr learned my addr 172.21.15.78:0/1061973027 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c37fe640 1 -- 172.21.15.78:0/1061973027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40094d0 con 0x7fd8c4104430 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c37fe640 1 --2- 172.21.15.78:0/1061973027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c41997b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4000c00 tx=0x7fd8b4032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c0ff9640 1 -- 172.21.15.78:0/1061973027 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4030c90 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c0ff9640 1 -- 172.21.15.78:0/1061973027 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fd8b4030df0 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c4199ef0 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.313+0000 7fd8c0ff9640 1 -- 172.21.15.78:0/1061973027 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b403a520 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.317+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c419a390 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.317+0000 7fd8c0ff9640 1 -- 172.21.15.78:0/1061973027 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd8b4039040 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.317+0000 7fd8c0ff9640 1 -- 172.21.15.78:0/1061973027 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd8b4044d60 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.317+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c4104810 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.317+0000 7fd8c0ff9640 1 -- 172.21.15.78:0/1061973027 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd8b4049060 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.429+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd8c4107a60 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.429+0000 7fd8c0ff9640 1 -- 172.21.15.78:0/1061973027 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fd8b403f070 con 0x7fd8c4104430 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.433+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 msgr2=0x7fd8c41997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.433+0000 7fd8c9ed5640 1 --2- 172.21.15.78:0/1061973027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c41997b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4000c00 tx=0x7fd8b4032c80 comp rx=0 tx=0).stop 2024-09-17T08:41:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.433+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 shutdown_connections 2024-09-17T08:41:43.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.433+0000 7fd8c9ed5640 1 --2- 172.21.15.78:0/1061973027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4104430 0x7fd8c41997b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:43.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.433+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 >> 172.21.15.78:0/1061973027 conn(0x7fd8c40fe0b0 msgr2=0x7fd8c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:43.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.433+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 shutdown_connections 2024-09-17T08:41:43.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:42.433+0000 7fd8c9ed5640 1 -- 172.21.15.78:0/1061973027 wait complete. 2024-09-17T08:41:43.025 INFO:teuthology.orchestra.run.smithi078.stdout:mgr not available, waiting (2/15)... 2024-09-17T08:41:43.566 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:43 smithi078 bash[22923]: debug 2024-09-17T08:41:43.273+0000 7f59c17be040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T08:41:43.566 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:43 smithi078 bash[22923]: debug 2024-09-17T08:41:43.345+0000 7f59c17be040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T08:41:43.566 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:43 smithi078 bash[22923]: debug 2024-09-17T08:41:43.561+0000 7f59c17be040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T08:41:43.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:43 smithi078 bash[22923]: debug 2024-09-17T08:41:43.633+0000 7f59c17be040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T08:41:44.356 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22923]: debug 2024-09-17T08:41:44.013+0000 7f59c17be040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T08:41:44.356 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22923]: debug 2024-09-17T08:41:44.089+0000 7f59c17be040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T08:41:44.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: cluster 2024-09-17T08:41:44.112849+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: cluster 2024-09-17T08:41:44.119581+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00694315s) 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: audit 2024-09-17T08:41:44.121375+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: audit 2024-09-17T08:41:44.121700+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: audit 2024-09-17T08:41:44.121977+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: audit 2024-09-17T08:41:44.122307+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: audit 2024-09-17T08:41:44.122640+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: cluster 2024-09-17T08:41:44.148462+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: audit 2024-09-17T08:41:44.159456+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T08:41:44.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:44 smithi078 bash[22670]: audit 2024-09-17T08:41:44.161781+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T08:41:45.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:45 smithi078 bash[22670]: audit 2024-09-17T08:41:44.164159+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' 2024-09-17T08:41:45.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:45 smithi078 bash[22670]: audit 2024-09-17T08:41:44.170682+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' 2024-09-17T08:41:45.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:45 smithi078 bash[22670]: audit 2024-09-17T08:41:44.175507+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.78:0/806971279' entity='mgr.y' 2024-09-17T08:41:45.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:45 smithi078 bash[22670]: cluster 2024-09-17T08:41:45.128177+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01555s) 2024-09-17T08:41:47.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:47.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-17T08:41:47.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "7121dba6-74d0-11ef-bceb-c7b262605968", 2024-09-17T08:41:47.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T08:41:47.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T08:41:47.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:47.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T08:41:47.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T08:41:47.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:47.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T08:41:47.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:47.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T08:41:47.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T08:41:47.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T08:41:47.266 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:47.267 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T08:41:29.091887+0000", 2024-09-17T08:41:47.268 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295fe6a640 1 Processor -- start 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295fe6a640 1 -- start start 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295fe6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f2958102040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295fe6a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2958102610 con 0x7f2958101c40 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295dc06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f2958102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295dc06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f2958102040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49674/0 (socket says 172.21.15.78:49674) 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295dc06640 1 -- 172.21.15.78:0/1538720966 learned_addr learned my addr 172.21.15.78:0/1538720966 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295dc06640 1 -- 172.21.15.78:0/1538720966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958102750 con 0x7f2958101c40 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295dc06640 1 --2- 172.21.15.78:0/1538720966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f2958102040 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2948009e80 tx=0x7f294802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f0cace03656720 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:47.269 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295cc04640 1 -- 172.21.15.78:0/1538720966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2948031400 con 0x7f2958101c40 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295cc04640 1 -- 172.21.15.78:0/1538720966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f294802d050 con 0x7f2958101c40 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.209+0000 7f295cc04640 1 -- 172.21.15.78:0/1538720966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2948007710 con 0x7f2958101c40 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/1538720966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 msgr2=0x7f2958102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 --2- 172.21.15.78:0/1538720966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f2958102040 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2948009e80 tx=0x7f294802a7a0 comp rx=0 tx=0).stop 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/1538720966 shutdown_connections 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 --2- 172.21.15.78:0/1538720966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f2958102040 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/1538720966 >> 172.21.15.78:0/1538720966 conn(0x7f29580fd7f0 msgr2=0x7f29580ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/1538720966 shutdown_connections 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/1538720966 wait complete. 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 Processor -- start 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- start start 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f295819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295819e0c0 con 0x7f2958101c40 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295dc06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f295819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295dc06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f295819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49684/0 (socket says 172.21.15.78:49684) 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295dc06640 1 -- 172.21.15.78:0/2885283343 learned_addr learned my addr 172.21.15.78:0/2885283343 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295dc06640 1 -- 172.21.15.78:0/2885283343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948009b30 con 0x7f2958101c40 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295dc06640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f295819db80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2948009e50 tx=0x7f2948031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f2956ffd640 1 -- 172.21.15.78:0/2885283343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29480319d0 con 0x7f2958101c40 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f2956ffd640 1 -- 172.21.15.78:0/2885283343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f2948031b30 con 0x7f2958101c40 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f2956ffd640 1 -- 172.21.15.78:0/2885283343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f294803a370 con 0x7f2958101c40 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295819e2c0 con 0x7f2958101c40 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295819e760 con 0x7f2958101c40 2024-09-17T08:41:47.271 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f2956ffd640 1 -- 172.21.15.78:0/2885283343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f2948038050 con 0x7f2958101c40 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f2956ffd640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f29400385d0 0x7f294003aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2958102040 con 0x7f2958101c40 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f2956ffd640 1 -- 172.21.15.78:0/2885283343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f294806bbf0 con 0x7f2958101c40 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.213+0000 7f295d405640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f29400385d0 0x7f294003aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.217+0000 7f295d405640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f29400385d0 0x7f294003aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f294c0098c0 tx=0x7f294c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.221+0000 7f2956ffd640 1 -- 172.21.15.78:0/2885283343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2948031ca0 con 0x7f2958101c40 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.669+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f29581035d0 con 0x7f2958101c40 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.669+0000 7f2956ffd640 1 -- 172.21.15.78:0/2885283343 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f2948036020 con 0x7f2958101c40 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f29400385d0 msgr2=0x7f294003aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f29400385d0 0x7f294003aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f294c0098c0 tx=0x7f294c006db0 comp rx=0 tx=0).stop 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 msgr2=0x7f295819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f295819db80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2948009e50 tx=0x7f2948031630 comp rx=0 tx=0).stop 2024-09-17T08:41:47.272 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 shutdown_connections 2024-09-17T08:41:47.273 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f29400385d0 0x7f294003aa90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:47.273 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 --2- 172.21.15.78:0/2885283343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2958101c40 0x7f295819db80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:47.273 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 >> 172.21.15.78:0/2885283343 conn(0x7f29580fd7f0 msgr2=0x7f29581080d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:47.273 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 shutdown_connections 2024-09-17T08:41:47.273 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:46.673+0000 7f295fe6a640 1 -- 172.21.15.78:0/2885283343 wait complete. 2024-09-17T08:41:47.273 INFO:teuthology.orchestra.run.smithi078.stdout:mgr is available 2024-09-17T08:41:47.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:47 smithi078 bash[22670]: cluster 2024-09-17T08:41:46.174967+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-09-17T08:41:47.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:47 smithi078 bash[22670]: audit 2024-09-17T08:41:46.673962+0000 mon.a (mon.0) 24 : audit [DBG] from='client.? 172.21.15.78:0/2885283343' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T08:41:48.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:48 smithi078 bash[22670]: audit 2024-09-17T08:41:48.579609+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.78:0/4083114385' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T08:41:49.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout fsid = 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T08:41:49.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T08:41:49.229 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T08:41:49.229 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.249+0000 7ff1bd7e0640 1 Processor -- start 2024-09-17T08:41:49.229 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.249+0000 7ff1bd7e0640 1 -- start start 2024-09-17T08:41:49.229 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b8103da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:49.229 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8104370 con 0x7ff1b81039a0 2024-09-17T08:41:49.233 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b8103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b8103da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49700/0 (socket says 172.21.15.78:49700) 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 -- 172.21.15.78:0/1522222566 learned_addr learned my addr 172.21.15.78:0/1522222566 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 -- 172.21.15.78:0/1522222566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b8104ba0 con 0x7ff1b81039a0 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 --2- 172.21.15.78:0/1522222566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b8103da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009820 tx=0x7ff1a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6ab224da012ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b5ffb640 1 -- 172.21.15.78:0/1522222566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a802ae70 con 0x7ff1b81039a0 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b5ffb640 1 -- 172.21.15.78:0/1522222566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7ff1a8032870 con 0x7ff1b81039a0 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b5ffb640 1 -- 172.21.15.78:0/1522222566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a8030690 con 0x7ff1b81039a0 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/1522222566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 msgr2=0x7ff1b8103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 --2- 172.21.15.78:0/1522222566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b8103da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009820 tx=0x7ff1a802a270 comp rx=0 tx=0).stop 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/1522222566 shutdown_connections 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 --2- 172.21.15.78:0/1522222566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b8103da0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:49.234 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/1522222566 >> 172.21.15.78:0/1522222566 conn(0x7ff1b80ff1b0 msgr2=0x7ff1b81015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/1522222566 shutdown_connections 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/1522222566 wait complete. 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 Processor -- start 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- start start 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1bd7e0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8199d10 con 0x7ff1b81039a0 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b81997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49704/0 (socket says 172.21.15.78:49704) 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 -- 172.21.15.78:0/4083114385 learned_addr learned my addr 172.21.15.78:0/4083114385 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.253+0000 7ff1b6ffd640 1 -- 172.21.15.78:0/4083114385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80094d0 con 0x7ff1b81039a0 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff1b6ffd640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b81997d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff1a802a790 tx=0x7ff1a8032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff19ffff640 1 -- 172.21.15.78:0/4083114385 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a8030c90 con 0x7ff1b81039a0 2024-09-17T08:41:49.235 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b8199f10 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff19ffff640 1 -- 172.21.15.78:0/4083114385 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7ff1a8030df0 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff19ffff640 1 -- 172.21.15.78:0/4083114385 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a803a520 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b819a3b0 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff19ffff640 1 -- 172.21.15.78:0/4083114385 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7ff1a8039040 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff19ffff640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7ff1a0038620 0x7ff1a003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff19ffff640 1 -- 172.21.15.78:0/4083114385 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff1a806b680 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b8103da0 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff1b67fc640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7ff1a0038620 0x7ff1a003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.257+0000 7ff1b67fc640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7ff1a0038620 0x7ff1a003aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0098c0 tx=0x7ff1ac006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.261+0000 7ff19ffff640 1 -- 172.21.15.78:0/4083114385 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff1a8037080 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.577+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ff1b8107dd0 con 0x7ff1b81039a0 2024-09-17T08:41:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.577+0000 7ff19ffff640 1 -- 172.21.15.78:0/4083114385 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+282 (secure 0 0 0) 0x7ff1b8107dd0 con 0x7ff1b81039a0 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7ff1a0038620 msgr2=0x7ff1a003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7ff1a0038620 0x7ff1a003aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0098c0 tx=0x7ff1ac006db0 comp rx=0 tx=0).stop 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 msgr2=0x7ff1b81997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b81997d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff1a802a790 tx=0x7ff1a8032d50 comp rx=0 tx=0).stop 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 shutdown_connections 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7ff1a0038620 0x7ff1a003aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 --2- 172.21.15.78:0/4083114385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1b81039a0 0x7ff1b81997d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 >> 172.21.15.78:0/4083114385 conn(0x7ff1b80ff1b0 msgr2=0x7ff1b80ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 shutdown_connections 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:48.581+0000 7ff1bd7e0640 1 -- 172.21.15.78:0/4083114385 wait complete. 2024-09-17T08:41:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling cephadm module... 2024-09-17T08:41:51.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:50 smithi078 bash[22670]: audit 2024-09-17T08:41:50.678992+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.78:0/2190449994' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T08:41:51.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:50 smithi078 bash[22923]: ignoring --setuser ceph since I am not root 2024-09-17T08:41:51.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:50 smithi078 bash[22923]: ignoring --setgroup ceph since I am not root 2024-09-17T08:41:51.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:50 smithi078 bash[22923]: debug 2024-09-17T08:41:50.881+0000 7f2423b5c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 Processor -- start 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 -- start start 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c1067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c077760 con 0x7f198c1043f0 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f19916d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c1067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f19916d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c1067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49714/0 (socket says 172.21.15.78:49714) 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f19916d1640 1 -- 172.21.15.78:0/2233718973 learned_addr learned my addr 172.21.15.78:0/2233718973 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f19916d1640 1 -- 172.21.15.78:0/2233718973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c106d20 con 0x7f198c1043f0 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f19916d1640 1 --2- 172.21.15.78:0/2233718973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c1067e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1988009820 tx=0x7f198802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2714e018fcb0f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1983fff640 1 -- 172.21.15.78:0/2233718973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f198802ae70 con 0x7f198c1043f0 2024-09-17T08:41:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1983fff640 1 -- 172.21.15.78:0/2233718973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f1988032870 con 0x7f198c1043f0 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1983fff640 1 -- 172.21.15.78:0/2233718973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1988030690 con 0x7f198c1043f0 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 -- 172.21.15.78:0/2233718973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 msgr2=0x7f198c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 --2- 172.21.15.78:0/2233718973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c1067e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1988009820 tx=0x7f198802a270 comp rx=0 tx=0).stop 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 -- 172.21.15.78:0/2233718973 shutdown_connections 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 --2- 172.21.15.78:0/2233718973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c1067e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 -- 172.21.15.78:0/2233718973 >> 172.21.15.78:0/2233718973 conn(0x7f198c0fe070 msgr2=0x7f198c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 -- 172.21.15.78:0/2233718973 shutdown_connections 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.265+0000 7f1993935640 1 -- 172.21.15.78:0/2233718973 wait complete. 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1993935640 1 Processor -- start 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1993935640 1 -- start start 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1993935640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1993935640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c197a50 con 0x7f198c1043f0 2024-09-17T08:41:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19916d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19916d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49730/0 (socket says 172.21.15.78:49730) 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19916d1640 1 -- 172.21.15.78:0/2190449994 learned_addr learned my addr 172.21.15.78:0/2190449994 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19916d1640 1 -- 172.21.15.78:0/2190449994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880094d0 con 0x7f198c1043f0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19916d1640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c197510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1988000c00 tx=0x7f1988032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1988030c90 con 0x7f198c1043f0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f1988030df0 con 0x7f198c1043f0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f198803a520 con 0x7f198c1043f0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c197c50 con 0x7f198c1043f0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c1980f0 con 0x7f198c1043f0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f1988039040 con 0x7f198c1043f0 2024-09-17T08:41:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19827fc640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f1978038620 0x7f197803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c107a20 con 0x7f198c1043f0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f198806b720 con 0x7f198c1043f0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1990ed0640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f1978038620 0x7f197803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.269+0000 7f1990ed0640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f1978038620 0x7f197803aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f197c0098c0 tx=0x7f197c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.277+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1988037070 con 0x7f198c1043f0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.673+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f198c107c30 con 0x7f198c1043f0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.729+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f1988037c50 con 0x7f198c1043f0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f19827fc640 1 -- 172.21.15.78:0/2190449994 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f198803b7b0 con 0x7f198c1043f0 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f1978038620 msgr2=0x7f197803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f1978038620 0x7f197803aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f197c0098c0 tx=0x7f197c006db0 comp rx=0 tx=0).stop 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 msgr2=0x7f198c197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c197510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1988000c00 tx=0x7f1988032c80 comp rx=0 tx=0).stop 2024-09-17T08:41:51.365 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 shutdown_connections 2024-09-17T08:41:51.366 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f1978038620 0x7f197803aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:51.366 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 --2- 172.21.15.78:0/2190449994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f198c1043f0 0x7f198c197510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:51.366 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.733+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 >> 172.21.15.78:0/2190449994 conn(0x7f198c0fe070 msgr2=0x7f198c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:51.366 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.737+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 shutdown_connections 2024-09-17T08:41:51.366 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:50.737+0000 7f1993935640 1 -- 172.21.15.78:0/2190449994 wait complete. 2024-09-17T08:41:52.055 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:51 smithi078 bash[22670]: audit 2024-09-17T08:41:50.735297+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.78:0/2190449994' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T08:41:52.055 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:51 smithi078 bash[22670]: cluster 2024-09-17T08:41:50.735387+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 6s) 2024-09-17T08:41:52.344 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:52 smithi078 bash[22923]: debug 2024-09-17T08:41:52.049+0000 7f2423b5c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T08:41:52.344 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:52 smithi078 bash[22923]: debug 2024-09-17T08:41:52.117+0000 7f2423b5c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T08:41:52.344 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:52 smithi078 bash[22923]: debug 2024-09-17T08:41:52.265+0000 7f2423b5c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T08:41:52.935 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:52 smithi078 bash[22923]: debug 2024-09-17T08:41:52.913+0000 7f2423b5c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T08:41:53.238 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:52 smithi078 bash[22670]: audit 2024-09-17T08:41:52.896473+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.78:0/1633985952' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T08:41:53.238 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:52 smithi078 bash[22923]: debug 2024-09-17T08:41:52.985+0000 7f2423b5c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T08:41:53.238 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.053+0000 7f2423b5c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T08:41:53.470 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-17T08:41:53.470 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b739b4640 1 Processor -- start 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b739b4640 1 -- start start 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b739b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c1067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b739b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c076ed0 con 0x7f9b6c1043c0 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b71750640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c1067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b71750640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c1067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49742/0 (socket says 172.21.15.78:49742) 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b71750640 1 -- 172.21.15.78:0/1611597332 learned_addr learned my addr 172.21.15.78:0/1611597332 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.481+0000 7f9b71750640 1 -- 172.21.15.78:0/1611597332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c106cf0 con 0x7f9b6c1043c0 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b71750640 1 --2- 172.21.15.78:0/1611597332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c1067b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009820 tx=0x7f9b5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3ef7c64301533a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b63fff640 1 -- 172.21.15.78:0/1611597332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b5c02ae70 con 0x7f9b6c1043c0 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b63fff640 1 -- 172.21.15.78:0/1611597332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f9b5c032870 con 0x7f9b6c1043c0 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b63fff640 1 -- 172.21.15.78:0/1611597332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b5c030690 con 0x7f9b6c1043c0 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- 172.21.15.78:0/1611597332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 msgr2=0x7f9b6c1067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 --2- 172.21.15.78:0/1611597332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c1067b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009820 tx=0x7f9b5c02a270 comp rx=0 tx=0).stop 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- 172.21.15.78:0/1611597332 shutdown_connections 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 --2- 172.21.15.78:0/1611597332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c1067b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:53.472 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- 172.21.15.78:0/1611597332 >> 172.21.15.78:0/1611597332 conn(0x7f9b6c0fe040 msgr2=0x7f9b6c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- 172.21.15.78:0/1611597332 shutdown_connections 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- 172.21.15.78:0/1611597332 wait complete. 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 Processor -- start 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- start start 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c103c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c104180 con 0x7f9b6c1043c0 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b71750640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b71750640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c103c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49750/0 (socket says 172.21.15.78:49750) 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b71750640 1 -- 172.21.15.78:0/1633985952 learned_addr learned my addr 172.21.15.78:0/1633985952 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b71750640 1 -- 172.21.15.78:0/1633985952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0094d0 con 0x7f9b6c1043c0 2024-09-17T08:41:53.473 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b71750640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c103c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0097f0 tx=0x7f9b5c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b627fc640 1 -- 172.21.15.78:0/1633985952 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b5c030bb0 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b627fc640 1 -- 172.21.15.78:0/1633985952 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f9b5c030d10 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c102370 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b627fc640 1 -- 172.21.15.78:0/1633985952 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b5c03a520 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.485+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6c102810 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.489+0000 7f9b627fc640 1 -- 172.21.15.78:0/1633985952 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f9b5c039040 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.489+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6c1047a0 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.489+0000 7f9b627fc640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 0x7f9b5803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.489+0000 7f9b70f4f640 1 -- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 msgr2=0x7f9b5803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/3976204901 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.489+0000 7f9b627fc640 1 -- 172.21.15.78:0/1633985952 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9b5c06b880 con 0x7f9b6c1043c0 2024-09-17T08:41:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.489+0000 7f9b70f4f640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 0x7f9b5803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.493+0000 7f9b627fc640 1 -- 172.21.15.78:0/1633985952 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9b5c031990 con 0x7f9b6c1043c0 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.689+0000 7f9b70f4f640 1 -- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 msgr2=0x7f9b5803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/3976204901 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.689+0000 7f9b70f4f640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 0x7f9b5803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.893+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9b6c102c20 con 0x7f9b6c1043c0 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.893+0000 7f9b627fc640 1 -- 172.21.15.78:0/1633985952 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f9b5c03f070 con 0x7f9b6c1043c0 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 msgr2=0x7f9b5803aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 0x7f9b5803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 msgr2=0x7f9b6c103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c103c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0097f0 tx=0x7f9b5c032c10 comp rx=0 tx=0).stop 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 shutdown_connections 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f9b58038620 0x7f9b5803aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 --2- 172.21.15.78:0/1633985952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b6c1043c0 0x7f9b6c103c40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:53.476 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 >> 172.21.15.78:0/1633985952 conn(0x7f9b6c0fe040 msgr2=0x7f9b6c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:53.476 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 shutdown_connections 2024-09-17T08:41:53.476 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:52.897+0000 7f9b739b4640 1 -- 172.21.15.78:0/1633985952 wait complete. 2024-09-17T08:41:53.476 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for the mgr to restart... 2024-09-17T08:41:53.476 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr epoch 5... 2024-09-17T08:41:53.565 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.233+0000 7f2423b5c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T08:41:53.565 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.309+0000 7f2423b5c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T08:41:53.565 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.377+0000 7f2423b5c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T08:41:53.855 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.637+0000 7f2423b5c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T08:41:53.856 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.701+0000 7f2423b5c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T08:41:54.219 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.893+0000 7f2423b5c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T08:41:54.219 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:53 smithi078 bash[22923]: debug 2024-09-17T08:41:53.969+0000 7f2423b5c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T08:41:54.469 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:54 smithi078 bash[22923]: debug 2024-09-17T08:41:54.213+0000 7f2423b5c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T08:41:54.469 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:54 smithi078 bash[22923]: debug 2024-09-17T08:41:54.389+0000 7f2423b5c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:41:54.815 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:54 smithi078 bash[22923]: debug 2024-09-17T08:41:54.557+0000 7f2423b5c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T08:41:54.815 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:54 smithi078 bash[22923]: debug 2024-09-17T08:41:54.637+0000 7f2423b5c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T08:41:55.105 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:54 smithi078 bash[22923]: debug 2024-09-17T08:41:54.809+0000 7f2423b5c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:41:55.855 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:55 smithi078 bash[22923]: debug 2024-09-17T08:41:55.593+0000 7f2423b5c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T08:41:55.855 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:55 smithi078 bash[22923]: debug 2024-09-17T08:41:55.665+0000 7f2423b5c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T08:41:56.336 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:55 smithi078 bash[22923]: debug 2024-09-17T08:41:55.881+0000 7f2423b5c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T08:41:56.336 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:55 smithi078 bash[22923]: debug 2024-09-17T08:41:55.953+0000 7f2423b5c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T08:41:56.605 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22923]: debug 2024-09-17T08:41:56.333+0000 7f2423b5c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T08:41:56.605 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22923]: debug 2024-09-17T08:41:56.409+0000 7f2423b5c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T08:41:56.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: cluster 2024-09-17T08:41:56.432403+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: cluster 2024-09-17T08:41:56.432955+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: cluster 2024-09-17T08:41:56.441951+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: cluster 2024-09-17T08:41:56.442189+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00940525s) 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: audit 2024-09-17T08:41:56.444008+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: audit 2024-09-17T08:41:56.445611+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: audit 2024-09-17T08:41:56.447103+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: audit 2024-09-17T08:41:56.447476+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: audit 2024-09-17T08:41:56.447813+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T08:41:56.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:56 smithi078 bash[22670]: cluster 2024-09-17T08:41:56.472562+0000 mon.a (mon.0) 39 : cluster [INF] Manager daemon y is now available 2024-09-17T08:41:57.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: cephadm 2024-09-17T08:41:56.482476+0000 mgr.y (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:56.487828+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:56.493754+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:56.497616+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:56.500288+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:56.509386+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:56.511663+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:57.250948+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: audit 2024-09-17T08:41:57.256753+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:41:57.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:57 smithi078 bash[22670]: cluster 2024-09-17T08:41:57.444514+0000 mon.a (mon.0) 48 : cluster [DBG] mgrmap e7: y(active, since 1.01172s) 2024-09-17T08:41:58.086 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-17T08:41:58.086 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 Processor -- start 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- start start 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4102650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4076e30 con 0x7f36d4102250 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d990c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d990c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43380/0 (socket says 172.21.15.78:43380) 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d990c640 1 -- 172.21.15.78:0/1827113562 learned_addr learned my addr 172.21.15.78:0/1827113562 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d990c640 1 -- 172.21.15.78:0/1827113562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d4076f70 con 0x7f36d4102250 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d990c640 1 --2- 172.21.15.78:0/1827113562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4102650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009820 tx=0x7f36d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40b517135f619b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d890a640 1 -- 172.21.15.78:0/1827113562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d002ae70 con 0x7f36d4102250 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d890a640 1 -- 172.21.15.78:0/1827113562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f36d0032870 con 0x7f36d4102250 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36d890a640 1 -- 172.21.15.78:0/1827113562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d0030690 con 0x7f36d4102250 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- 172.21.15.78:0/1827113562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 msgr2=0x7f36d4102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 --2- 172.21.15.78:0/1827113562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4102650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009820 tx=0x7f36d002a270 comp rx=0 tx=0).stop 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- 172.21.15.78:0/1827113562 shutdown_connections 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 --2- 172.21.15.78:0/1827113562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4102650 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- 172.21.15.78:0/1827113562 >> 172.21.15.78:0/1827113562 conn(0x7f36d40fe040 msgr2=0x7f36d4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- 172.21.15.78:0/1827113562 shutdown_connections 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- 172.21.15.78:0/1827113562 wait complete. 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 Processor -- start 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- start start 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.609+0000 7f36dbb70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4199cd0 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36d990c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36d990c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43390/0 (socket says 172.21.15.78:43390) 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36d990c640 1 -- 172.21.15.78:0/789941104 learned_addr learned my addr 172.21.15.78:0/789941104 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36d990c640 1 -- 172.21.15.78:0/789941104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00094d0 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36d990c640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4199790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36d00097f0 tx=0x7f36d0032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d0030bb0 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f36d0030d10 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d003a520 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d4199ed0 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d419a370 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f36d0039040 con 0x7f36d4102250 2024-09-17T08:41:58.089 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36caffd640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 0x7f36c003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 --> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36c003b240 con 0x7f36c0038670 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f36d006b6e0 con 0x7f36d4102250 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36d910b640 1 -- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 msgr2=0x7f36c003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/3976204901 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.613+0000 7f36d910b640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 0x7f36c003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.813+0000 7f36d910b640 1 -- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 msgr2=0x7f36c003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/3976204901 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:54.813+0000 7f36d910b640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 0x7f36c003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:55.213+0000 7f36d910b640 1 -- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 msgr2=0x7f36c003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/3976204901 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:55.213+0000 7f36d910b640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 0x7f36c003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T08:41:58.090 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:56.017+0000 7f36d910b640 1 -- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 msgr2=0x7f36c003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/3976204901 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:56.017+0000 7f36d910b640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 0x7f36c003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:56.437+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7f36d006a520 con 0x7f36d4102250 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:56.437+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 msgr2=0x7f36c003ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:56.437+0000 7f36caffd640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 0x7f36c003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.437+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f36d006d6e0 con 0x7f36d4102250 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.437+0000 7f36caffd640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f36c003bf50 0x7f36c003e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.437+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36c003b240 con 0x7f36c003bf50 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.437+0000 7f36d910b640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f36c003bf50 0x7f36c003e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.437+0000 7f36d910b640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f36c003bf50 0x7f36c003e340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f36c4003980 tx=0x7f36c40092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:41:58.091 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.441+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f36c003b240 con 0x7f36c003bf50 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f36d41037c0 con 0x7f36c003bf50 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36caffd640 1 -- 172.21.15.78:0/789941104 <== mgr.14118 v2:172.21.15.78:6800/2109055855 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f36d41037c0 con 0x7f36c003bf50 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f36c003bf50 msgr2=0x7f36c003e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f36c003bf50 0x7f36c003e340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f36c4003980 tx=0x7f36c40092b0 comp rx=0 tx=0).stop 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 msgr2=0x7f36d4199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4199790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36d00097f0 tx=0x7f36d0032c10 comp rx=0 tx=0).stop 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 shutdown_connections 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f36c003bf50 0x7f36c003e340 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:6800/3976204901,v1:172.21.15.78:6801/3976204901] conn(0x7f36c0038670 0x7f36c003ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 --2- 172.21.15.78:0/789941104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d4102250 0x7f36d4199790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.449+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 >> 172.21.15.78:0/789941104 conn(0x7f36d40fe040 msgr2=0x7f36d4190670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.453+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 shutdown_connections 2024-09-17T08:41:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:57.453+0000 7f36dbb70640 1 -- 172.21.15.78:0/789941104 wait complete. 2024-09-17T08:41:58.093 INFO:teuthology.orchestra.run.smithi078.stdout:mgr epoch 5 is available 2024-09-17T08:41:58.093 INFO:teuthology.orchestra.run.smithi078.stdout:Setting orchestrator backend to cephadm... 2024-09-17T08:41:58.500 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: debug 2024-09-17T08:41:58.381+0000 7f2391065640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:08:41:58] ENGINE Error in HTTPServer.serve 2024-09-17T08:41:58.500 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: Traceback (most recent call last): 2024-09-17T08:41:58.500 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:41:58.500 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: self._connections.run(self.expiration_interval) 2024-09-17T08:41:58.500 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:41:58.500 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: self._run(expiration_interval) 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: s = self.context.wrap_socket( 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: return self.sslsocket_class._create( 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: self.do_handshake() 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: self._sslobj.do_handshake() 2024-09-17T08:41:58.501 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22923]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:41:58.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22670]: audit 2024-09-17T08:41:57.442584+0000 mgr.y (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T08:41:58.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22670]: audit 2024-09-17T08:41:57.453749+0000 mgr.y (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T08:41:58.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:58 smithi078 bash[22670]: audit 2024-09-17T08:41:58.481713+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: cephadm 2024-09-17T08:41:58.257538+0000 mgr.y (mgr.14118) 4 : cephadm [INF] [17/Sep/2024:08:41:58] ENGINE Bus STARTING 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: cephadm 2024-09-17T08:41:58.379219+0000 mgr.y (mgr.14118) 5 : cephadm [INF] [17/Sep/2024:08:41:58] ENGINE Serving on https://172.21.15.78:7150 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: cephadm 2024-09-17T08:41:58.383115+0000 mgr.y (mgr.14118) 6 : cephadm [ERR] [17/Sep/2024:08:41:58] ENGINE Error in HTTPServer.serve 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: Traceback (most recent call last): 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: self._connections.run(self.expiration_interval) 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: self._run(expiration_interval) 2024-09-17T08:41:59.799 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: s = self.context.wrap_socket( 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: return self.sslsocket_class._create( 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: self.do_handshake() 2024-09-17T08:41:59.800 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:41:59.801 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: self._sslobj.do_handshake() 2024-09-17T08:41:59.801 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:41:59.801 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: cephadm 2024-09-17T08:41:58.480412+0000 mgr.y (mgr.14118) 7 : cephadm [INF] [17/Sep/2024:08:41:58] ENGINE Serving on http://172.21.15.78:8765 2024-09-17T08:41:59.801 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: cephadm 2024-09-17T08:41:58.480543+0000 mgr.y (mgr.14118) 8 : cephadm [INF] [17/Sep/2024:08:41:58] ENGINE Bus STARTED 2024-09-17T08:41:59.801 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:41:59 smithi078 bash[22670]: cluster 2024-09-17T08:41:58.497003+0000 mon.a (mon.0) 50 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-09-17T08:42:00.186 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7febabf64640 1 Processor -- start 2024-09-17T08:42:00.186 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7febabf64640 1 -- start start 2024-09-17T08:42:00.186 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7febabf64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7febabf64640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4106550 con 0x7feba4105b80 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba9d00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba9d00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43444/0 (socket says 172.21.15.78:43444) 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba9d00640 1 -- 172.21.15.78:0/784556765 learned_addr learned my addr 172.21.15.78:0/784556765 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba9d00640 1 -- 172.21.15.78:0/784556765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4106d80 con 0x7feba4105b80 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba9d00640 1 --2- 172.21.15.78:0/784556765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4105f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feba0009820 tx=0x7feba002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8b397e1eaddd31 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba8cfe640 1 -- 172.21.15.78:0/784556765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba002ae70 con 0x7feba4105b80 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba8cfe640 1 -- 172.21.15.78:0/784556765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7feba0032870 con 0x7feba4105b80 2024-09-17T08:42:00.187 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.241+0000 7feba8cfe640 1 -- 172.21.15.78:0/784556765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba0030690 con 0x7feba4105b80 2024-09-17T08:42:00.188 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- 172.21.15.78:0/784556765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 msgr2=0x7feba4105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:00.188 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 --2- 172.21.15.78:0/784556765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4105f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feba0009820 tx=0x7feba002a270 comp rx=0 tx=0).stop 2024-09-17T08:42:00.188 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- 172.21.15.78:0/784556765 shutdown_connections 2024-09-17T08:42:00.188 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 --2- 172.21.15.78:0/784556765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4105f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:00.188 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- 172.21.15.78:0/784556765 >> 172.21.15.78:0/784556765 conn(0x7feba40791a0 msgr2=0x7feba4103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- 172.21.15.78:0/784556765 shutdown_connections 2024-09-17T08:42:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- 172.21.15.78:0/784556765 wait complete. 2024-09-17T08:42:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 Processor -- start 2024-09-17T08:42:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- start start 2024-09-17T08:42:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4199cc0 con 0x7feba4105b80 2024-09-17T08:42:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feba9d00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feba9d00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43448/0 (socket says 172.21.15.78:43448) 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feba9d00640 1 -- 172.21.15.78:0/1378823549 learned_addr learned my addr 172.21.15.78:0/1378823549 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feba9d00640 1 -- 172.21.15.78:0/1378823549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00094d0 con 0x7feba4105b80 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feba9d00640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4199780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feba002a790 tx=0x7feba0032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feb9affd640 1 -- 172.21.15.78:0/1378823549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba0030c90 con 0x7feba4105b80 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feb9affd640 1 -- 172.21.15.78:0/1378823549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7feba0030df0 con 0x7feba4105b80 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7feb9affd640 1 -- 172.21.15.78:0/1378823549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba003a520 con 0x7feba4105b80 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4199ec0 con 0x7feba4105b80 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.245+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba419a360 con 0x7feba4105b80 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.249+0000 7feb9affd640 1 -- 172.21.15.78:0/1378823549 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7feba0039040 con 0x7feba4105b80 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.249+0000 7feb9affd640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7feb90038670 0x7feb9003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:00.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.249+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba4105f80 con 0x7feba4105b80 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.249+0000 7feb9affd640 1 -- 172.21.15.78:0/1378823549 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7feba006b840 con 0x7feba4105b80 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.249+0000 7feba94ff640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7feb90038670 0x7feb9003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.249+0000 7feba94ff640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7feb90038670 0x7feb9003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feb940098c0 tx=0x7feb94006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.253+0000 7feb9affd640 1 -- 172.21.15.78:0/1378823549 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feba0037070 con 0x7feba4105b80 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.593+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7feba4103c30 con 0x7feb90038670 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7feb9affd640 1 -- 172.21.15.78:0/1378823549 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feba4103c30 con 0x7feb90038670 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7feb90038670 msgr2=0x7feb9003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7feb90038670 0x7feb9003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feb940098c0 tx=0x7feb94006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 msgr2=0x7feba4199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4199780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feba002a790 tx=0x7feba0032d50 comp rx=0 tx=0).stop 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 shutdown_connections 2024-09-17T08:42:00.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7feb90038670 0x7feb9003ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:00.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 --2- 172.21.15.78:0/1378823549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba4105b80 0x7feba4199780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:00.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 >> 172.21.15.78:0/1378823549 conn(0x7feba40791a0 msgr2=0x7feba4103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:00.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 shutdown_connections 2024-09-17T08:42:00.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:41:59.609+0000 7febabf64640 1 -- 172.21.15.78:0/1378823549 wait complete. 2024-09-17T08:42:00.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:00 smithi078 bash[22670]: audit 2024-09-17T08:41:59.597498+0000 mgr.y (mgr.14118) 9 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:00.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:00 smithi078 bash[22670]: audit 2024-09-17T08:41:59.605735+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:00.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:00 smithi078 bash[22670]: audit 2024-09-17T08:41:59.619138+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:42:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:01 smithi078 bash[22670]: audit 2024-09-17T08:42:01.531951+0000 mgr.y (mgr.14118) 10 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:02.141 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T08:42:02.141 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.202+0000 7fad767e8640 1 Processor -- start 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.202+0000 7fad767e8640 1 -- start start 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70102680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700776e0 con 0x7fad70102280 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70102680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70102680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43464/0 (socket says 172.21.15.78:43464) 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 -- 172.21.15.78:0/2790347290 learned_addr learned my addr 172.21.15.78:0/2790347290 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 -- 172.21.15.78:0/2790347290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70102bc0 con 0x7fad70102280 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 --2- 172.21.15.78:0/2790347290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70102680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad60009820 tx=0x7fad6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5062367efe4816c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6effd640 1 -- 172.21.15.78:0/2790347290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad6002ae70 con 0x7fad70102280 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6effd640 1 -- 172.21.15.78:0/2790347290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fad60032870 con 0x7fad70102280 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6effd640 1 -- 172.21.15.78:0/2790347290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad60030690 con 0x7fad70102280 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- 172.21.15.78:0/2790347290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 msgr2=0x7fad70102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:02.142 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 --2- 172.21.15.78:0/2790347290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70102680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad60009820 tx=0x7fad6002a270 comp rx=0 tx=0).stop 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- 172.21.15.78:0/2790347290 shutdown_connections 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 --2- 172.21.15.78:0/2790347290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70102680 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- 172.21.15.78:0/2790347290 >> 172.21.15.78:0/2790347290 conn(0x7fad700fe0b0 msgr2=0x7fad701004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- 172.21.15.78:0/2790347290 shutdown_connections 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- 172.21.15.78:0/2790347290 wait complete. 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 Processor -- start 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- start start 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad767e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70199c80 con 0x7fad70102280 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43470/0 (socket says 172.21.15.78:43470) 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.206+0000 7fad6ffff640 1 -- 172.21.15.78:0/1637258691 learned_addr learned my addr 172.21.15.78:0/1637258691 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6ffff640 1 -- 172.21.15.78:0/1637258691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600094d0 con 0x7fad70102280 2024-09-17T08:42:02.143 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6ffff640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70199740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad600097f0 tx=0x7fad60032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6d7fa640 1 -- 172.21.15.78:0/1637258691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad60030ce0 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6d7fa640 1 -- 172.21.15.78:0/1637258691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fad60030e40 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6d7fa640 1 -- 172.21.15.78:0/1637258691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad6003a520 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad70199e80 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7019a320 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6d7fa640 1 -- 172.21.15.78:0/1637258691 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fad60039040 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6d7fa640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fad58038670 0x7fad5803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70193470 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6f7fe640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fad58038670 0x7fad5803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6d7fa640 1 -- 172.21.15.78:0/1637258691 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad6006ba80 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.210+0000 7fad6f7fe640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fad58038670 0x7fad5803ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad640098c0 tx=0x7fad64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.214+0000 7fad6d7fa640 1 -- 172.21.15.78:0/1637258691 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad6003f020 con 0x7fad70102280 2024-09-17T08:42:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.530+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fad7002c450 con 0x7fad58038670 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.530+0000 7fad6d7fa640 1 -- 172.21.15.78:0/1637258691 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fad7002c450 con 0x7fad58038670 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fad58038670 msgr2=0x7fad5803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fad58038670 0x7fad5803ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad640098c0 tx=0x7fad64006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 msgr2=0x7fad70199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70199740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad600097f0 tx=0x7fad60032c10 comp rx=0 tx=0).stop 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 shutdown_connections 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fad58038670 0x7fad5803ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 --2- 172.21.15.78:0/1637258691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad70102280 0x7fad70199740 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 >> 172.21.15.78:0/1637258691 conn(0x7fad700fe0b0 msgr2=0x7fad70190640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 shutdown_connections 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:01.534+0000 7fad767e8640 1 -- 172.21.15.78:0/1637258691 wait complete. 2024-09-17T08:42:02.145 INFO:teuthology.orchestra.run.smithi078.stdout:Generating ssh key... 2024-09-17T08:42:04.105 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: Generating public/private rsa key pair. 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: Your identification has been saved in /tmp/tmp3truo15b/key 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: Your public key has been saved in /tmp/tmp3truo15b/key.pub 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: The key fingerprint is: 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: SHA256:ZcOJQyhZavZbPzZ4jQ1EP1cOjb777jkbBaMQQwJZ0yk ceph-7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: The key's randomart image is: 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: +---[RSA 3072]----+ 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | oo==o=. .o.| 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | o.o.E*o= .+.| 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | +. o.O o.+ .| 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | o . = o +.o | 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | . S . . ..| 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | o o = . .| 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | . . B o o | 2024-09-17T08:42:04.106 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | o o ..o| 2024-09-17T08:42:04.107 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: | **| 2024-09-17T08:42:04.107 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:03 smithi078 bash[22923]: +----[SHA256]-----+ 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 Processor -- start 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- start start 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0102c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0103220 con 0x7f96e0102850 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0102c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55844/0 (socket says 172.21.15.78:55844) 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 -- 172.21.15.78:0/236824784 learned_addr learned my addr 172.21.15.78:0/236824784 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:04.349 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 -- 172.21.15.78:0/236824784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0103a50 con 0x7f96e0102850 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 --2- 172.21.15.78:0/236824784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0102c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009820 tx=0x7f96dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f9f15660c17c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e48da640 1 -- 172.21.15.78:0/236824784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96dc02ae70 con 0x7f96e0102850 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e48da640 1 -- 172.21.15.78:0/236824784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f96dc032870 con 0x7f96e0102850 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e48da640 1 -- 172.21.15.78:0/236824784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96dc030690 con 0x7f96e0102850 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- 172.21.15.78:0/236824784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 msgr2=0x7f96e0102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 --2- 172.21.15.78:0/236824784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0102c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009820 tx=0x7f96dc02a270 comp rx=0 tx=0).stop 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- 172.21.15.78:0/236824784 shutdown_connections 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 --2- 172.21.15.78:0/236824784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0102c50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- 172.21.15.78:0/236824784 >> 172.21.15.78:0/236824784 conn(0x7f96e00fe040 msgr2=0x7f96e0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- 172.21.15.78:0/236824784 shutdown_connections 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- 172.21.15.78:0/236824784 wait complete. 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 Processor -- start 2024-09-17T08:42:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- start start 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e7b40640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0199d70 con 0x7f96e0102850 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55860/0 (socket says 172.21.15.78:55860) 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.274+0000 7f96e58dc640 1 -- 172.21.15.78:0/3665493693 learned_addr learned my addr 172.21.15.78:0/3665493693 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96e58dc640 1 -- 172.21.15.78:0/3665493693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc0094d0 con 0x7f96e0102850 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96e58dc640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0199830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f96dc02a790 tx=0x7f96dc032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96d6ffd640 1 -- 172.21.15.78:0/3665493693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96dc030c90 con 0x7f96e0102850 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e0199f70 con 0x7f96e0102850 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96d6ffd640 1 -- 172.21.15.78:0/3665493693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f96dc030df0 con 0x7f96e0102850 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96d6ffd640 1 -- 172.21.15.78:0/3665493693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96dc03a390 con 0x7f96e0102850 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e019a410 con 0x7f96e0102850 2024-09-17T08:42:04.351 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96d6ffd640 1 -- 172.21.15.78:0/3665493693 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f96dc039040 con 0x7f96e0102850 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0102c50 con 0x7f96e0102850 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96d6ffd640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f96cc038670 0x7f96cc03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96d6ffd640 1 -- 172.21.15.78:0/3665493693 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f96dc06b670 con 0x7f96e0102850 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96e50db640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f96cc038670 0x7f96cc03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.278+0000 7f96e50db640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f96cc038670 0x7f96cc03ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f96d00098c0 tx=0x7f96d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.282+0000 7f96d6ffd640 1 -- 172.21.15.78:0/3665493693 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f96dc0313a0 con 0x7f96e0102850 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.598+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f96e002c450 con 0x7f96cc038670 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.770+0000 7f96d6ffd640 1 -- 172.21.15.78:0/3665493693 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f96e002c450 con 0x7f96cc038670 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f96cc038670 msgr2=0x7f96cc03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f96cc038670 0x7f96cc03ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f96d00098c0 tx=0x7f96d0006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 msgr2=0x7f96e0199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0199830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f96dc02a790 tx=0x7f96dc032d50 comp rx=0 tx=0).stop 2024-09-17T08:42:04.352 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 shutdown_connections 2024-09-17T08:42:04.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f96cc038670 0x7f96cc03ab30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:04.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 --2- 172.21.15.78:0/3665493693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e0102850 0x7f96e0199830 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:04.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 >> 172.21.15.78:0/3665493693 conn(0x7f96e00fe040 msgr2=0x7f96e00fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:04.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 shutdown_connections 2024-09-17T08:42:04.353 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:03.774+0000 7f96e7b40640 1 -- 172.21.15.78:0/3665493693 wait complete. 2024-09-17T08:42:05.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:04 smithi078 bash[22670]: audit 2024-09-17T08:42:03.600625+0000 mgr.y (mgr.14118) 11 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:05.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:04 smithi078 bash[22670]: cephadm 2024-09-17T08:42:03.601036+0000 mgr.y (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-17T08:42:05.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:04 smithi078 bash[22670]: audit 2024-09-17T08:42:03.765808+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:05.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:04 smithi078 bash[22670]: audit 2024-09-17T08:42:03.771074+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:06.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:05 smithi078 bash[22670]: audit 2024-09-17T08:42:05.646033+0000 mgr.y (mgr.14118) 13 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC81WJZUWpyUhFyBIDhgyvej44AkZRvg4ZDdkLpI2GNLtGYZcgZicnu7GkLe8J3xuAvuiyL1/qnCuQwkYviWApU8L5vo+xjuyQs9ImrdcWmYik8DuJ73ib3AE4+UXQCS2RAqBFSjkZuxxAxk7yN9DO9kq4y12RTdvPcnJ3k7eV1nD1kqzelJvSfBJPr/ZaJjNU0JC4B7ut9dVRNMCkPKovnFnf7HDOHaS97vywBZYirUvylcl5kvbiqLW5AULYgDxvqvlmNokqvlTXkrQsXN9gBkMppGuosu4AA9psxjseDy0vrApLrhZmZl4MHgPfxIdWzHGRR8YcRNQk9InenWZscs1bPG++8vZM5KBNhooYfwFArPHtwKxzcARMMMwl6e/sAUJFPFp7S7xhBQExJd8qA2ZOZG8sjB1MXq2sHbriEg8XqbRFoV+nQFQbExY/AeXZCiXDHQn0p6w1WRdRIJYslW3mltkGuok7jYjdEFPMGUSoxXOEwbPQF7Ox6I1p9Ro8= ceph-7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.302+0000 7f107bf2b640 1 Processor -- start 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- start start 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10741065b0 con 0x7f1074105be0 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55874/0 (socket says 172.21.15.78:55874) 2024-09-17T08:42:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 -- 172.21.15.78:0/3743938370 learned_addr learned my addr 172.21.15.78:0/3743938370 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 -- 172.21.15.78:0/3743938370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074106d90 con 0x7f1074105be0 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 --2- 172.21.15.78:0/3743938370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074105fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1064009820 tx=0x7f106402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0870bb9620cb682 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1078cc5640 1 -- 172.21.15.78:0/3743938370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106402ae70 con 0x7f1074105be0 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1078cc5640 1 -- 172.21.15.78:0/3743938370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f1064032870 con 0x7f1074105be0 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1078cc5640 1 -- 172.21.15.78:0/3743938370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1064030690 con 0x7f1074105be0 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- 172.21.15.78:0/3743938370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 msgr2=0x7f1074105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 --2- 172.21.15.78:0/3743938370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074105fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1064009820 tx=0x7f106402a270 comp rx=0 tx=0).stop 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- 172.21.15.78:0/3743938370 shutdown_connections 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 --2- 172.21.15.78:0/3743938370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074105fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- 172.21.15.78:0/3743938370 >> 172.21.15.78:0/3743938370 conn(0x7f10740791d0 msgr2=0x7f1074103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- 172.21.15.78:0/3743938370 shutdown_connections 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- 172.21.15.78:0/3743938370 wait complete. 2024-09-17T08:42:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 Processor -- start 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- start start 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f107bf2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074199cd0 con 0x7f1074105be0 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55888/0 (socket says 172.21.15.78:55888) 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.306+0000 7f1079cc7640 1 -- 172.21.15.78:0/65581967 learned_addr learned my addr 172.21.15.78:0/65581967 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f1079cc7640 1 -- 172.21.15.78:0/65581967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640094d0 con 0x7f1074105be0 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f1079cc7640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074199790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10640097f0 tx=0x7f1064032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:06.192 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f106affd640 1 -- 172.21.15.78:0/65581967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1064030bb0 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f106affd640 1 -- 172.21.15.78:0/65581967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7f1064030d10 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f106affd640 1 -- 172.21.15.78:0/65581967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106403a520 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1074199ed0 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107419a370 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f106affd640 1 -- 172.21.15.78:0/65581967 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f1064039040 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1074105fe0 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f106affd640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f1060038670 0x7f106003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f106affd640 1 -- 172.21.15.78:0/65581967 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f106406b710 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f10794c6640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f1060038670 0x7f106003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.310+0000 7f10794c6640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f1060038670 0x7f106003ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10700098c0 tx=0x7f1070006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.314+0000 7f106affd640 1 -- 172.21.15.78:0/65581967 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f10640313a0 con 0x7f1074105be0 2024-09-17T08:42:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.642+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1074103c50 con 0x7f1060038670 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.642+0000 7f106affd640 1 -- 172.21.15.78:0/65581967 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f1074103c50 con 0x7f1060038670 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f1060038670 msgr2=0x7f106003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f1060038670 0x7f106003ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10700098c0 tx=0x7f1070006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 msgr2=0x7f1074199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074199790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10640097f0 tx=0x7f1064032c10 comp rx=0 tx=0).stop 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 shutdown_connections 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f1060038670 0x7f106003ab30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 --2- 172.21.15.78:0/65581967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1074105be0 0x7f1074199790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 >> 172.21.15.78:0/65581967 conn(0x7f10740791d0 msgr2=0x7f1074103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 shutdown_connections 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:05.646+0000 7f107bf2b640 1 -- 172.21.15.78:0/65581967 wait complete. 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T08:42:06.194 INFO:teuthology.orchestra.run.smithi078.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T08:42:06.195 INFO:teuthology.orchestra.run.smithi078.stdout:Adding host smithi078... 2024-09-17T08:42:08.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:07 smithi078 bash[22670]: audit 2024-09-17T08:42:07.592458+0000 mgr.y (mgr.14118) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi078", "addr": "172.21.15.78", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:08.938 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:08 smithi078 bash[22670]: cephadm 2024-09-17T08:42:08.536514+0000 mgr.y (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi078 2024-09-17T08:42:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Added host 'smithi078' with addr '172.21.15.78' 2024-09-17T08:42:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.250+0000 7fd408620640 1 Processor -- start 2024-09-17T08:42:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.250+0000 7fd408620640 1 -- start start 2024-09-17T08:42:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd400077bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000781c0 con 0x7fd400079790 2024-09-17T08:42:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd400077bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd400077bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55892/0 (socket says 172.21.15.78:55892) 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 -- 172.21.15.78:0/4033735117 learned_addr learned my addr 172.21.15.78:0/4033735117 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 -- 172.21.15.78:0/4033735117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400078300 con 0x7fd400079790 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 --2- 172.21.15.78:0/4033735117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd400077bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009820 tx=0x7fd3fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d638c4a2fcb63e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4053ba640 1 -- 172.21.15.78:0/4033735117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3fc02ae70 con 0x7fd400079790 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4053ba640 1 -- 172.21.15.78:0/4033735117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fd3fc032870 con 0x7fd400079790 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4053ba640 1 -- 172.21.15.78:0/4033735117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3fc030690 con 0x7fd400079790 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- 172.21.15.78:0/4033735117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 msgr2=0x7fd400077bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 --2- 172.21.15.78:0/4033735117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd400077bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009820 tx=0x7fd3fc02a270 comp rx=0 tx=0).stop 2024-09-17T08:42:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- 172.21.15.78:0/4033735117 shutdown_connections 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 --2- 172.21.15.78:0/4033735117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd400077bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- 172.21.15.78:0/4033735117 >> 172.21.15.78:0/4033735117 conn(0x7fd4000ff180 msgr2=0x7fd4001015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- 172.21.15.78:0/4033735117 shutdown_connections 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- 172.21.15.78:0/4033735117 wait complete. 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 Processor -- start 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- start start 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd40019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd408620640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40019e0b0 con 0x7fd400079790 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd40019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd40019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55908/0 (socket says 172.21.15.78:55908) 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.254+0000 7fd4063bc640 1 -- 172.21.15.78:0/898821783 learned_addr learned my addr 172.21.15.78:0/898821783 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd4063bc640 1 -- 172.21.15.78:0/898821783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0094d0 con 0x7fd400079790 2024-09-17T08:42:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd4063bc640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd40019db70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0097f0 tx=0x7fd3fc032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd3f77fe640 1 -- 172.21.15.78:0/898821783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3fc030bb0 con 0x7fd400079790 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd3f77fe640 1 -- 172.21.15.78:0/898821783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fd3fc030d10 con 0x7fd400079790 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40019e2b0 con 0x7fd400079790 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd3f77fe640 1 -- 172.21.15.78:0/898821783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3fc03a520 con 0x7fd400079790 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40019e750 con 0x7fd400079790 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd3f77fe640 1 -- 172.21.15.78:0/898821783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd3fc039040 con 0x7fd400079790 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd3f77fe640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fd3ec038620 0x7fd3ec03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd3f77fe640 1 -- 172.21.15.78:0/898821783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd3fc06b830 con 0x7fd400079790 2024-09-17T08:42:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd400077bf0 con 0x7fd400079790 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd405bbb640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fd3ec038620 0x7fd3ec03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.258+0000 7fd405bbb640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fd3ec038620 0x7fd3ec03aae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098c0 tx=0x7fd3f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.262+0000 7fd3f77fe640 1 -- 172.21.15.78:0/898821783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd3fc049080 con 0x7fd400079790 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:07.590+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi078", "addr": "172.21.15.78", "target": ["mon-mgr", ""]}) v1 -- 0x7fd400105af0 con 0x7fd3ec038620 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd3f77fe640 1 -- 172.21.15.78:0/898821783 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fd400105af0 con 0x7fd3ec038620 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fd3ec038620 msgr2=0x7fd3ec03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fd3ec038620 0x7fd3ec03aae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098c0 tx=0x7fd3f0006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 msgr2=0x7fd40019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd40019db70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0097f0 tx=0x7fd3fc032c10 comp rx=0 tx=0).stop 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 shutdown_connections 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fd3ec038620 0x7fd3ec03aae0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 --2- 172.21.15.78:0/898821783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd400079790 0x7fd40019db70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.678+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 >> 172.21.15.78:0/898821783 conn(0x7fd4000ff180 msgr2=0x7fd400101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.682+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 shutdown_connections 2024-09-17T08:42:11.716 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:10.682+0000 7fd408620640 1 -- 172.21.15.78:0/898821783 wait complete. 2024-09-17T08:42:11.716 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying unmanaged mon service... 2024-09-17T08:42:12.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:11 smithi078 bash[22670]: audit 2024-09-17T08:42:10.679109+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:12.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:11 smithi078 bash[22670]: cephadm 2024-09-17T08:42:10.679658+0000 mgr.y (mgr.14118) 16 : cephadm [INF] Added host smithi078 2024-09-17T08:42:12.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:11 smithi078 bash[22670]: audit 2024-09-17T08:42:10.680003+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.478+0000 7fe9810e2640 1 Processor -- start 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.478+0000 7fe9810e2640 1 -- start start 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.478+0000 7fe9810e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c10cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.478+0000 7fe9810e2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c10d1a0 con 0x7fe97c10a7e0 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c10cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c10cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60530/0 (socket says 172.21.15.78:60530) 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 -- 172.21.15.78:0/2124446200 learned_addr learned my addr 172.21.15.78:0/2124446200 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 -- 172.21.15.78:0/2124446200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c10d2e0 con 0x7fe97c10a7e0 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 --2- 172.21.15.78:0/2124446200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c10cbd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe974009e80 tx=0x7fe97402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74883a816552edb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe979d9b640 1 -- 172.21.15.78:0/2124446200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe974031400 con 0x7fe97c10a7e0 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe979d9b640 1 -- 172.21.15.78:0/2124446200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fe97402d050 con 0x7fe97c10a7e0 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe979d9b640 1 -- 172.21.15.78:0/2124446200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe974007710 con 0x7fe97c10a7e0 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 -- 172.21.15.78:0/2124446200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 msgr2=0x7fe97c10cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 --2- 172.21.15.78:0/2124446200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c10cbd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe974009e80 tx=0x7fe97402a7a0 comp rx=0 tx=0).stop 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 -- 172.21.15.78:0/2124446200 shutdown_connections 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 --2- 172.21.15.78:0/2124446200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c10cbd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 -- 172.21.15.78:0/2124446200 >> 172.21.15.78:0/2124446200 conn(0x7fe97c079190 msgr2=0x7fe97c07b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 -- 172.21.15.78:0/2124446200 shutdown_connections 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 -- 172.21.15.78:0/2124446200 wait complete. 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 Processor -- start 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 -- start start 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe9810e2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c19e130 con 0x7fe97c10a7e0 2024-09-17T08:42:14.463 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60534/0 (socket says 172.21.15.78:60534) 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 -- 172.21.15.78:0/4135631225 learned_addr learned my addr 172.21.15.78:0/4135631225 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.482+0000 7fe97ad9d640 1 -- 172.21.15.78:0/4135631225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974009b30 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe97ad9d640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c19dbf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe97402acc0 tx=0x7fe974031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe974031980 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c19e330 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 976+0+0 (secure 0 0 0) 0x7fe974031ae0 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c19e7d0 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe97403a370 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fe974038050 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe963fff640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fe9640382f0 0x7fe96403a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe97406f5d0 con 0x7fe97c10a7e0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe97a59c640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fe9640382f0 0x7fe96403a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:14.464 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c10ac40 con 0x7fe97c10a7e0 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.486+0000 7fe97a59c640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fe9640382f0 0x7fe96403a7b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9700098c0 tx=0x7fe970006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.490+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe974036080 con 0x7fe97c10a7e0 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.538+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mon.0 v2:172.21.15.78:3300/0 7 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fe97406aa10 con 0x7fe97c10a7e0 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.834+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe97c07a4c0 con 0x7fe9640382f0 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.842+0000 7fe963fff640 1 -- 172.21.15.78:0/4135631225 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe97c07a4c0 con 0x7fe9640382f0 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fe9640382f0 msgr2=0x7fe96403a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fe9640382f0 0x7fe96403a7b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9700098c0 tx=0x7fe970006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 msgr2=0x7fe97c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c19dbf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe97402acc0 tx=0x7fe974031630 comp rx=0 tx=0).stop 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 shutdown_connections 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fe9640382f0 0x7fe96403a7b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 --2- 172.21.15.78:0/4135631225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe97c10a7e0 0x7fe97c19dbf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 >> 172.21.15.78:0/4135631225 conn(0x7fe97c079190 msgr2=0x7fe97c079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 shutdown_connections 2024-09-17T08:42:14.465 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:13.846+0000 7fe9810e2640 1 -- 172.21.15.78:0/4135631225 wait complete. 2024-09-17T08:42:14.466 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying unmanaged mgr service... 2024-09-17T08:42:14.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:14 smithi078 bash[22670]: audit 2024-09-17T08:42:13.542261+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:14.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:14 smithi078 bash[22670]: audit 2024-09-17T08:42:13.843847+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:14.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:14 smithi078 bash[22670]: audit 2024-09-17T08:42:13.857595+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:15.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:15 smithi078 bash[22670]: audit 2024-09-17T08:42:13.838382+0000 mgr.y (mgr.14118) 17 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:15.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:15 smithi078 bash[22670]: cephadm 2024-09-17T08:42:13.840076+0000 mgr.y (mgr.14118) 18 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-17T08:42:16.519 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T08:42:16.519 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 Processor -- start 2024-09-17T08:42:16.519 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- start start 2024-09-17T08:42:16.519 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa898077bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:16.519 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980781c0 con 0x7fa898079790 2024-09-17T08:42:16.519 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa898077bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:16.519 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa898077bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60536/0 (socket says 172.21.15.78:60536) 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 -- 172.21.15.78:0/1790780343 learned_addr learned my addr 172.21.15.78:0/1790780343 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 -- 172.21.15.78:0/1790780343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898078300 con 0x7fa898079790 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 --2- 172.21.15.78:0/1790780343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa898077bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa894009820 tx=0x7fa89402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2138f379bf4241b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89ca75640 1 -- 172.21.15.78:0/1790780343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa89402ae70 con 0x7fa898079790 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89ca75640 1 -- 172.21.15.78:0/1790780343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa894032890 con 0x7fa898079790 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89ca75640 1 -- 172.21.15.78:0/1790780343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa894030660 con 0x7fa898079790 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- 172.21.15.78:0/1790780343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 msgr2=0x7fa898077bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 --2- 172.21.15.78:0/1790780343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa898077bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa894009820 tx=0x7fa89402a270 comp rx=0 tx=0).stop 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- 172.21.15.78:0/1790780343 shutdown_connections 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 --2- 172.21.15.78:0/1790780343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa898077bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- 172.21.15.78:0/1790780343 >> 172.21.15.78:0/1790780343 conn(0x7fa8980ff180 msgr2=0x7fa8981015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- 172.21.15.78:0/1790780343 shutdown_connections 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- 172.21.15.78:0/1790780343 wait complete. 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 Processor -- start 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- start start 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa8981997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89fcdb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa898199d30 con 0x7fa898079790 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa8981997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa8981997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60540/0 (socket says 172.21.15.78:60540) 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.514+0000 7fa89da77640 1 -- 172.21.15.78:0/3691454132 learned_addr learned my addr 172.21.15.78:0/3691454132 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa89da77640 1 -- 172.21.15.78:0/3691454132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940094d0 con 0x7fa898079790 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa89da77640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa8981997f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa894030380 tx=0x7fa894032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa88effd640 1 -- 172.21.15.78:0/3691454132 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa894030cb0 con 0x7fa898079790 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa88effd640 1 -- 172.21.15.78:0/3691454132 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa894030e10 con 0x7fa898079790 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa898199f30 con 0x7fa898079790 2024-09-17T08:42:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa88effd640 1 -- 172.21.15.78:0/3691454132 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa89403a520 con 0x7fa898079790 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89819a3d0 con 0x7fa898079790 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa88effd640 1 -- 172.21.15.78:0/3691454132 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa894039040 con 0x7fa898079790 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa88effd640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fa884038670 0x7fa88403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa88effd640 1 -- 172.21.15.78:0/3691454132 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa89406b830 con 0x7fa898079790 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa89d276640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fa884038670 0x7fa88403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa898077c70 con 0x7fa898079790 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.518+0000 7fa89d276640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fa884038670 0x7fa88403ab30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa8880098c0 tx=0x7fa888006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.522+0000 7fa88effd640 1 -- 172.21.15.78:0/3691454132 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa89403f080 con 0x7fa898079790 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.862+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa8981004d0 con 0x7fa884038670 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa88effd640 1 -- 172.21.15.78:0/3691454132 <== mgr.14118 v2:172.21.15.78:6800/2109055855 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa8981004d0 con 0x7fa884038670 2024-09-17T08:42:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fa884038670 msgr2=0x7fa88403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fa884038670 0x7fa88403ab30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa8880098c0 tx=0x7fa888006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 msgr2=0x7fa8981997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa8981997f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa894030380 tx=0x7fa894032670 comp rx=0 tx=0).stop 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 shutdown_connections 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fa884038670 0x7fa88403ab30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 --2- 172.21.15.78:0/3691454132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa898079790 0x7fa8981997f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 >> 172.21.15.78:0/3691454132 conn(0x7fa8980ff180 msgr2=0x7fa8980ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 shutdown_connections 2024-09-17T08:42:16.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:15.874+0000 7fa89fcdb640 1 -- 172.21.15.78:0/3691454132 wait complete. 2024-09-17T08:42:17.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:16 smithi078 bash[22670]: audit 2024-09-17T08:42:15.865525+0000 mgr.y (mgr.14118) 19 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:17.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:16 smithi078 bash[22670]: cephadm 2024-09-17T08:42:15.867710+0000 mgr.y (mgr.14118) 20 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-17T08:42:17.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:16 smithi078 bash[22670]: audit 2024-09-17T08:42:15.874166+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:17.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:16 smithi078 bash[22670]: cluster 2024-09-17T08:42:16.448667+0000 mgr.y (mgr.14118) 21 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:18.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.642+0000 7fe00934f640 1 Processor -- start 2024-09-17T08:42:18.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.642+0000 7fe00934f640 1 -- start start 2024-09-17T08:42:18.603 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.642+0000 7fe00934f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.642+0000 7fe00934f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004106550 con 0x7fe004105b80 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60544/0 (socket says 172.21.15.78:60544) 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 -- 172.21.15.78:0/1829722263 learned_addr learned my addr 172.21.15.78:0/1829722263 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 -- 172.21.15.78:0/1829722263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004106d80 con 0x7fe004105b80 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 --2- 172.21.15.78:0/1829722263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004105f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009820 tx=0x7fdff402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c488ec68e0aa09b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe001ffb640 1 -- 172.21.15.78:0/1829722263 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff402ae70 con 0x7fe004105b80 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe001ffb640 1 -- 172.21.15.78:0/1829722263 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fdff4032890 con 0x7fe004105b80 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe001ffb640 1 -- 172.21.15.78:0/1829722263 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff4030660 con 0x7fe004105b80 2024-09-17T08:42:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 -- 172.21.15.78:0/1829722263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 msgr2=0x7fe004105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 --2- 172.21.15.78:0/1829722263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004105f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009820 tx=0x7fdff402a270 comp rx=0 tx=0).stop 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 -- 172.21.15.78:0/1829722263 shutdown_connections 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 --2- 172.21.15.78:0/1829722263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004105f80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 -- 172.21.15.78:0/1829722263 >> 172.21.15.78:0/1829722263 conn(0x7fe0040791a0 msgr2=0x7fe004103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 -- 172.21.15.78:0/1829722263 shutdown_connections 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 -- 172.21.15.78:0/1829722263 wait complete. 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 Processor -- start 2024-09-17T08:42:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 -- start start 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe00934f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004199d40 con 0x7fe004105b80 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60548/0 (socket says 172.21.15.78:60548) 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 -- 172.21.15.78:0/3329307649 learned_addr learned my addr 172.21.15.78:0/3329307649 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.646+0000 7fe002ffd640 1 -- 172.21.15.78:0/3329307649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40094d0 con 0x7fe004105b80 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fe002ffd640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004199800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdff4030380 tx=0x7fdff4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fdfebfff640 1 -- 172.21.15.78:0/3329307649 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff4030cb0 con 0x7fe004105b80 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fdfebfff640 1 -- 172.21.15.78:0/3329307649 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fdff4030e10 con 0x7fe004105b80 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe004199f40 con 0x7fe004105b80 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fdfebfff640 1 -- 172.21.15.78:0/3329307649 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff403a520 con 0x7fe004105b80 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00419a3e0 con 0x7fe004105b80 2024-09-17T08:42:18.606 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fdfebfff640 1 -- 172.21.15.78:0/3329307649 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fdff4039040 con 0x7fe004105b80 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe004105f80 con 0x7fe004105b80 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fdfebfff640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fdfec038670 0x7fdfec03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fdfebfff640 1 -- 172.21.15.78:0/3329307649 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdff406b8a0 con 0x7fe004105b80 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fe0027fc640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fdfec038670 0x7fdfec03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.650+0000 7fe0027fc640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fdfec038670 0x7fdfec03ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdff80098c0 tx=0x7fdff8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.654+0000 7fdfebfff640 1 -- 172.21.15.78:0/3329307649 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdff404b300 con 0x7fe004105b80 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.982+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe004109fb0 con 0x7fe004105b80 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fdfebfff640 1 -- 172.21.15.78:0/3329307649 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fdff40370d0 con 0x7fe004105b80 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fdfec038670 msgr2=0x7fdfec03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fdfec038670 0x7fdfec03ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdff80098c0 tx=0x7fdff8006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 msgr2=0x7fe004199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004199800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdff4030380 tx=0x7fdff4032670 comp rx=0 tx=0).stop 2024-09-17T08:42:18.607 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 shutdown_connections 2024-09-17T08:42:18.608 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fdfec038670 0x7fdfec03ab30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:18.608 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 --2- 172.21.15.78:0/3329307649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe004105b80 0x7fe004199800 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:18.608 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.986+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 >> 172.21.15.78:0/3329307649 conn(0x7fe0040791a0 msgr2=0x7fe004103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:18.608 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.990+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 shutdown_connections 2024-09-17T08:42:18.608 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:17.990+0000 7fe00934f640 1 -- 172.21.15.78:0/3329307649 wait complete. 2024-09-17T08:42:19.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:18 smithi078 bash[22670]: audit 2024-09-17T08:42:17.987556+0000 mon.a (mon.0) 61 : audit [INF] from='client.? 172.21.15.78:0/3329307649' entity='client.admin' 2024-09-17T08:42:19.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:18 smithi078 bash[22670]: cluster 2024-09-17T08:42:18.449117+0000 mgr.y (mgr.14118) 22 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:20 smithi078 bash[22670]: audit 2024-09-17T08:42:19.314556+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:20.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:20 smithi078 bash[22670]: audit 2024-09-17T08:42:19.974911+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.78:0/132909293' entity='mgr.y' 2024-09-17T08:42:20.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:20 smithi078 bash[22670]: audit 2024-09-17T08:42:20.045430+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.78:0/1719013919' entity='client.admin' 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a5ab78640 1 Processor -- start 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a5ab78640 1 -- start start 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a5ab78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a54102c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a5ab78640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a54103210 con 0x7f5a54102840 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a58914640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a54102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a58914640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a54102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60554/0 (socket says 172.21.15.78:60554) 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a58914640 1 -- 172.21.15.78:0/1270330702 learned_addr learned my addr 172.21.15.78:0/1270330702 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.698+0000 7f5a58914640 1 -- 172.21.15.78:0/1270330702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54103a40 con 0x7f5a54102840 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a58914640 1 --2- 172.21.15.78:0/1270330702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a54102c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009e80 tx=0x7f5a4402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb00bdbb4f5c532 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a537fe640 1 -- 172.21.15.78:0/1270330702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a44031400 con 0x7f5a54102840 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a537fe640 1 -- 172.21.15.78:0/1270330702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5a4402d050 con 0x7f5a54102840 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a537fe640 1 -- 172.21.15.78:0/1270330702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a44007740 con 0x7f5a54102840 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1270330702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 msgr2=0x7f5a54102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 --2- 172.21.15.78:0/1270330702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a54102c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009e80 tx=0x7f5a4402a7a0 comp rx=0 tx=0).stop 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1270330702 shutdown_connections 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 --2- 172.21.15.78:0/1270330702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a54102c40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1270330702 >> 172.21.15.78:0/1270330702 conn(0x7f5a540fe010 msgr2=0x7f5a54100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1270330702 shutdown_connections 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1270330702 wait complete. 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 Processor -- start 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- start start 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a5418d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5418de30 con 0x7f5a54102840 2024-09-17T08:42:20.643 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a58914640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a5418d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a58914640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a5418d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60560/0 (socket says 172.21.15.78:60560) 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a58914640 1 -- 172.21.15.78:0/1719013919 learned_addr learned my addr 172.21.15.78:0/1719013919 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a58914640 1 -- 172.21.15.78:0/1719013919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44009b30 con 0x7f5a54102840 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a58914640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a5418d8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009e50 tx=0x7f5a44007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a51ffb640 1 -- 172.21.15.78:0/1719013919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a44031740 con 0x7f5a54102840 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a51ffb640 1 -- 172.21.15.78:0/1719013919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5a440318a0 con 0x7f5a54102840 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5418c020 con 0x7f5a54102840 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a51ffb640 1 -- 172.21.15.78:0/1719013919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a440444f0 con 0x7f5a54102840 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.702+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5418c4c0 con 0x7f5a54102840 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.706+0000 7f5a51ffb640 1 -- 172.21.15.78:0/1719013919 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5a44038040 con 0x7f5a54102840 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.706+0000 7f5a51ffb640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f5a40038220 0x7f5a4003a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.706+0000 7f5a51ffb640 1 -- 172.21.15.78:0/1719013919 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5a44070580 con 0x7f5a54102840 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.706+0000 7f5a53fff640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f5a40038220 0x7f5a4003a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.706+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a54102c40 con 0x7f5a54102840 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.706+0000 7f5a53fff640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f5a40038220 0x7f5a4003a6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0098c0 tx=0x7f5a3c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:19.714+0000 7f5a51ffb640 1 -- 172.21.15.78:0/1719013919 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5a44036080 con 0x7f5a54102840 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.034+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5a54191200 con 0x7f5a54102840 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.042+0000 7f5a51ffb640 1 -- 172.21.15.78:0/1719013919 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5a44041020 con 0x7f5a54102840 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f5a40038220 msgr2=0x7f5a4003a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f5a40038220 0x7f5a4003a6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0098c0 tx=0x7f5a3c006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 msgr2=0x7f5a5418d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a5418d8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009e50 tx=0x7f5a44007dc0 comp rx=0 tx=0).stop 2024-09-17T08:42:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 shutdown_connections 2024-09-17T08:42:20.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f5a40038220 0x7f5a4003a6e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:20.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 --2- 172.21.15.78:0/1719013919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a54102840 0x7f5a5418d8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:20.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.046+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 >> 172.21.15.78:0/1719013919 conn(0x7f5a540fe010 msgr2=0x7f5a540fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:20.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.050+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 shutdown_connections 2024-09-17T08:42:20.646 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:20.050+0000 7f5a5ab78640 1 -- 172.21.15.78:0/1719013919 wait complete. 2024-09-17T08:42:20.646 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling the dashboard module... 2024-09-17T08:42:21.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:21 smithi078 bash[22670]: cluster 2024-09-17T08:42:20.449551+0000 mgr.y (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:22.595 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:22 smithi078 bash[22670]: audit 2024-09-17T08:42:22.145264+0000 mon.a (mon.0) 65 : audit [INF] from='client.? 172.21.15.78:0/1169323902' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T08:42:22.595 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:22 smithi078 bash[22923]: ignoring --setuser ceph since I am not root 2024-09-17T08:42:22.595 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:22 smithi078 bash[22923]: ignoring --setgroup ceph since I am not root 2024-09-17T08:42:22.595 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:22 smithi078 bash[22923]: debug 2024-09-17T08:42:22.486+0000 7f8fc1fbe040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T08:42:23.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.726+0000 7fb3e5673640 1 Processor -- start 2024-09-17T08:42:23.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.726+0000 7fb3e5673640 1 -- start start 2024-09-17T08:42:23.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.726+0000 7fb3e5673640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:23.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.726+0000 7fb3e5673640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e01065b0 con 0x7fb3e0105be0 2024-09-17T08:42:23.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.726+0000 7fb3deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:23.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.726+0000 7fb3deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60564/0 (socket says 172.21.15.78:60564) 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.726+0000 7fb3deffd640 1 -- 172.21.15.78:0/4126234237 learned_addr learned my addr 172.21.15.78:0/4126234237 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3deffd640 1 -- 172.21.15.78:0/4126234237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0106d90 con 0x7fb3e0105be0 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3deffd640 1 --2- 172.21.15.78:0/4126234237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0105fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009820 tx=0x7fb3c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27341ca4ffb96235 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3ddffb640 1 -- 172.21.15.78:0/4126234237 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3c802ae70 con 0x7fb3e0105be0 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3ddffb640 1 -- 172.21.15.78:0/4126234237 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fb3c8032890 con 0x7fb3e0105be0 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3ddffb640 1 -- 172.21.15.78:0/4126234237 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3c8030660 con 0x7fb3e0105be0 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- 172.21.15.78:0/4126234237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 msgr2=0x7fb3e0105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 --2- 172.21.15.78:0/4126234237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0105fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009820 tx=0x7fb3c802a270 comp rx=0 tx=0).stop 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- 172.21.15.78:0/4126234237 shutdown_connections 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 --2- 172.21.15.78:0/4126234237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0105fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- 172.21.15.78:0/4126234237 >> 172.21.15.78:0/4126234237 conn(0x7fb3e00791d0 msgr2=0x7fb3e0103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- 172.21.15.78:0/4126234237 shutdown_connections 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- 172.21.15.78:0/4126234237 wait complete. 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 Processor -- start 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- start start 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e0199dd0 con 0x7fb3e0105be0 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60566/0 (socket says 172.21.15.78:60566) 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3deffd640 1 -- 172.21.15.78:0/1169323902 learned_addr learned my addr 172.21.15.78:0/1169323902 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3deffd640 1 -- 172.21.15.78:0/1169323902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80094d0 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3deffd640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0199890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3c802afa0 tx=0x7fb3c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3c8030c60 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fb3c8030dc0 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3c803a390 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e0199fd0 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.730+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e019a470 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.734+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fb3c8039040 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.734+0000 7fb3d7fff640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fb3cc038670 0x7fb3cc03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.734+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb3c806b630 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.734+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e0105fe0 con 0x7fb3e0105be0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.734+0000 7fb3de7fc640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fb3cc038670 0x7fb3cc03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.734+0000 7fb3de7fc640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fb3cc038670 0x7fb3cc03ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00098c0 tx=0x7fb3d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:23.027 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:21.738+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb3c803f080 con 0x7fb3e0105be0 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.142+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fb3e0109fc0 con 0x7fb3e0105be0 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.334+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fb3c803b7b0 con 0x7fb3e0105be0 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3d7fff640 1 -- 172.21.15.78:0/1169323902 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fb3c8040260 con 0x7fb3e0105be0 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fb3cc038670 msgr2=0x7fb3cc03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fb3cc038670 0x7fb3cc03ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00098c0 tx=0x7fb3d0006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 msgr2=0x7fb3e0199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0199890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3c802afa0 tx=0x7fb3c8032670 comp rx=0 tx=0).stop 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 shutdown_connections 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7fb3cc038670 0x7fb3cc03ab30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 --2- 172.21.15.78:0/1169323902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e0105be0 0x7fb3e0199890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 >> 172.21.15.78:0/1169323902 conn(0x7fb3e00791d0 msgr2=0x7fb3e01035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 shutdown_connections 2024-09-17T08:42:23.028 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:22.338+0000 7fb3e5673640 1 -- 172.21.15.78:0/1169323902 wait complete. 2024-09-17T08:42:23.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:23 smithi078 bash[22670]: audit 2024-09-17T08:42:22.338892+0000 mon.a (mon.0) 66 : audit [INF] from='client.? 172.21.15.78:0/1169323902' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T08:42:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:23 smithi078 bash[22670]: cluster 2024-09-17T08:42:22.338939+0000 mon.a (mon.0) 67 : cluster [DBG] mgrmap e9: y(active, since 25s) 2024-09-17T08:42:23.913 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:23 smithi078 bash[22923]: debug 2024-09-17T08:42:23.658+0000 7f8fc1fbe040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T08:42:23.913 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:23 smithi078 bash[22923]: debug 2024-09-17T08:42:23.726+0000 7f8fc1fbe040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T08:42:23.913 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:23 smithi078 bash[22923]: debug 2024-09-17T08:42:23.878+0000 7f8fc1fbe040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T08:42:24.593 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:24 smithi078 bash[22923]: debug 2024-09-17T08:42:24.522+0000 7f8fc1fbe040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T08:42:24.847 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:24 smithi078 bash[22923]: debug 2024-09-17T08:42:24.590+0000 7f8fc1fbe040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T08:42:24.847 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:24 smithi078 bash[22923]: debug 2024-09-17T08:42:24.662+0000 7f8fc1fbe040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T08:42:25.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:24 smithi078 bash[22670]: audit 2024-09-17T08:42:24.911343+0000 mon.a (mon.0) 68 : audit [DBG] from='client.? 172.21.15.78:0/149930242' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T08:42:25.105 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:24 smithi078 bash[22923]: debug 2024-09-17T08:42:24.846+0000 7f8fc1fbe040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T08:42:25.105 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:24 smithi078 bash[22923]: debug 2024-09-17T08:42:24.926+0000 7f8fc1fbe040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T08:42:25.105 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:25 smithi078 bash[22923]: debug 2024-09-17T08:42:25.002+0000 7f8fc1fbe040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T08:42:25.517 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:25 smithi078 bash[22923]: debug 2024-09-17T08:42:25.258+0000 7f8fc1fbe040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T08:42:25.517 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:25 smithi078 bash[22923]: debug 2024-09-17T08:42:25.322+0000 7f8fc1fbe040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T08:42:25.839 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:25 smithi078 bash[22923]: debug 2024-09-17T08:42:25.514+0000 7f8fc1fbe040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T08:42:25.839 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:25 smithi078 bash[22923]: debug 2024-09-17T08:42:25.590+0000 7f8fc1fbe040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T08:42:26.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-17T08:42:26.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T08:42:26.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T08:42:26.021 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0edfa640 1 Processor -- start 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0edfa640 1 -- start start 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0edfa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08102c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0edfa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08103240 con 0x7f1a08102870 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0cb96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0cb96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41908/0 (socket says 172.21.15.78:41908) 2024-09-17T08:42:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0cb96640 1 -- 172.21.15.78:0/1403172531 learned_addr learned my addr 172.21.15.78:0/1403172531 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.486+0000 7f1a0cb96640 1 -- 172.21.15.78:0/1403172531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08103a70 con 0x7f1a08102870 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0cb96640 1 --2- 172.21.15.78:0/1403172531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08102c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009820 tx=0x7f19fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba5a7b7a2b7bc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a077fe640 1 -- 172.21.15.78:0/1403172531 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19fc02ae70 con 0x7f1a08102870 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a077fe640 1 -- 172.21.15.78:0/1403172531 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f19fc032890 con 0x7f1a08102870 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a077fe640 1 -- 172.21.15.78:0/1403172531 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19fc030660 con 0x7f1a08102870 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- 172.21.15.78:0/1403172531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 msgr2=0x7f1a08102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 --2- 172.21.15.78:0/1403172531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08102c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009820 tx=0x7f19fc02a270 comp rx=0 tx=0).stop 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- 172.21.15.78:0/1403172531 shutdown_connections 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 --2- 172.21.15.78:0/1403172531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08102c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- 172.21.15.78:0/1403172531 >> 172.21.15.78:0/1403172531 conn(0x7f1a080fe000 msgr2=0x7f1a08100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- 172.21.15.78:0/1403172531 shutdown_connections 2024-09-17T08:42:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- 172.21.15.78:0/1403172531 wait complete. 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 Processor -- start 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- start start 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08199dd0 con 0x7f1a08102870 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0cb96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0cb96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41912/0 (socket says 172.21.15.78:41912) 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0cb96640 1 -- 172.21.15.78:0/149930242 learned_addr learned my addr 172.21.15.78:0/149930242 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0cb96640 1 -- 172.21.15.78:0/149930242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0094d0 con 0x7f1a08102870 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0cb96640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08199890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19fc032670 tx=0x7f19fc0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a05ffb640 1 -- 172.21.15.78:0/149930242 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19fc030cb0 con 0x7f1a08102870 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a05ffb640 1 -- 172.21.15.78:0/149930242 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f19fc030e10 con 0x7f1a08102870 2024-09-17T08:42:26.024 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a08199fd0 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a05ffb640 1 -- 172.21.15.78:0/149930242 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19fc03a390 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.490+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0819a470 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.494+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08102c70 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.494+0000 7f1a05ffb640 1 -- 172.21.15.78:0/149930242 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f19fc039040 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.494+0000 7f1a05ffb640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 0x7f19f803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.494+0000 7f1a05ffb640 1 -- 172.21.15.78:0/149930242 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f19fc06b890 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.494+0000 7f1a07fff640 1 -- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 msgr2=0x7f19f803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2109055855 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.494+0000 7f1a07fff640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 0x7f19f803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.498+0000 7f1a05ffb640 1 -- 172.21.15.78:0/149930242 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f19fc0313a0 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.694+0000 7f1a07fff640 1 -- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 msgr2=0x7f19f803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2109055855 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.694+0000 7f1a07fff640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 0x7f19f803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f1a08106c70 con 0x7f1a08102870 2024-09-17T08:42:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a05ffb640 1 -- 172.21.15.78:0/149930242 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f19fc03f070 con 0x7f1a08102870 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 msgr2=0x7f19f803ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 0x7f19f803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 msgr2=0x7f1a08199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08199890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19fc032670 tx=0x7f19fc0326a0 comp rx=0 tx=0).stop 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 shutdown_connections 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f19f8038670 0x7f19f803ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 --2- 172.21.15.78:0/149930242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08102870 0x7f1a08199890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.910+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 >> 172.21.15.78:0/149930242 conn(0x7f1a080fe000 msgr2=0x7f1a080fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.914+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 shutdown_connections 2024-09-17T08:42:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:24.914+0000 7f1a0edfa640 1 -- 172.21.15.78:0/149930242 wait complete. 2024-09-17T08:42:26.027 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for the mgr to restart... 2024-09-17T08:42:26.027 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr epoch 9... 2024-09-17T08:42:26.104 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:25 smithi078 bash[22923]: debug 2024-09-17T08:42:25.838+0000 7f8fc1fbe040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T08:42:26.105 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:26 smithi078 bash[22923]: debug 2024-09-17T08:42:26.010+0000 7f8fc1fbe040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:42:26.432 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:26 smithi078 bash[22923]: debug 2024-09-17T08:42:26.178+0000 7f8fc1fbe040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T08:42:26.432 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:26 smithi078 bash[22923]: debug 2024-09-17T08:42:26.254+0000 7f8fc1fbe040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T08:42:26.854 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:26 smithi078 bash[22923]: debug 2024-09-17T08:42:26.430+0000 7f8fc1fbe040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:42:27.315 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:27 smithi078 bash[22923]: debug 2024-09-17T08:42:27.238+0000 7f8fc1fbe040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T08:42:27.604 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:27 smithi078 bash[22923]: debug 2024-09-17T08:42:27.314+0000 7f8fc1fbe040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T08:42:27.604 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:27 smithi078 bash[22923]: debug 2024-09-17T08:42:27.530+0000 7f8fc1fbe040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T08:42:27.984 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:27 smithi078 bash[22923]: debug 2024-09-17T08:42:27.602+0000 7f8fc1fbe040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T08:42:28.258 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:27 smithi078 bash[22923]: debug 2024-09-17T08:42:27.982+0000 7f8fc1fbe040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T08:42:28.258 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22923]: debug 2024-09-17T08:42:28.058+0000 7f8fc1fbe040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T08:42:28.258 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: cluster 2024-09-17T08:42:28.063883+0000 mon.a (mon.0) 69 : cluster [INF] Active manager daemon y restarted 2024-09-17T08:42:28.258 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: cluster 2024-09-17T08:42:28.064599+0000 mon.a (mon.0) 70 : cluster [INF] Activating manager daemon y 2024-09-17T08:42:28.258 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: cluster 2024-09-17T08:42:28.068814+0000 mon.a (mon.0) 71 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-17T08:42:28.258 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: cluster 2024-09-17T08:42:28.068970+0000 mon.a (mon.0) 72 : cluster [DBG] mgrmap e10: y(active, starting, since 0.00471246s) 2024-09-17T08:42:28.258 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: audit 2024-09-17T08:42:28.072104+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:42:28.259 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: audit 2024-09-17T08:42:28.073917+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T08:42:28.259 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: audit 2024-09-17T08:42:28.074885+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T08:42:28.259 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: audit 2024-09-17T08:42:28.075043+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T08:42:28.259 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: audit 2024-09-17T08:42:28.075195+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T08:42:28.259 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: cluster 2024-09-17T08:42:28.100904+0000 mon.a (mon.0) 78 : cluster [INF] Manager daemon y is now available 2024-09-17T08:42:28.259 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:28 smithi078 bash[22670]: audit 2024-09-17T08:42:28.114643+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:42:29.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22670]: audit 2024-09-17T08:42:28.133464+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T08:42:29.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22670]: audit 2024-09-17T08:42:28.137503+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T08:42:29.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22670]: cluster 2024-09-17T08:42:29.077522+0000 mon.a (mon.0) 82 : cluster [DBG] mgrmap e11: y(active, since 1.01326s) 2024-09-17T08:42:29.733 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-17T08:42:29.733 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T08:42:29.733 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T08:42:29.733 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-17T08:42:29.733 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 Processor -- start 2024-09-17T08:42:29.734 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 -- start start 2024-09-17T08:42:29.734 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a41067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:29.734 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4076ed0 con 0x7f53a41043c0 2024-09-17T08:42:29.734 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a41067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:29.734 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a41067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41914/0 (socket says 172.21.15.78:41914) 2024-09-17T08:42:29.734 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a3fff640 1 -- 172.21.15.78:0/2145411414 learned_addr learned my addr 172.21.15.78:0/2145411414 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:29.734 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a3fff640 1 -- 172.21.15.78:0/2145411414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4106cf0 con 0x7f53a41043c0 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a3fff640 1 --2- 172.21.15.78:0/2145411414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a41067b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5394009820 tx=0x7f539402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e7ae1db1142fad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a2ffd640 1 -- 172.21.15.78:0/2145411414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f539402ae70 con 0x7f53a41043c0 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a2ffd640 1 -- 172.21.15.78:0/2145411414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5394032890 con 0x7f53a41043c0 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53a2ffd640 1 -- 172.21.15.78:0/2145411414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5394030660 con 0x7f53a41043c0 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 -- 172.21.15.78:0/2145411414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 msgr2=0x7f53a41067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 --2- 172.21.15.78:0/2145411414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a41067b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5394009820 tx=0x7f539402a270 comp rx=0 tx=0).stop 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 -- 172.21.15.78:0/2145411414 shutdown_connections 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 --2- 172.21.15.78:0/2145411414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a41067b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 -- 172.21.15.78:0/2145411414 >> 172.21.15.78:0/2145411414 conn(0x7f53a40fe040 msgr2=0x7f53a4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 -- 172.21.15.78:0/2145411414 shutdown_connections 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 -- 172.21.15.78:0/2145411414 wait complete. 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.214+0000 7f53aa5c7640 1 Processor -- start 2024-09-17T08:42:29.735 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53aa5c7640 1 -- start start 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53aa5c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a4197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53aa5c7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4197b70 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a4197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a4197630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41928/0 (socket says 172.21.15.78:41928) 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a3fff640 1 -- 172.21.15.78:0/3016598804 learned_addr learned my addr 172.21.15.78:0/3016598804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a3fff640 1 -- 172.21.15.78:0/3016598804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940094d0 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a3fff640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a4197630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53940326a0 tx=0x7f53940326d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5394030cb0 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5394030e10 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f539403a390 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a4197d70 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a4198210 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f5394039040 con 0x7f53a41043c0 2024-09-17T08:42:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a17fa640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 0x7f539003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 --> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53a4107a30 con 0x7f53900386c0 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f539406b800 con 0x7f53a41043c0 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a37fe640 1 -- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 msgr2=0x7f539003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2109055855 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.218+0000 7f53a37fe640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 0x7f539003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.418+0000 7f53a37fe640 1 -- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 msgr2=0x7f539003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2109055855 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.418+0000 7f53a37fe640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 0x7f539003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.818+0000 7f53a37fe640 1 -- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 msgr2=0x7f539003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2109055855 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:27.818+0000 7f53a37fe640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 0x7f539003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:28.066+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f5394041d60 con 0x7f53a41043c0 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:28.066+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 msgr2=0x7f539003ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:28.066+0000 7f53a17fa640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 0x7f539003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.070+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f539406d420 con 0x7f53a41043c0 2024-09-17T08:42:29.737 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.070+0000 7f53a17fa640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f539003bf80 0x7f539003e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.070+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53a4107a30 con 0x7f539003bf80 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.070+0000 7f53a37fe640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f539003bf80 0x7f539003e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.074+0000 7f53a37fe640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f539003bf80 0x7f539003e370 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f538c003980 tx=0x7f538c0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.074+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f53a4107a30 con 0x7f539003bf80 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f53a4107ba0 con 0x7f539003bf80 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53a17fa640 1 -- 172.21.15.78:0/3016598804 <== mgr.14150 v2:172.21.15.78:6800/2295189925 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f53a4107ba0 con 0x7f539003bf80 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f539003bf80 msgr2=0x7f539003e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f539003bf80 0x7f539003e370 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f538c003980 tx=0x7f538c0092b0 comp rx=0 tx=0).stop 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 msgr2=0x7f53a4197630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a4197630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53940326a0 tx=0x7f53940326d0 comp rx=0 tx=0).stop 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 shutdown_connections 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f539003bf80 0x7f539003e370 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:29.738 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:6800/2109055855,v1:172.21.15.78:6801/2109055855] conn(0x7f53900386c0 0x7f539003ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:29.739 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 --2- 172.21.15.78:0/3016598804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53a41043c0 0x7f53a4197630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:29.739 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 >> 172.21.15.78:0/3016598804 conn(0x7f53a40fe040 msgr2=0x7f53a40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:29.739 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 shutdown_connections 2024-09-17T08:42:29.739 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:29.086+0000 7f53aa5c7640 1 -- 172.21.15.78:0/3016598804 wait complete. 2024-09-17T08:42:29.739 INFO:teuthology.orchestra.run.smithi078.stdout:mgr epoch 9 is available 2024-09-17T08:42:29.739 INFO:teuthology.orchestra.run.smithi078.stdout:Generating a dashboard self-signed certificate... 2024-09-17T08:42:29.850 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: debug 2024-09-17T08:42:29.486+0000 7f8f2dc44640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:08:42:29] ENGINE Error in HTTPServer.serve 2024-09-17T08:42:29.850 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: Traceback (most recent call last): 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: self._connections.run(self.expiration_interval) 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: self._run(expiration_interval) 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: s = self.context.wrap_socket( 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: return self.sslsocket_class._create( 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:42:29.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: self.do_handshake() 2024-09-17T08:42:29.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:42:29.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: self._sslobj.do_handshake() 2024-09-17T08:42:29.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:42:29 smithi078 bash[22923]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:42:30.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:30 smithi078 bash[22670]: cephadm 2024-09-17T08:42:29.364422+0000 mgr.y (mgr.14150) 3 : cephadm [INF] [17/Sep/2024:08:42:29] ENGINE Bus STARTING 2024-09-17T08:42:31.470 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: cephadm 2024-09-17T08:42:29.484240+0000 mgr.y (mgr.14150) 4 : cephadm [INF] [17/Sep/2024:08:42:29] ENGINE Serving on https://172.21.15.78:7150 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: cephadm 2024-09-17T08:42:29.487727+0000 mgr.y (mgr.14150) 5 : cephadm [ERR] [17/Sep/2024:08:42:29] ENGINE Error in HTTPServer.serve 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: Traceback (most recent call last): 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: self._connections.run(self.expiration_interval) 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: self._run(expiration_interval) 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: s = self.context.wrap_socket( 2024-09-17T08:42:31.471 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: return self.sslsocket_class._create( 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: self.do_handshake() 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: self._sslobj.do_handshake() 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: cephadm 2024-09-17T08:42:29.585237+0000 mgr.y (mgr.14150) 6 : cephadm [INF] [17/Sep/2024:08:42:29] ENGINE Serving on http://172.21.15.78:8765 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: cephadm 2024-09-17T08:42:29.585342+0000 mgr.y (mgr.14150) 7 : cephadm [INF] [17/Sep/2024:08:42:29] ENGINE Bus STARTED 2024-09-17T08:42:31.472 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:31 smithi078 bash[22670]: cluster 2024-09-17T08:42:30.134137+0000 mon.a (mon.0) 83 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-09-17T08:42:31.853 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.834+0000 7fdd90d5a640 1 Processor -- start 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.834+0000 7fdd90d5a640 1 -- start start 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.834+0000 7fdd90d5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c102c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.834+0000 7fdd90d5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c103240 con 0x7fdd8c102870 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.834+0000 7fdd8a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.834+0000 7fdd8a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42018/0 (socket says 172.21.15.78:42018) 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 -- 172.21.15.78:0/772977683 learned_addr learned my addr 172.21.15.78:0/772977683 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 -- 172.21.15.78:0/772977683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c103a70 con 0x7fdd8c102870 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 --2- 172.21.15.78:0/772977683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c102c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009820 tx=0x7fdd7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9883d5e68c93301d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8959a640 1 -- 172.21.15.78:0/772977683 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c02ae70 con 0x7fdd8c102870 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8959a640 1 -- 172.21.15.78:0/772977683 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fdd7c032890 con 0x7fdd8c102870 2024-09-17T08:42:31.854 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8959a640 1 -- 172.21.15.78:0/772977683 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c030660 con 0x7fdd8c102870 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- 172.21.15.78:0/772977683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 msgr2=0x7fdd8c102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 --2- 172.21.15.78:0/772977683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c102c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009820 tx=0x7fdd7c02a270 comp rx=0 tx=0).stop 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- 172.21.15.78:0/772977683 shutdown_connections 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 --2- 172.21.15.78:0/772977683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c102c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- 172.21.15.78:0/772977683 >> 172.21.15.78:0/772977683 conn(0x7fdd8c0fe000 msgr2=0x7fdd8c100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- 172.21.15.78:0/772977683 shutdown_connections 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- 172.21.15.78:0/772977683 wait complete. 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 Processor -- start 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- start start 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c197be0 con 0x7fdd8c102870 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c1976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42026/0 (socket says 172.21.15.78:42026) 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 -- 172.21.15.78:0/4064606457 learned_addr learned my addr 172.21.15.78:0/4064606457 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 -- 172.21.15.78:0/4064606457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c0094d0 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd8a59c640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c1976a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c032670 tx=0x7fdd7c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd7b7fe640 1 -- 172.21.15.78:0/4064606457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c030cb0 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd7b7fe640 1 -- 172.21.15.78:0/4064606457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fdd7c030e10 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c197de0 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd7b7fe640 1 -- 172.21.15.78:0/4064606457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c03a390 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.838+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c198280 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.842+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c102c70 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.842+0000 7fdd7b7fe640 1 -- 172.21.15.78:0/4064606457 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fdd7c039040 con 0x7fdd8c102870 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.842+0000 7fdd7b7fe640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdd740386c0 0x7fdd7403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:31.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.842+0000 7fdd7b7fe640 1 -- 172.21.15.78:0/4064606457 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdd7c06b850 con 0x7fdd8c102870 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.842+0000 7fdd89d9b640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdd740386c0 0x7fdd7403ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.842+0000 7fdd89d9b640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdd740386c0 0x7fdd7403ab80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdd800098c0 tx=0x7fdd80006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:30.846+0000 7fdd7b7fe640 1 -- 172.21.15.78:0/4064606457 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdd7c0313a0 con 0x7fdd8c102870 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.170+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd8c0608f0 con 0x7fdd740386c0 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.254+0000 7fdd7b7fe640 1 -- 172.21.15.78:0/4064606457 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fdd8c0608f0 con 0x7fdd740386c0 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdd740386c0 msgr2=0x7fdd7403ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdd740386c0 0x7fdd7403ab80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdd800098c0 tx=0x7fdd80006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 msgr2=0x7fdd8c1976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c1976a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c032670 tx=0x7fdd7c0326a0 comp rx=0 tx=0).stop 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 shutdown_connections 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdd740386c0 0x7fdd7403ab80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 --2- 172.21.15.78:0/4064606457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c102870 0x7fdd8c1976a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:31.857 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 >> 172.21.15.78:0/4064606457 conn(0x7fdd8c0fe000 msgr2=0x7fdd8c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:31.858 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 shutdown_connections 2024-09-17T08:42:31.858 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:31.258+0000 7fdd90d5a640 1 -- 172.21.15.78:0/4064606457 wait complete. 2024-09-17T08:42:31.858 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial admin user... 2024-09-17T08:42:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:32 smithi078 bash[22670]: audit 2024-09-17T08:42:31.173677+0000 mgr.y (mgr.14150) 8 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:32.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:32 smithi078 bash[22670]: audit 2024-09-17T08:42:31.254393+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:32.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:32 smithi078 bash[22670]: audit 2024-09-17T08:42:31.257132+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:33.703 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:33 smithi078 bash[22670]: audit 2024-09-17T08:42:33.222760+0000 mgr.y (mgr.14150) 9 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:34.103 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$B/UcOCKoffM8XoETmdNILOtcJV8sXM7DKpnKfC5TVFGmyq1ron7Kq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726562553, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T08:42:34.103 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feeff54f640 1 Processor -- start 2024-09-17T08:42:34.103 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feeff54f640 1 -- start start 2024-09-17T08:42:34.103 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feeff54f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef8077b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:34.103 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feeff54f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8078160 con 0x7feef8079730 2024-09-17T08:42:34.103 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feefd2eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef8077b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feefd2eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef8077b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43012/0 (socket says 172.21.15.78:43012) 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feefd2eb640 1 -- 172.21.15.78:0/121373283 learned_addr learned my addr 172.21.15.78:0/121373283 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feefd2eb640 1 -- 172.21.15.78:0/121373283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80782a0 con 0x7feef8079730 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.874+0000 7feefd2eb640 1 --2- 172.21.15.78:0/121373283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef8077b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feef0009e80 tx=0x7feef002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58647b1df80d51f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeeffff640 1 -- 172.21.15.78:0/121373283 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feef0031400 con 0x7feef8079730 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeeffff640 1 -- 172.21.15.78:0/121373283 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7feef002d050 con 0x7feef8079730 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeeffff640 1 -- 172.21.15.78:0/121373283 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feef0007740 con 0x7feef8079730 2024-09-17T08:42:34.104 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/121373283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 msgr2=0x7feef8077b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 --2- 172.21.15.78:0/121373283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef8077b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feef0009e80 tx=0x7feef002a7a0 comp rx=0 tx=0).stop 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/121373283 shutdown_connections 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 --2- 172.21.15.78:0/121373283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef8077b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/121373283 >> 172.21.15.78:0/121373283 conn(0x7feef80ff1b0 msgr2=0x7feef81015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/121373283 shutdown_connections 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/121373283 wait complete. 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 Processor -- start 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- start start 2024-09-17T08:42:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8199d00 con 0x7feef8079730 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feefd2eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feefd2eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef81997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43024/0 (socket says 172.21.15.78:43024) 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feefd2eb640 1 -- 172.21.15.78:0/3879721383 learned_addr learned my addr 172.21.15.78:0/3879721383 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feefd2eb640 1 -- 172.21.15.78:0/3879721383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009b30 con 0x7feef8079730 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feefd2eb640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef81997c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feef0032fd0 tx=0x7feef0031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeee7fc640 1 -- 172.21.15.78:0/3879721383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feef0031880 con 0x7feef8079730 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeee7fc640 1 -- 172.21.15.78:0/3879721383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7feef00319e0 con 0x7feef8079730 2024-09-17T08:42:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8199f00 con 0x7feef8079730 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeee7fc640 1 -- 172.21.15.78:0/3879721383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feef00394d0 con 0x7feef8079730 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef819a3a0 con 0x7feef8079730 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeee7fc640 1 -- 172.21.15.78:0/3879721383 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7feef0038040 con 0x7feef8079730 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef8109cd0 con 0x7feef8079730 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.878+0000 7feeee7fc640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feee40386c0 0x7feee403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.882+0000 7feeee7fc640 1 -- 172.21.15.78:0/3879721383 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feef006b5b0 con 0x7feef8079730 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.882+0000 7feefcaea640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feee40386c0 0x7feee403ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.882+0000 7feefcaea640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feee40386c0 0x7feee403ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feee80098c0 tx=0x7feee8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:34.107 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:32.886+0000 7feeee7fc640 1 -- 172.21.15.78:0/3879721383 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feef00434f0 con 0x7feef8079730 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.218+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7feef8061900 con 0x7feee40386c0 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.458+0000 7feeee7fc640 1 -- 172.21.15.78:0/3879721383 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7feef8061900 con 0x7feee40386c0 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feee40386c0 msgr2=0x7feee403ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feee40386c0 0x7feee403ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feee80098c0 tx=0x7feee8006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 msgr2=0x7feef81997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef81997c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feef0032fd0 tx=0x7feef0031cb0 comp rx=0 tx=0).stop 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 shutdown_connections 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feee40386c0 0x7feee403ab80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 --2- 172.21.15.78:0/3879721383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feef8079730 0x7feef81997c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 >> 172.21.15.78:0/3879721383 conn(0x7feef80ff1b0 msgr2=0x7feef80ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:34.108 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 shutdown_connections 2024-09-17T08:42:34.109 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:33.462+0000 7feeff54f640 1 -- 172.21.15.78:0/3879721383 wait complete. 2024-09-17T08:42:34.111 INFO:teuthology.orchestra.run.smithi078.stdout:Fetching dashboard port number... 2024-09-17T08:42:34.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:34 smithi078 bash[22670]: audit 2024-09-17T08:42:33.462104+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:35.727 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:35 smithi078 bash[22670]: cluster 2024-09-17T08:42:34.472029+0000 mon.a (mon.0) 87 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-09-17T08:42:35.727 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:35 smithi078 bash[22670]: audit 2024-09-17T08:42:34.764111+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:35.728 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:35 smithi078 bash[22670]: audit 2024-09-17T08:42:35.393734+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:36.117 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T08:42:36.117 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa588e48640 1 Processor -- start 2024-09-17T08:42:36.117 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa588e48640 1 -- start start 2024-09-17T08:42:36.117 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa588e48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584077b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:36.117 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa588e48640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584078160 con 0x7fa584079730 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584077b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584077b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43040/0 (socket says 172.21.15.78:43040) 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58259c640 1 -- 172.21.15.78:0/827125614 learned_addr learned my addr 172.21.15.78:0/827125614 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58259c640 1 -- 172.21.15.78:0/827125614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840782a0 con 0x7fa584079730 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58259c640 1 --2- 172.21.15.78:0/827125614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584077b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa578009820 tx=0x7fa57802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1e37e22d582e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58159a640 1 -- 172.21.15.78:0/827125614 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57802ae70 con 0x7fa584079730 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58159a640 1 -- 172.21.15.78:0/827125614 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa578032890 con 0x7fa584079730 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.154+0000 7fa58159a640 1 -- 172.21.15.78:0/827125614 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa578030660 con 0x7fa584079730 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- 172.21.15.78:0/827125614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 msgr2=0x7fa584077b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 --2- 172.21.15.78:0/827125614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584077b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa578009820 tx=0x7fa57802a270 comp rx=0 tx=0).stop 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- 172.21.15.78:0/827125614 shutdown_connections 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 --2- 172.21.15.78:0/827125614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584077b90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- 172.21.15.78:0/827125614 >> 172.21.15.78:0/827125614 conn(0x7fa5840ff180 msgr2=0x7fa5841015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- 172.21.15.78:0/827125614 shutdown_connections 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- 172.21.15.78:0/827125614 wait complete. 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 Processor -- start 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- start start 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584199d50 con 0x7fa584079730 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa58259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa58259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43044/0 (socket says 172.21.15.78:43044) 2024-09-17T08:42:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa58259c640 1 -- 172.21.15.78:0/2757815855 learned_addr learned my addr 172.21.15.78:0/2757815855 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa58259c640 1 -- 172.21.15.78:0/2757815855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5780094d0 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa58259c640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584199810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa578032670 tx=0x7fa5780326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa5737fe640 1 -- 172.21.15.78:0/2757815855 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa578030cb0 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa584199f50 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa5737fe640 1 -- 172.21.15.78:0/2757815855 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa578030e10 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58419a3f0 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa5737fe640 1 -- 172.21.15.78:0/2757815855 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57803a3f0 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.158+0000 7fa5737fe640 1 -- 172.21.15.78:0/2757815855 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fa578039040 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.162+0000 7fa5737fe640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fa56c038300 0x7fa56c03a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.162+0000 7fa5737fe640 1 -- 172.21.15.78:0/2757815855 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa578070660 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.162+0000 7fa581d9b640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fa56c038300 0x7fa56c03a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.162+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584077c10 con 0x7fa584079730 2024-09-17T08:42:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.162+0000 7fa581d9b640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fa56c038300 0x7fa56c03a7c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa5740098c0 tx=0x7fa574006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.166+0000 7fa5737fe640 1 -- 172.21.15.78:0/2757815855 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa57803f070 con 0x7fa584079730 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.494+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fa584109cc0 con 0x7fa584079730 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.494+0000 7fa5737fe640 1 -- 172.21.15.78:0/2757815855 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fa578037030 con 0x7fa584079730 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fa56c038300 msgr2=0x7fa56c03a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fa56c038300 0x7fa56c03a7c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa5740098c0 tx=0x7fa574006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 msgr2=0x7fa584199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584199810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa578032670 tx=0x7fa5780326a0 comp rx=0 tx=0).stop 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 shutdown_connections 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fa56c038300 0x7fa56c03a7c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 --2- 172.21.15.78:0/2757815855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa584079730 0x7fa584199810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 >> 172.21.15.78:0/2757815855 conn(0x7fa5840ff180 msgr2=0x7fa5840ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 shutdown_connections 2024-09-17T08:42:36.122 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:35.498+0000 7fa588e48640 1 -- 172.21.15.78:0/2757815855 wait complete. 2024-09-17T08:42:36.122 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld does not appear to be present 2024-09-17T08:42:36.122 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T08:42:36.122 INFO:teuthology.orchestra.run.smithi078.stdout:Ceph Dashboard is now available at: 2024-09-17T08:42:36.122 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: URL: https://smithi078.front.sepia.ceph.com:8443/ 2024-09-17T08:42:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: User: admin 2024-09-17T08:42:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: Password: rt8o9jypkx 2024-09-17T08:42:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:36.123 INFO:teuthology.orchestra.run.smithi078.stdout:Saving cluster configuration to /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config directory 2024-09-17T08:42:36.123 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling autotune for osd_memory_target 2024-09-17T08:42:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:36 smithi078 bash[22670]: audit 2024-09-17T08:42:35.497119+0000 mon.a (mon.0) 90 : audit [DBG] from='client.? 172.21.15.78:0/2757815855' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T08:42:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08cafca640 1 Processor -- start 2024-09-17T08:42:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08cafca640 1 -- start start 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08cafca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c4105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08cafca640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c41065b0 con 0x7f08c4105be0 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08c8d66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c4105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08c8d66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c4105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43054/0 (socket says 172.21.15.78:43054) 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08c8d66640 1 -- 172.21.15.78:0/1992549993 learned_addr learned my addr 172.21.15.78:0/1992549993 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.234+0000 7f08c8d66640 1 -- 172.21.15.78:0/1992549993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4106d90 con 0x7f08c4105be0 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c8d66640 1 --2- 172.21.15.78:0/1992549993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c4105fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009820 tx=0x7f08b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549f7fa1146ba4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c37fe640 1 -- 172.21.15.78:0/1992549993 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08b402ae70 con 0x7f08c4105be0 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c37fe640 1 -- 172.21.15.78:0/1992549993 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f08b4032890 con 0x7f08c4105be0 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c37fe640 1 -- 172.21.15.78:0/1992549993 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08b4030660 con 0x7f08c4105be0 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- 172.21.15.78:0/1992549993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 msgr2=0x7f08c4105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 --2- 172.21.15.78:0/1992549993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c4105fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009820 tx=0x7f08b402a270 comp rx=0 tx=0).stop 2024-09-17T08:42:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- 172.21.15.78:0/1992549993 shutdown_connections 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 --2- 172.21.15.78:0/1992549993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c4105fe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- 172.21.15.78:0/1992549993 >> 172.21.15.78:0/1992549993 conn(0x7f08c40791d0 msgr2=0x7f08c4103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- 172.21.15.78:0/1992549993 shutdown_connections 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- 172.21.15.78:0/1992549993 wait complete. 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 Processor -- start 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- start start 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c419dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c419e200 con 0x7f08c4105be0 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c8d66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c419dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c8d66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c419dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43060/0 (socket says 172.21.15.78:43060) 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c8d66640 1 -- 172.21.15.78:0/2493741649 learned_addr learned my addr 172.21.15.78:0/2493741649 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c8d66640 1 -- 172.21.15.78:0/2493741649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b40094d0 con 0x7f08c4105be0 2024-09-17T08:42:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c8d66640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c419dcc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08b4032670 tx=0x7f08b40326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c1ffb640 1 -- 172.21.15.78:0/2493741649 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08b4030cb0 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c1ffb640 1 -- 172.21.15.78:0/2493741649 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f08b4030e10 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c419e400 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08c1ffb640 1 -- 172.21.15.78:0/2493741649 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08b403a390 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.238+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c419e8a0 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.242+0000 7f08c1ffb640 1 -- 172.21.15.78:0/2493741649 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f08b4039040 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.242+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c4105fe0 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.242+0000 7f08c1ffb640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f08b0038710 0x7f08b003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.242+0000 7f08c1ffb640 1 -- 172.21.15.78:0/2493741649 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f08b406ba10 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.242+0000 7f08c3fff640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f08b0038710 0x7f08b003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.242+0000 7f08c3fff640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f08b0038710 0x7f08b003abd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0098c0 tx=0x7f08ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.246+0000 7f08c1ffb640 1 -- 172.21.15.78:0/2493741649 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f08b40313a0 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.558+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f08c4109fc0 con 0x7f08c4105be0 2024-09-17T08:42:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.558+0000 7f08c1ffb640 1 -- 172.21.15.78:0/2493741649 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f08b403f070 con 0x7f08c4105be0 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f08b0038710 msgr2=0x7f08b003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f08b0038710 0x7f08b003abd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0098c0 tx=0x7f08ac006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 msgr2=0x7f08c419dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c419dcc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08b4032670 tx=0x7f08b40326a0 comp rx=0 tx=0).stop 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 shutdown_connections 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f08b0038710 0x7f08b003abd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 --2- 172.21.15.78:0/2493741649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08c4105be0 0x7f08c419dcc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 >> 172.21.15.78:0/2493741649 conn(0x7f08c40791d0 msgr2=0x7f08c41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 shutdown_connections 2024-09-17T08:42:38.228 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:37.562+0000 7f08cafca640 1 -- 172.21.15.78:0/2493741649 wait complete. 2024-09-17T08:42:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d02b86640 1 Processor -- start 2024-09-17T08:42:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d02b86640 1 -- start start 2024-09-17T08:42:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d02b86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc10cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d02b86640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc10d1a0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d00922640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc10cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d00922640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc10cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43062/0 (socket says 172.21.15.78:43062) 2024-09-17T08:42:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d00922640 1 -- 172.21.15.78:0/3641113993 learned_addr learned my addr 172.21.15.78:0/3641113993 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:40.322 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.270+0000 7f3d00922640 1 -- 172.21.15.78:0/3641113993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc10d2e0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.322 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d00922640 1 --2- 172.21.15.78:0/3641113993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc10cbd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009820 tx=0x7f3cec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4949b763eaa05f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:40.322 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3cfb7fe640 1 -- 172.21.15.78:0/3641113993 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cec02ae70 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.322 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3cfb7fe640 1 -- 172.21.15.78:0/3641113993 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f3cec032890 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.322 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3cfb7fe640 1 -- 172.21.15.78:0/3641113993 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cec030660 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.322 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- 172.21.15.78:0/3641113993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 msgr2=0x7f3cfc10cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 --2- 172.21.15.78:0/3641113993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc10cbd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009820 tx=0x7f3cec02a270 comp rx=0 tx=0).stop 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- 172.21.15.78:0/3641113993 shutdown_connections 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 --2- 172.21.15.78:0/3641113993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc10cbd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- 172.21.15.78:0/3641113993 >> 172.21.15.78:0/3641113993 conn(0x7f3cfc079190 msgr2=0x7f3cfc07b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- 172.21.15.78:0/3641113993 shutdown_connections 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- 172.21.15.78:0/3641113993 wait complete. 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 Processor -- start 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- start start 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc19e150 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d00922640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d00922640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43068/0 (socket says 172.21.15.78:43068) 2024-09-17T08:42:40.323 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d00922640 1 -- 172.21.15.78:0/3736457930 learned_addr learned my addr 172.21.15.78:0/3736457930 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d00922640 1 -- 172.21.15.78:0/3736457930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0094d0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d00922640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc19dc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3cec000c00 tx=0x7f3cec032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3cf9ffb640 1 -- 172.21.15.78:0/3736457930 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cec030c60 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3cf9ffb640 1 -- 172.21.15.78:0/3736457930 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f3cec030dc0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc19e350 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc19e7f0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.274+0000 7f3cf9ffb640 1 -- 172.21.15.78:0/3736457930 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cec03a3f0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.278+0000 7f3cf9ffb640 1 -- 172.21.15.78:0/3736457930 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f3cec039040 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.278+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce8005070 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.327 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.278+0000 7f3cf9ffb640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3ce4038760 0x7f3ce403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.278+0000 7f3cf9ffb640 1 -- 172.21.15.78:0/3736457930 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3cec06b8c0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.278+0000 7f3cfbfff640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3ce4038760 0x7f3ce403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.278+0000 7f3cfbfff640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3ce4038760 0x7f3ce403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000ad30 tx=0x7f3cf00093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.282+0000 7f3cf9ffb640 1 -- 172.21.15.78:0/3736457930 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3cec04b300 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.778+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f3ce80058a0 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.782+0000 7f3cf9ffb640 1 -- 172.21.15.78:0/3736457930 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f3cec037070 con 0x7f3cfc10a7e0 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3ce4038760 msgr2=0x7f3ce403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3ce4038760 0x7f3ce403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000ad30 tx=0x7f3cf00093f0 comp rx=0 tx=0).stop 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 msgr2=0x7f3cfc19dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc19dc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3cec000c00 tx=0x7f3cec032670 comp rx=0 tx=0).stop 2024-09-17T08:42:40.328 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 shutdown_connections 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3ce4038760 0x7f3ce403ac20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 --2- 172.21.15.78:0/3736457930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cfc10a7e0 0x7f3cfc19dc10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 >> 172.21.15.78:0/3736457930 conn(0x7f3cfc079190 msgr2=0x7f3cfc079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 shutdown_connections 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr 2024-09-17T08:42:39.786+0000 7f3d02b86640 1 -- 172.21.15.78:0/3736457930 wait complete. 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T08:42:40.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout: ceph telemetry on 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout:For more information see: 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:42:40.330 INFO:teuthology.orchestra.run.smithi078.stdout:Bootstrap complete. 2024-09-17T08:42:40.374 INFO:tasks.cephadm:Fetching config... 2024-09-17T08:42:40.374 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:42:40.375 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T08:42:40.381 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T08:42:40.381 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:42:40.381 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T08:42:40.430 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T08:42:40.430 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:42:40.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-17T08:42:40.483 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T08:42:40.483 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:42:40.484 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T08:42:40.530 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T08:42:40.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC81WJZUWpyUhFyBIDhgyvej44AkZRvg4ZDdkLpI2GNLtGYZcgZicnu7GkLe8J3xuAvuiyL1/qnCuQwkYviWApU8L5vo+xjuyQs9ImrdcWmYik8DuJ73ib3AE4+UXQCS2RAqBFSjkZuxxAxk7yN9DO9kq4y12RTdvPcnJ3k7eV1nD1kqzelJvSfBJPr/ZaJjNU0JC4B7ut9dVRNMCkPKovnFnf7HDOHaS97vywBZYirUvylcl5kvbiqLW5AULYgDxvqvlmNokqvlTXkrQsXN9gBkMppGuosu4AA9psxjseDy0vrApLrhZmZl4MHgPfxIdWzHGRR8YcRNQk9InenWZscs1bPG++8vZM5KBNhooYfwFArPHtwKxzcARMMMwl6e/sAUJFPFp7S7xhBQExJd8qA2ZOZG8sjB1MXq2sHbriEg8XqbRFoV+nQFQbExY/AeXZCiXDHQn0p6w1WRdRIJYslW3mltkGuok7jYjdEFPMGUSoxXOEwbPQF7Ox6I1p9Ro8= ceph-7121dba6-74d0-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T08:42:40.593 INFO:teuthology.orchestra.run.smithi078.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC81WJZUWpyUhFyBIDhgyvej44AkZRvg4ZDdkLpI2GNLtGYZcgZicnu7GkLe8J3xuAvuiyL1/qnCuQwkYviWApU8L5vo+xjuyQs9ImrdcWmYik8DuJ73ib3AE4+UXQCS2RAqBFSjkZuxxAxk7yN9DO9kq4y12RTdvPcnJ3k7eV1nD1kqzelJvSfBJPr/ZaJjNU0JC4B7ut9dVRNMCkPKovnFnf7HDOHaS97vywBZYirUvylcl5kvbiqLW5AULYgDxvqvlmNokqvlTXkrQsXN9gBkMppGuosu4AA9psxjseDy0vrApLrhZmZl4MHgPfxIdWzHGRR8YcRNQk9InenWZscs1bPG++8vZM5KBNhooYfwFArPHtwKxzcARMMMwl6e/sAUJFPFp7S7xhBQExJd8qA2ZOZG8sjB1MXq2sHbriEg8XqbRFoV+nQFQbExY/AeXZCiXDHQn0p6w1WRdRIJYslW3mltkGuok7jYjdEFPMGUSoxXOEwbPQF7Ox6I1p9Ro8= ceph-7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:42:40.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC81WJZUWpyUhFyBIDhgyvej44AkZRvg4ZDdkLpI2GNLtGYZcgZicnu7GkLe8J3xuAvuiyL1/qnCuQwkYviWApU8L5vo+xjuyQs9ImrdcWmYik8DuJ73ib3AE4+UXQCS2RAqBFSjkZuxxAxk7yN9DO9kq4y12RTdvPcnJ3k7eV1nD1kqzelJvSfBJPr/ZaJjNU0JC4B7ut9dVRNMCkPKovnFnf7HDOHaS97vywBZYirUvylcl5kvbiqLW5AULYgDxvqvlmNokqvlTXkrQsXN9gBkMppGuosu4AA9psxjseDy0vrApLrhZmZl4MHgPfxIdWzHGRR8YcRNQk9InenWZscs1bPG++8vZM5KBNhooYfwFArPHtwKxzcARMMMwl6e/sAUJFPFp7S7xhBQExJd8qA2ZOZG8sjB1MXq2sHbriEg8XqbRFoV+nQFQbExY/AeXZCiXDHQn0p6w1WRdRIJYslW3mltkGuok7jYjdEFPMGUSoxXOEwbPQF7Ox6I1p9Ro8= ceph-7121dba6-74d0-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T08:42:40.626 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC81WJZUWpyUhFyBIDhgyvej44AkZRvg4ZDdkLpI2GNLtGYZcgZicnu7GkLe8J3xuAvuiyL1/qnCuQwkYviWApU8L5vo+xjuyQs9ImrdcWmYik8DuJ73ib3AE4+UXQCS2RAqBFSjkZuxxAxk7yN9DO9kq4y12RTdvPcnJ3k7eV1nD1kqzelJvSfBJPr/ZaJjNU0JC4B7ut9dVRNMCkPKovnFnf7HDOHaS97vywBZYirUvylcl5kvbiqLW5AULYgDxvqvlmNokqvlTXkrQsXN9gBkMppGuosu4AA9psxjseDy0vrApLrhZmZl4MHgPfxIdWzHGRR8YcRNQk9InenWZscs1bPG++8vZM5KBNhooYfwFArPHtwKxzcARMMMwl6e/sAUJFPFp7S7xhBQExJd8qA2ZOZG8sjB1MXq2sHbriEg8XqbRFoV+nQFQbExY/AeXZCiXDHQn0p6w1WRdRIJYslW3mltkGuok7jYjdEFPMGUSoxXOEwbPQF7Ox6I1p9Ro8= ceph-7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:42:40.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T08:42:41.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:40 smithi078 bash[22670]: audit 2024-09-17T08:42:39.783959+0000 mon.a (mon.0) 91 : audit [INF] from='client.? 172.21.15.78:0/3736457930' entity='client.admin' 2024-09-17T08:42:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:42:47.499 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:47 smithi078 bash[22670]: audit 2024-09-17T08:42:46.244723+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:47.499 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:47 smithi078 bash[22670]: audit 2024-09-17T08:42:46.249714+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:47.499 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:47 smithi078 bash[22670]: audit 2024-09-17T08:42:46.250877+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:42:47.500 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:47 smithi078 bash[22670]: audit 2024-09-17T08:42:46.258393+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:47.500 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:47 smithi078 bash[22670]: audit 2024-09-17T08:42:46.289938+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:42:47.500 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:47 smithi078 bash[22670]: audit 2024-09-17T08:42:46.299228+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 -- 172.21.15.78:0/2742709783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 msgr2=0x7f2cbc0feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 --2- 172.21.15.78:0/2742709783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc0feaf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009880 tx=0x7f2cac02a5d0 comp rx=0 tx=0).stop 2024-09-17T08:42:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 -- 172.21.15.78:0/2742709783 shutdown_connections 2024-09-17T08:42:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 --2- 172.21.15.78:0/2742709783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc0feaf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 -- 172.21.15.78:0/2742709783 >> 172.21.15.78:0/2742709783 conn(0x7f2cbc0f9e80 msgr2=0x7f2cbc0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 -- 172.21.15.78:0/2742709783 shutdown_connections 2024-09-17T08:42:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 -- 172.21.15.78:0/2742709783 wait complete. 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 Processor -- start 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 -- start start 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc194230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cc11f3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc194770 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cbad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc194230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cbad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc194230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37972/0 (socket says 172.21.15.78:37972) 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.286+0000 7f2cbad9d640 1 -- 172.21.15.78:0/1632031791 learned_addr learned my addr 172.21.15.78:0/1632031791 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cbad9d640 1 -- 172.21.15.78:0/1632031791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009560 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cbad9d640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc194230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2cac005940 tx=0x7f2cac005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb8d99640 1 -- 172.21.15.78:0/1632031791 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cac0055e0 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb8d99640 1 -- 172.21.15.78:0/1632031791 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f2cac003a40 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb8d99640 1 -- 172.21.15.78:0/1632031791 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cac03c7c0 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc194970 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc194d90 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc0feaf0 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb8d99640 1 -- 172.21.15.78:0/1632031791 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2cac003bb0 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb8d99640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f2ca8038760 0x7f2ca803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb8d99640 1 -- 172.21.15.78:0/1632031791 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2cac06c7d0 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb259c640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f2ca8038760 0x7f2ca803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.290+0000 7f2cb259c640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f2ca8038760 0x7f2ca803ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40098c0 tx=0x7f2ca4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.294+0000 7f2cb8d99640 1 -- 172.21.15.78:0/1632031791 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2cac0303a0 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.470+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2cbc18ddc0 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.474+0000 7f2cb8d99640 1 -- 172.21.15.78:0/1632031791 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2cac035070 con 0x7f2cbc0fe6f0 2024-09-17T08:42:49.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f2ca8038760 msgr2=0x7f2ca803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:49.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f2ca8038760 0x7f2ca803ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40098c0 tx=0x7f2ca4006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:49.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 msgr2=0x7f2cbc194230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:49.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc194230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2cac005940 tx=0x7f2cac005060 comp rx=0 tx=0).stop 2024-09-17T08:42:49.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 shutdown_connections 2024-09-17T08:42:49.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f2ca8038760 0x7f2ca803ac20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:49.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 --2- 172.21.15.78:0/1632031791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cbc0fe6f0 0x7f2cbc194230 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:49.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 >> 172.21.15.78:0/1632031791 conn(0x7f2cbc0f9e80 msgr2=0x7f2cbc068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:49.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 shutdown_connections 2024-09-17T08:42:49.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:49.478+0000 7f2cc11f3640 1 -- 172.21.15.78:0/1632031791 wait complete. 2024-09-17T08:42:49.490 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:49 smithi078 bash[22670]: cluster 2024-09-17T08:42:48.076830+0000 mgr.y (mgr.14150) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:50.098 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T08:42:50.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T08:42:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:50 smithi078 bash[22670]: audit 2024-09-17T08:42:49.477460+0000 mon.a (mon.0) 98 : audit [INF] from='client.? 172.21.15.78:0/1632031791' entity='client.admin' 2024-09-17T08:42:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:50 smithi078 bash[22670]: audit 2024-09-17T08:42:49.491563+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:42:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:50 smithi078 bash[22670]: audit 2024-09-17T08:42:49.496702+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:50 smithi078 bash[22670]: cluster 2024-09-17T08:42:50.077220+0000 mgr.y (mgr.14150) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:53 smithi078 bash[22670]: cluster 2024-09-17T08:42:52.077628+0000 mgr.y (mgr.14150) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:54.760 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:42:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:55 smithi078 bash[22670]: cluster 2024-09-17T08:42:54.078035+0000 mgr.y (mgr.14150) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:57.571 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:57 smithi078 bash[22670]: cluster 2024-09-17T08:42:56.078494+0000 mgr.y (mgr.14150) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/194332007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 msgr2=0x7f0ef80fdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 --2- 172.21.15.78:0/194332007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef80fdea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009880 tx=0x7f0ef402a5d0 comp rx=0 tx=0).stop 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/194332007 shutdown_connections 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 --2- 172.21.15.78:0/194332007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef80fdea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/194332007 >> 172.21.15.78:0/194332007 conn(0x7f0ef80f9610 msgr2=0x7f0ef80fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/194332007 shutdown_connections 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/194332007 wait complete. 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 Processor -- start 2024-09-17T08:42:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- start start 2024-09-17T08:42:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef8194150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8194690 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0efe523640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef8194150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0efe523640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef8194150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41714/0 (socket says 172.21.15.78:41714) 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0efe523640 1 -- 172.21.15.78:0/2686140863 learned_addr learned my addr 172.21.15.78:0/2686140863 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0efe523640 1 -- 172.21.15.78:0/2686140863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4009560 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0efe523640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef8194150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4004d60 tx=0x7f0ef4005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0eef7fe640 1 -- 172.21.15.78:0/2686140863 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ef40055b0 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef8194890 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0eef7fe640 1 -- 172.21.15.78:0/2686140863 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0ef4003a40 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0eef7fe640 1 -- 172.21.15.78:0/2686140863 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ef403c880 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef8194d30 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0eef7fe640 1 -- 172.21.15.78:0/2686140863 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0ef40035f0 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.706+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef80fdea0 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.710+0000 7f0eef7fe640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0ee4038710 0x7f0ee403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:42:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.710+0000 7f0eef7fe640 1 -- 172.21.15.78:0/2686140863 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0ef406c470 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.710+0000 7f0efdd22640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0ee4038710 0x7f0ee403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:42:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.710+0000 7f0efdd22640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0ee4038710 0x7f0ee403abd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80098c0 tx=0x7f0ee8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:42:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.714+0000 7f0eef7fe640 1 -- 172.21.15.78:0/2686140863 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0ef403a540 con 0x7f0ef80fdaa0 2024-09-17T08:42:57.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.886+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ef8104c50 con 0x7f0ee4038710 2024-09-17T08:42:57.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.890+0000 7f0eef7fe640 1 -- 172.21.15.78:0/2686140863 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0ef8104c50 con 0x7f0ee4038710 2024-09-17T08:42:57.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0ee4038710 msgr2=0x7f0ee403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:57.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0ee4038710 0x7f0ee403abd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80098c0 tx=0x7f0ee8006db0 comp rx=0 tx=0).stop 2024-09-17T08:42:57.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 msgr2=0x7f0ef8194150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:42:57.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef8194150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4004d60 tx=0x7f0ef4005060 comp rx=0 tx=0).stop 2024-09-17T08:42:57.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 shutdown_connections 2024-09-17T08:42:57.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0ee4038710 0x7f0ee403abd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:57.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 --2- 172.21.15.78:0/2686140863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef80fdaa0 0x7f0ef8194150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:42:57.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 >> 172.21.15.78:0/2686140863 conn(0x7f0ef80f9610 msgr2=0x7f0ef80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:42:57.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 shutdown_connections 2024-09-17T08:42:57.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:42:57.894+0000 7f0f00787640 1 -- 172.21.15.78:0/2686140863 wait complete. 2024-09-17T08:42:58.532 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2024-09-17T08:42:58.533 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:42:58.533 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2024-09-17T08:42:58.539 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:42:58.540 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:42:58.586 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2024-09-17T08:42:58.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch host add smithi136 2024-09-17T08:42:59.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:57.889508+0000 mgr.y (mgr.14150) 15 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:42:59.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:57.893158+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:57.894232+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:57.897169+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:57.898094+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: cephadm 2024-09-17T08:42:57.899535+0000 mgr.y (mgr.14150) 16 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: cephadm 2024-09-17T08:42:57.994845+0000 mgr.y (mgr.14150) 17 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: cephadm 2024-09-17T08:42:58.074768+0000 mgr.y (mgr.14150) 18 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: cluster 2024-09-17T08:42:58.078770+0000 mgr.y (mgr.14150) 19 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: cephadm 2024-09-17T08:42:58.155590+0000 mgr.y (mgr.14150) 20 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:58.310770+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:58.314180+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:42:59.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:42:58 smithi078 bash[22670]: audit 2024-09-17T08:42:58.317620+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:01 smithi078 bash[22670]: cluster 2024-09-17T08:43:00.079135+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:43:03.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:03 smithi078 bash[22670]: cluster 2024-09-17T08:43:02.079555+0000 mgr.y (mgr.14150) 22 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:05.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:05 smithi078 bash[22670]: cluster 2024-09-17T08:43:04.079927+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:06.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- 172.21.15.78:0/1683402600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 msgr2=0x7fefb8100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:06.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 --2- 172.21.15.78:0/1683402600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb8100d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009880 tx=0x7fefa802a670 comp rx=0 tx=0).stop 2024-09-17T08:43:06.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- 172.21.15.78:0/1683402600 shutdown_connections 2024-09-17T08:43:06.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 --2- 172.21.15.78:0/1683402600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb8100d10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:06.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- 172.21.15.78:0/1683402600 >> 172.21.15.78:0/1683402600 conn(0x7fefb80fa3b0 msgr2=0x7fefb80fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:06.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- 172.21.15.78:0/1683402600 shutdown_connections 2024-09-17T08:43:06.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- 172.21.15.78:0/1683402600 wait complete. 2024-09-17T08:43:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 Processor -- start 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- start start 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb81945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8194b30 con 0x7fefb8100930 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbd339640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb81945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbd339640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb81945f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53310/0 (socket says 172.21.15.78:53310) 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbd339640 1 -- 172.21.15.78:0/2960267845 learned_addr learned my addr 172.21.15.78:0/2960267845 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbd339640 1 -- 172.21.15.78:0/2960267845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8009560 con 0x7fefb8100930 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbd339640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb81945f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009230 tx=0x7fefa8004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefae7fc640 1 -- 172.21.15.78:0/2960267845 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefa80053a0 con 0x7fefb8100930 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefae7fc640 1 -- 172.21.15.78:0/2960267845 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fefa8005500 con 0x7fefb8100930 2024-09-17T08:43:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb8194d30 con 0x7fefb8100930 2024-09-17T08:43:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefae7fc640 1 -- 172.21.15.78:0/2960267845 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefa803c670 con 0x7fefb8100930 2024-09-17T08:43:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb8195150 con 0x7fefb8100930 2024-09-17T08:43:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.102+0000 7fefae7fc640 1 -- 172.21.15.78:0/2960267845 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fefa803c930 con 0x7fefb8100930 2024-09-17T08:43:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.106+0000 7fefae7fc640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fefa4038710 0x7fefa403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.106+0000 7fefae7fc640 1 -- 172.21.15.78:0/2960267845 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fefa806c480 con 0x7fefb8100930 2024-09-17T08:43:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.106+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb80687a0 con 0x7fefb8100930 2024-09-17T08:43:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.106+0000 7fefbcb38640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fefa4038710 0x7fefa403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.106+0000 7fefbcb38640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fefa4038710 0x7fefa403abd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098c0 tx=0x7fefb4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.110+0000 7fefae7fc640 1 -- 172.21.15.78:0/2960267845 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fefa8040080 con 0x7fefb8100930 2024-09-17T08:43:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:06.286+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}) v1 -- 0x7fefb8100d10 con 0x7fefa4038710 2024-09-17T08:43:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:07 smithi078 bash[22670]: cluster 2024-09-17T08:43:06.080224+0000 mgr.y (mgr.14150) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:07 smithi078 bash[22670]: audit 2024-09-17T08:43:06.289106+0000 mgr.y (mgr.14150) 25 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:08.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:08 smithi078 bash[22670]: cephadm 2024-09-17T08:43:07.290695+0000 mgr.y (mgr.14150) 26 : cephadm [INF] Deploying cephadm binary to smithi136 2024-09-17T08:43:09.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.514+0000 7fefae7fc640 1 -- 172.21.15.78:0/2960267845 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fefb8100d10 con 0x7fefa4038710 2024-09-17T08:43:09.517 INFO:teuthology.orchestra.run.smithi078.stdout:Added host 'smithi136' with addr '172.21.15.136' 2024-09-17T08:43:09.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fefa4038710 msgr2=0x7fefa403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fefa4038710 0x7fefa403abd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098c0 tx=0x7fefb4006db0 comp rx=0 tx=0).stop 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 msgr2=0x7fefb81945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb81945f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009230 tx=0x7fefa8004e50 comp rx=0 tx=0).stop 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 shutdown_connections 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fefa4038710 0x7fefa403abd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 --2- 172.21.15.78:0/2960267845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefb8100930 0x7fefb81945f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 >> 172.21.15.78:0/2960267845 conn(0x7fefb80fa3b0 msgr2=0x7fefb8106dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 shutdown_connections 2024-09-17T08:43:09.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:09.522+0000 7fefbf59d640 1 -- 172.21.15.78:0/2960267845 wait complete. 2024-09-17T08:43:09.536 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:09 smithi078 bash[22670]: cluster 2024-09-17T08:43:08.080571+0000 mgr.y (mgr.14150) 27 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:10.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T08:43:10.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:10 smithi078 bash[22670]: audit 2024-09-17T08:43:09.516594+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:10.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:10 smithi078 bash[22670]: cephadm 2024-09-17T08:43:09.517386+0000 mgr.y (mgr.14150) 28 : cephadm [INF] Added host smithi136 2024-09-17T08:43:10.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:10 smithi078 bash[22670]: audit 2024-09-17T08:43:09.518186+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:10.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:10 smithi078 bash[22670]: audit 2024-09-17T08:43:09.817852+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:10.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:10 smithi078 bash[22670]: cluster 2024-09-17T08:43:10.080989+0000 mgr.y (mgr.14150) 29 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:12.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:12 smithi078 bash[22670]: audit 2024-09-17T08:43:11.138725+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:12.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:12 smithi078 bash[22670]: audit 2024-09-17T08:43:11.976193+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:13 smithi078 bash[22670]: cluster 2024-09-17T08:43:12.081387+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:14.761 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:43:15.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:15 smithi078 bash[22670]: cluster 2024-09-17T08:43:14.081914+0000 mgr.y (mgr.14150) 31 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:17.394 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:17 smithi078 bash[22670]: cluster 2024-09-17T08:43:16.082281+0000 mgr.y (mgr.14150) 32 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 -- 172.21.15.78:0/1581016547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 msgr2=0x7f4de0105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 --2- 172.21.15.78:0/1581016547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0105b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009880 tx=0x7f4dd002a5d0 comp rx=0 tx=0).stop 2024-09-17T08:43:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 -- 172.21.15.78:0/1581016547 shutdown_connections 2024-09-17T08:43:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 --2- 172.21.15.78:0/1581016547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0105b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 -- 172.21.15.78:0/1581016547 >> 172.21.15.78:0/1581016547 conn(0x7f4de00fb850 msgr2=0x7f4de00fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 -- 172.21.15.78:0/1581016547 shutdown_connections 2024-09-17T08:43:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 -- 172.21.15.78:0/1581016547 wait complete. 2024-09-17T08:43:17.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 Processor -- start 2024-09-17T08:43:17.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.542+0000 7f4de589d640 1 -- start start 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de589d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de589d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0196c80 con 0x7f4de0105750 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4ddeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4ddeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0196740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41286/0 (socket says 172.21.15.78:41286) 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4ddeffd640 1 -- 172.21.15.78:0/3368853612 learned_addr learned my addr 172.21.15.78:0/3368853612 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4ddeffd640 1 -- 172.21.15.78:0/3368853612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0009560 con 0x7f4de0105750 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4ddeffd640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0196740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009230 tx=0x7f4dd0004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de489b640 1 -- 172.21.15.78:0/3368853612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd00053a0 con 0x7f4de0105750 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de489b640 1 -- 172.21.15.78:0/3368853612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4dd0005500 con 0x7f4de0105750 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de0196ee0 con 0x7f4de0105750 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de489b640 1 -- 172.21.15.78:0/3368853612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd003c670 con 0x7f4de0105750 2024-09-17T08:43:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de0197360 con 0x7f4de0105750 2024-09-17T08:43:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de489b640 1 -- 172.21.15.78:0/3368853612 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f4dd003c930 con 0x7f4de0105750 2024-09-17T08:43:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de0100e90 con 0x7f4de0105750 2024-09-17T08:43:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de489b640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4dcc038710 0x7f4dcc03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4de489b640 1 -- 172.21.15.78:0/3368853612 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4dd006c5b0 con 0x7f4de0105750 2024-09-17T08:43:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4dd7fff640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4dcc038710 0x7f4dcc03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.546+0000 7f4dd7fff640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4dcc038710 0x7f4dcc03abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80098c0 tx=0x7f4dc8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.554+0000 7f4de489b640 1 -- 172.21.15.78:0/3368853612 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4dd003a950 con 0x7f4de0105750 2024-09-17T08:43:17.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.730+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4de0197b10 con 0x7f4dcc038710 2024-09-17T08:43:17.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.730+0000 7f4de489b640 1 -- 172.21.15.78:0/3368853612 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f4de0197b10 con 0x7f4dcc038710 2024-09-17T08:43:17.733 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:43:17.733 INFO:teuthology.orchestra.run.smithi078.stdout:[{"addr": "172.21.15.78", "hostname": "smithi078", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4dcc038710 msgr2=0x7f4dcc03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4dcc038710 0x7f4dcc03abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80098c0 tx=0x7f4dc8006db0 comp rx=0 tx=0).stop 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 msgr2=0x7f4de0196740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0196740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009230 tx=0x7f4dd0004e50 comp rx=0 tx=0).stop 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 shutdown_connections 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4dcc038710 0x7f4dcc03abd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 --2- 172.21.15.78:0/3368853612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4de0105750 0x7f4de0196740 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 >> 172.21.15.78:0/3368853612 conn(0x7f4de00fb850 msgr2=0x7f4de01014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 shutdown_connections 2024-09-17T08:43:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:17.734+0000 7f4de589d640 1 -- 172.21.15.78:0/3368853612 wait complete. 2024-09-17T08:43:18.333 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T08:43:18.333 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T08:43:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.506641+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.511941+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.516833+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.523994+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.525016+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.526144+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.527028+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: cephadm 2024-09-17T08:43:17.528265+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: cephadm 2024-09-17T08:43:17.632564+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: cephadm 2024-09-17T08:43:17.732637+0000 mgr.y (mgr.14150) 35 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.733252+0000 mgr.y (mgr.14150) 36 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:43:18.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: cephadm 2024-09-17T08:43:17.832572+0000 mgr.y (mgr.14150) 37 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:43:18.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.936740+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:18.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.944013+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:18.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: audit 2024-09-17T08:43:17.949528+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:18.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:18 smithi078 bash[22670]: cluster 2024-09-17T08:43:18.082641+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:21.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:21 smithi078 bash[22670]: cluster 2024-09-17T08:43:20.083049+0000 mgr.y (mgr.14150) 39 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:43:23.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:23 smithi078 bash[22670]: cluster 2024-09-17T08:43:22.083491+0000 mgr.y (mgr.14150) 40 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:25 smithi078 bash[22670]: cluster 2024-09-17T08:43:24.083913+0000 mgr.y (mgr.14150) 41 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:25.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/1440011754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 msgr2=0x7fc89c105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:25.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 --2- 172.21.15.78:0/1440011754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c105c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009880 tx=0x7fc88c02a5d0 comp rx=0 tx=0).stop 2024-09-17T08:43:25.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/1440011754 shutdown_connections 2024-09-17T08:43:25.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 --2- 172.21.15.78:0/1440011754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c105c10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:25.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/1440011754 >> 172.21.15.78:0/1440011754 conn(0x7fc89c076500 msgr2=0x7fc89c076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:25.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/1440011754 shutdown_connections 2024-09-17T08:43:25.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/1440011754 wait complete. 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 Processor -- start 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- start start 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c1944e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c194a20 con 0x7fc89c105830 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc89bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c1944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc89bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c1944e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35466/0 (socket says 172.21.15.78:35466) 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc89bfff640 1 -- 172.21.15.78:0/73328802 learned_addr learned my addr 172.21.15.78:0/73328802 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc89bfff640 1 -- 172.21.15.78:0/73328802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c009560 con 0x7fc89c105830 2024-09-17T08:43:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc89bfff640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c1944e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009230 tx=0x7fc88c004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:25.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8997fa640 1 -- 172.21.15.78:0/73328802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc88c0053a0 con 0x7fc89c105830 2024-09-17T08:43:25.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c194c80 con 0x7fc89c105830 2024-09-17T08:43:25.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8997fa640 1 -- 172.21.15.78:0/73328802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fc88c005500 con 0x7fc89c105830 2024-09-17T08:43:25.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8997fa640 1 -- 172.21.15.78:0/73328802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc88c03c670 con 0x7fc89c105830 2024-09-17T08:43:25.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c195100 con 0x7fc89c105830 2024-09-17T08:43:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8997fa640 1 -- 172.21.15.78:0/73328802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fc88c0035f0 con 0x7fc89c105830 2024-09-17T08:43:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c100ed0 con 0x7fc89c105830 2024-09-17T08:43:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8997fa640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fc884038710 0x7fc88403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc8997fa640 1 -- 172.21.15.78:0/73328802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc88c06c450 con 0x7fc89c105830 2024-09-17T08:43:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.933+0000 7fc89b7fe640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fc884038710 0x7fc88403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.937+0000 7fc89b7fe640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fc884038710 0x7fc88403abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc8900098c0 tx=0x7fc890006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:25.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:25.941+0000 7fc8997fa640 1 -- 172.21.15.78:0/73328802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc88c03a930 con 0x7fc89c105830 2024-09-17T08:43:26.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.117+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc89c195840 con 0x7fc89c105830 2024-09-17T08:43:26.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.145+0000 7fc8997fa640 1 -- 172.21.15.78:0/73328802 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc88c035090 con 0x7fc89c105830 2024-09-17T08:43:26.149 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fc884038710 msgr2=0x7fc88403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fc884038710 0x7fc88403abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc8900098c0 tx=0x7fc890006db0 comp rx=0 tx=0).stop 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 msgr2=0x7fc89c1944e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c1944e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009230 tx=0x7fc88c004e50 comp rx=0 tx=0).stop 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 shutdown_connections 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fc884038710 0x7fc88403abd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 --2- 172.21.15.78:0/73328802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c105830 0x7fc89c1944e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 >> 172.21.15.78:0/73328802 conn(0x7fc89c076500 msgr2=0x7fc89c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 shutdown_connections 2024-09-17T08:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:26.149+0000 7fc8a25c5640 1 -- 172.21.15.78:0/73328802 wait complete. 2024-09-17T08:43:26.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:26 smithi078 bash[22670]: audit 2024-09-17T08:43:26.118901+0000 mon.a (mon.0) 123 : audit [INF] from='client.? 172.21.15.78:0/73328802' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T08:43:26.796 INFO:tasks.cephadm:Adding mon.a on smithi078 2024-09-17T08:43:26.797 INFO:tasks.cephadm:Adding mon.c on smithi078 2024-09-17T08:43:26.797 INFO:tasks.cephadm:Adding mon.b on smithi136 2024-09-17T08:43:26.797 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b' 2024-09-17T08:43:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:27 smithi078 bash[22670]: cluster 2024-09-17T08:43:26.084367+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:27 smithi078 bash[22670]: audit 2024-09-17T08:43:26.149205+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.78:0/73328802' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T08:43:27.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:27 smithi078 bash[22670]: cluster 2024-09-17T08:43:26.149262+0000 mon.a (mon.0) 125 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:27.965 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:29 smithi078 bash[22670]: cluster 2024-09-17T08:43:28.084808+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:30.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 -- 172.21.15.136:0/2267048425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8780100930 msgr2=0x7f8780100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:30.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 --2- 172.21.15.136:0/2267048425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8780100930 0x7f8780100d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8770009880 tx=0x7f877002a5d0 comp rx=0 tx=0).stop 2024-09-17T08:43:30.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 -- 172.21.15.136:0/2267048425 shutdown_connections 2024-09-17T08:43:30.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 --2- 172.21.15.136:0/2267048425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8780100930 0x7f8780100d10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:30.514 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 -- 172.21.15.136:0/2267048425 >> 172.21.15.136:0/2267048425 conn(0x7f87800fa440 msgr2=0x7f87800fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:30.514 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 -- 172.21.15.136:0/2267048425 shutdown_connections 2024-09-17T08:43:30.514 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 -- 172.21.15.136:0/2267048425 wait complete. 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 Processor -- start 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 -- start start 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.510+0000 7f87887af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878019c860 0x7f878019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87887af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878019d180 con 0x7f878019c860 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f878654b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878019c860 0x7f878019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f878654b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878019c860 0x7f878019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.136:54886/0 (socket says 172.21.15.136:54886) 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f878654b640 1 -- 172.21.15.136:0/2250164293 learned_addr learned my addr 172.21.15.136:0/2250164293 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:43:30.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f878654b640 1 -- 172.21.15.136:0/2250164293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770009560 con 0x7f878019c860 2024-09-17T08:43:30.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f878654b640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878019c860 0x7f878019cc40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8770000c00 tx=0x7f8770005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:30.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87777fe640 1 -- 172.21.15.136:0/2250164293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8770005410 con 0x7f878019c860 2024-09-17T08:43:30.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87777fe640 1 -- 172.21.15.136:0/2250164293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f8770005570 con 0x7f878019c860 2024-09-17T08:43:30.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878019d380 con 0x7f878019c860 2024-09-17T08:43:30.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87777fe640 1 -- 172.21.15.136:0/2250164293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f877003c600 con 0x7f878019c860 2024-09-17T08:43:30.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8780196a90 con 0x7f878019c860 2024-09-17T08:43:30.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87777fe640 1 -- 172.21.15.136:0/2250164293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f87700035f0 con 0x7f878019c860 2024-09-17T08:43:30.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87800687a0 con 0x7f878019c860 2024-09-17T08:43:30.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87777fe640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f876c038350 0x7f876c03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:30.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f87777fe640 1 -- 172.21.15.136:0/2250164293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f877006bb50 con 0x7f878019c860 2024-09-17T08:43:30.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.514+0000 7f8785d4a640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f876c038350 0x7f876c03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:30.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.518+0000 7f8785d4a640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f876c038350 0x7f876c03a810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f877c0098c0 tx=0x7f877c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:30.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.530+0000 7f87777fe640 1 -- 172.21.15.136:0/2250164293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f877003a360 con 0x7f878019c860 2024-09-17T08:43:30.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.710+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f8780197df0 con 0x7f876c038350 2024-09-17T08:43:30.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87777fe640 1 -- 172.21.15.136:0/2250164293 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8780197df0 con 0x7f876c038350 2024-09-17T08:43:30.728 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mon update... 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f876c038350 msgr2=0x7f876c03a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f876c038350 0x7f876c03a810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f877c0098c0 tx=0x7f877c006db0 comp rx=0 tx=0).stop 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878019c860 msgr2=0x7f878019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878019c860 0x7f878019cc40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8770000c00 tx=0x7f8770005060 comp rx=0 tx=0).stop 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 shutdown_connections 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f876c038350 0x7f876c03a810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 --2- 172.21.15.136:0/2250164293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878019c860 0x7f878019cc40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 >> 172.21.15.136:0/2250164293 conn(0x7f87800fa440 msgr2=0x7f87800fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 shutdown_connections 2024-09-17T08:43:30.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:30.726+0000 7f87887af640 1 -- 172.21.15.136:0/2250164293 wait complete. 2024-09-17T08:43:31.390 DEBUG:teuthology.orchestra.run.smithi078:mon.c> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.c.service 2024-09-17T08:43:31.392 DEBUG:teuthology.orchestra.run.smithi136:mon.b> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.b.service 2024-09-17T08:43:31.395 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T08:43:31.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T08:43:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: cluster 2024-09-17T08:43:30.085261+0000 mgr.y (mgr.14150) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:31.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: audit 2024-09-17T08:43:30.727492+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:31.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: audit 2024-09-17T08:43:30.728992+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:31.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: audit 2024-09-17T08:43:30.732510+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:31.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: audit 2024-09-17T08:43:30.734443+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:31.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: audit 2024-09-17T08:43:30.744280+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:31.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: audit 2024-09-17T08:43:30.747961+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:31.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:31 smithi078 bash[22670]: audit 2024-09-17T08:43:30.749624+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:32.600 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:32 smithi078 bash[22670]: audit 2024-09-17T08:43:30.716955+0000 mgr.y (mgr.14150) 45 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:32 smithi078 bash[22670]: cephadm 2024-09-17T08:43:30.722507+0000 mgr.y (mgr.14150) 46 : cephadm [INF] Saving service mon spec with placement smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b;count:3 2024-09-17T08:43:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:32 smithi078 bash[22670]: cephadm 2024-09-17T08:43:30.751586+0000 mgr.y (mgr.14150) 47 : cephadm [INF] Deploying daemon mon.b on smithi136 2024-09-17T08:43:33.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:33 smithi078 bash[22670]: cluster 2024-09-17T08:43:32.085754+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:35 smithi078 bash[22670]: cluster 2024-09-17T08:43:34.086169+0000 mgr.y (mgr.14150) 49 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:36.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 -- 172.21.15.136:0/875831803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 msgr2=0x7f4d44100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:36.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 --2- 172.21.15.136:0/875831803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d44100d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009880 tx=0x7f4d3c02a670 comp rx=0 tx=0).stop 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 -- 172.21.15.136:0/875831803 shutdown_connections 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 --2- 172.21.15.136:0/875831803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d44100d10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 -- 172.21.15.136:0/875831803 >> 172.21.15.136:0/875831803 conn(0x7f4d440fa3b0 msgr2=0x7f4d440fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 -- 172.21.15.136:0/875831803 shutdown_connections 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 -- 172.21.15.136:0/875831803 wait complete. 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 Processor -- start 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 -- start start 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d440fe590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:36.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d49d36640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d441004a0 con 0x7f4d44100930 2024-09-17T08:43:36.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d440fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:36.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d440fe590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.136:49256/0 (socket says 172.21.15.136:49256) 2024-09-17T08:43:36.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d437fe640 1 -- 172.21.15.136:0/4019236158 learned_addr learned my addr 172.21.15.136:0/4019236158 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:43:36.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d437fe640 1 -- 172.21.15.136:0/4019236158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009560 con 0x7f4d44100930 2024-09-17T08:43:36.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.554+0000 7f4d437fe640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d440fe590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009230 tx=0x7f4d3c005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:36.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d40ff9640 1 -- 172.21.15.136:0/4019236158 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d3c0055b0 con 0x7f4d44100930 2024-09-17T08:43:36.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d440fead0 con 0x7f4d44100930 2024-09-17T08:43:36.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d40ff9640 1 -- 172.21.15.136:0/4019236158 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4d3c003a40 con 0x7f4d44100930 2024-09-17T08:43:36.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d40ff9640 1 -- 172.21.15.136:0/4019236158 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d3c03c760 con 0x7f4d44100930 2024-09-17T08:43:36.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d440fee30 con 0x7f4d44100930 2024-09-17T08:43:36.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d440fcca0 con 0x7f4d44100930 2024-09-17T08:43:36.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d40ff9640 1 -- 172.21.15.136:0/4019236158 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f4d3c003bb0 con 0x7f4d44100930 2024-09-17T08:43:36.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d40ff9640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4d30038710 0x7f4d3003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:36.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d40ff9640 1 -- 172.21.15.136:0/4019236158 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4d3c06c390 con 0x7f4d44100930 2024-09-17T08:43:36.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d42ffd640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4d30038710 0x7f4d3003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:36.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.558+0000 7f4d42ffd640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4d30038710 0x7f4d3003abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0098c0 tx=0x7f4d2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:36.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.570+0000 7f4d40ff9640 1 -- 172.21.15.136:0/4019236158 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4d3c04d940 con 0x7f4d44100930 2024-09-17T08:43:36.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.830+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4d44105eb0 con 0x7f4d44100930 2024-09-17T08:43:36.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.830+0000 7f4d40ff9640 1 -- 172.21.15.136:0/4019236158 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f4d3c035090 con 0x7f4d44100930 2024-09-17T08:43:36.833 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-17T08:43:36.833 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-17T08:43:36.833 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"7121dba6-74d0-11ef-bceb-c7b262605968","modified":"2024-09-17T08:41:24.274037Z","created":"2024-09-17T08:41:24.274037Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4d30038710 msgr2=0x7f4d3003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4d30038710 0x7f4d3003abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0098c0 tx=0x7f4d2c006db0 comp rx=0 tx=0).stop 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 msgr2=0x7f4d440fe590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d440fe590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009230 tx=0x7f4d3c005060 comp rx=0 tx=0).stop 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 shutdown_connections 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f4d30038710 0x7f4d3003abd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 --2- 172.21.15.136:0/4019236158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d44100930 0x7f4d440fe590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 >> 172.21.15.136:0/4019236158 conn(0x7f4d440fa3b0 msgr2=0x7f4d44106d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:36.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 shutdown_connections 2024-09-17T08:43:36.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:36.834+0000 7f4d49d36640 1 -- 172.21.15.136:0/4019236158 wait complete. 2024-09-17T08:43:37.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:36 smithi136 systemd[1]: Started Ceph mon.b for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:43:37.563 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:37.563 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:37 smithi078 bash[22670]: cluster 2024-09-17T08:43:36.086593+0000 mgr.y (mgr.14150) 50 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:37.563 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:37 smithi078 bash[22670]: audit 2024-09-17T08:43:36.833335+0000 mon.a (mon.0) 133 : audit [DBG] from='client.? 172.21.15.136:0/4019236158' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T08:43:37.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:37 smithi078 bash[22670]: audit 2024-09-17T08:43:37.013025+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:37.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:37 smithi078 bash[22670]: audit 2024-09-17T08:43:37.018936+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:37.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:37 smithi078 bash[22670]: audit 2024-09-17T08:43:37.025284+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:37.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:37 smithi078 bash[22670]: audit 2024-09-17T08:43:37.026444+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:37.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:37 smithi078 bash[22670]: audit 2024-09-17T08:43:37.028092+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:38.445 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:38 smithi078 bash[22670]: cephadm 2024-09-17T08:43:37.029861+0000 mgr.y (mgr.14150) 51 : cephadm [INF] Deploying daemon mon.c on smithi078 2024-09-17T08:43:38.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.582+0000 7f6ae6fb7b00 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.582+0000 7f6ae6fb7b00 0 ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 7 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.582+0000 7f6ae6fb7b00 0 pidfile_write: ignore empty --pid-file 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.582+0000 7f6ae6fb7b00 0 load: jerasure load: lrc 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: RocksDB version: 7.9.2 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Git sha 0 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: DB SUMMARY 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: DB Session ID: X1KRA82VUMJF3NJAKPZG 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: CURRENT file: CURRENT 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: IDENTITY file: IDENTITY 2024-09-17T08:43:38.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.error_if_exists: 0 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.create_if_missing: 0 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.paranoid_checks: 1 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.env: 0x55e0e0953bc0 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.fs: PosixFileSystem 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.info_log: 0x55e0e18a0be0 2024-09-17T08:43:38.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.statistics: (nil) 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.use_fsync: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_log_file_size: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.allow_fallocate: 1 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.use_direct_reads: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T08:43:38.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.create_missing_column_families: 0 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.db_log_dir: 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.wal_dir: 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.advise_random_on_open: 1 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.write_buffer_manager: 0x55e0e18ae320 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T08:43:38.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.rate_limiter: (nil) 2024-09-17T08:43:38.621 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T08:43:38.621 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.unordered_write: 0 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.row_cache: None 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.wal_filter: None 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T08:43:38.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.two_write_queues: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.manual_wal_flush: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.wal_compression: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.atomic_flush: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.log_readahead_size: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T08:43:38.624 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_background_jobs: 2 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_background_compactions: -1 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_subcompactions: 1 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_total_wal_size: 0 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T08:43:38.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_open_files: -1 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bytes_per_sync: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_background_flushes: -1 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Compression algorithms supported: 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kZSTD supported: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kXpressCompression supported: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kBZip2Compression supported: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kLZ4Compression supported: 1 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kZlibCompression supported: 1 2024-09-17T08:43:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: kSnappyCompression supported: 1 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.merge_operator: 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_filter: None 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_filter_factory: None 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T08:43:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e0e18a07e0) 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cache_index_and_filter_blocks: 1 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: pin_top_level_index_and_filter: 1 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: index_type: 0 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: data_block_index_type: 0 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: index_shortening: 1 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: data_block_hash_table_util_ratio: 0.750000 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: checksum: 4 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: no_block_cache: 0 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_cache: 0x55e0e18971f0 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_cache_name: BinnedLRUCache 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_cache_options: 2024-09-17T08:43:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: capacity : 536870912 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: num_shard_bits : 4 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: strict_capacity_limit : 0 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: high_pri_pool_ratio: 0.000 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_cache_compressed: (nil) 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: persistent_cache: (nil) 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_size: 4096 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_size_deviation: 10 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_restart_interval: 16 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: index_block_restart_interval: 1 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: metadata_block_size: 4096 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: partition_filters: 0 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: use_delta_encoding: 1 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: filter_policy: bloomfilter 2024-09-17T08:43:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: whole_key_filtering: 1 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: verify_compression: 0 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: read_amp_bytes_per_bit: 0 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: format_version: 5 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: enable_index_compression: 1 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: block_align: 0 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: max_auto_readahead_size: 262144 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: prepopulate_block_cache: 0 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: initial_auto_readahead_size: 8192 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: num_file_reads_for_auto_readahead: 2 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression: NoCompression 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-17T08:43:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.num_levels: 7 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:43:38.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.level: 32767 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.enabled: false 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T08:43:38.632 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T08:43:38.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.arena_block_size: 1048576 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T08:43:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.inplace_update_support: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.bloom_locality: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.max_successive_merges: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.force_consistency_checks: 1 2024-09-17T08:43:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.ttl: 2592000 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.enable_blob_files: false 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.min_blob_size: 0 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.blob_file_size: 268435456 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-17T08:43:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c743d03c-9deb-4d59-839a-d5cbac441108 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562618590799, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562618591288, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726562618, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c743d03c-9deb-4d59-839a-d5cbac441108", "db_session_id": "X1KRA82VUMJF3NJAKPZG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562618591423, "job": 1, "event": "recovery_finished"} 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.586+0000 7f6ae6fb7b00 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6ae6fb7b00 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6ae6fb7b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e0e18c0e00 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6ae6fb7b00 4 rocksdb: DB pointer 0x55e0e19b8000 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6adcd82640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T08:43:38.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6adcd82640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: ** DB Stats ** 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: ** Compaction Stats [default] ** 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:38.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: ** Compaction Stats [default] ** 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: AddFile(Keys): cumulative 0, interval 0 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Interval compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:43:38.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Block cache BinnedLRUCache@0x55e0e18971f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: ** File Read Latency Histogram By Level [default] ** 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6ae6fb7b00 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6ae6fb7b00 0 using public_addr v2:172.21.15.136:0/0 -> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6ae6fb7b00 0 starting mon.b rank -1 at public addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] at bind addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.590+0000 7f6ae6fb7b00 1 mon.b@-1(???) e0 preinit fsid 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 0 mon.b@-1(synchronizing).mds e1 new map 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 0 mon.b@-1(synchronizing).mds e1 print_map 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: e1 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: legacy client fscid: -1 2024-09-17T08:43:38.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: No filesystems configured 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.610+0000 7f6adfd88640 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.614+0000 7f6adfd88640 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.614+0000 7f6adfd88640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.614+0000 7f6adfd88640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.614+0000 7f6adfd88640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:42:56.078494+0000 mgr.y (mgr.14150) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:57.889508+0000 mgr.y (mgr.14150) 15 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:38.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:57.893158+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:57.894232+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:57.897169+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:57.898094+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:42:57.899535+0000 mgr.y (mgr.14150) 16 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:42:57.994845+0000 mgr.y (mgr.14150) 17 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:42:58.074768+0000 mgr.y (mgr.14150) 18 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:42:58.078770+0000 mgr.y (mgr.14150) 19 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:42:58.155590+0000 mgr.y (mgr.14150) 20 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:58.310770+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:58.314180+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:42:58.317620+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:00.079135+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:02.079555+0000 mgr.y (mgr.14150) 22 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:04.079927+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:06.080224+0000 mgr.y (mgr.14150) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:06.289106+0000 mgr.y (mgr.14150) 25 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:07.290695+0000 mgr.y (mgr.14150) 26 : cephadm [INF] Deploying cephadm binary to smithi136 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:08.080571+0000 mgr.y (mgr.14150) 27 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:09.516594+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:09.517386+0000 mgr.y (mgr.14150) 28 : cephadm [INF] Added host smithi136 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:09.518186+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:09.817852+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:10.080989+0000 mgr.y (mgr.14150) 29 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:11.138725+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:11.976193+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:12.081387+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:14.081914+0000 mgr.y (mgr.14150) 31 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:16.082281+0000 mgr.y (mgr.14150) 32 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.506641+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.511941+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.516833+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.523994+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.525016+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.526144+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.527028+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:17.528265+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:17.632564+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:17.732637+0000 mgr.y (mgr.14150) 35 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.733252+0000 mgr.y (mgr.14150) 36 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:43:38.644 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:17.832572+0000 mgr.y (mgr.14150) 37 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.936740+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.944013+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:17.949528+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:18.082641+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:20.083049+0000 mgr.y (mgr.14150) 39 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:22.083491+0000 mgr.y (mgr.14150) 40 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:24.083913+0000 mgr.y (mgr.14150) 41 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:26.118901+0000 mon.a (mon.0) 123 : audit [INF] from='client.? 172.21.15.78:0/73328802' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:26.084367+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:26.149205+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.78:0/73328802' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:26.149262+0000 mon.a (mon.0) 125 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:28.084808+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:30.085261+0000 mgr.y (mgr.14150) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.727492+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.728992+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.732510+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.734443+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.744280+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.747961+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.749624+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:30.716955+0000 mgr.y (mgr.14150) 45 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:30.722507+0000 mgr.y (mgr.14150) 46 : cephadm [INF] Saving service mon spec with placement smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b;count:3 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:30.751586+0000 mgr.y (mgr.14150) 47 : cephadm [INF] Deploying daemon mon.b on smithi136 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:32.085754+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:34.086169+0000 mgr.y (mgr.14150) 49 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.646 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cluster 2024-09-17T08:43:36.086593+0000 mgr.y (mgr.14150) 50 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:36.833335+0000 mon.a (mon.0) 133 : audit [DBG] from='client.? 172.21.15.136:0/4019236158' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:37.013025+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:37.018936+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:37.025284+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:37.026444+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: audit 2024-09-17T08:43:37.028092+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: cephadm 2024-09-17T08:43:37.029861+0000 mgr.y (mgr.14150) 51 : cephadm [INF] Deploying daemon mon.c on smithi078 2024-09-17T08:43:38.647 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:38 smithi136 bash[24812]: debug 2024-09-17T08:43:38.614+0000 7f6adfd88640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-17T08:43:38.982 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T08:43:38.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T08:43:40.987 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:40 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:40.987 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:43:40 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:41.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:41 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:41.322 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:40 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:41.323 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:40 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:41.323 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:40 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:41.323 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:41 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:41.323 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:41 smithi078 systemd[1]: Started Ceph mon.c for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:43:41.323 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:43:41 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:43:42.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.305+0000 7f419ee20b00 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-17T08:43:42.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.305+0000 7f419ee20b00 0 ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 7 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.305+0000 7f419ee20b00 0 pidfile_write: ignore empty --pid-file 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 0 load: jerasure load: lrc 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: RocksDB version: 7.9.2 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Git sha 0 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: DB SUMMARY 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: DB Session ID: 2R69ITV23AZZV3XOZV1Z 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: CURRENT file: CURRENT 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: IDENTITY file: IDENTITY 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-17T08:43:42.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.error_if_exists: 0 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.create_if_missing: 0 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.paranoid_checks: 1 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.env: 0x55a6e25e0bc0 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.fs: PosixFileSystem 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.info_log: 0x55a6e3f7cbe0 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-17T08:43:42.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.statistics: (nil) 2024-09-17T08:43:42.608 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.use_fsync: 0 2024-09-17T08:43:42.608 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_log_file_size: 0 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.allow_fallocate: 1 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.use_direct_reads: 0 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T08:43:42.609 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.create_missing_column_families: 0 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.db_log_dir: 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.wal_dir: 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.advise_random_on_open: 1 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.write_buffer_manager: 0x55a6e3f8a320 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T08:43:42.610 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.rate_limiter: (nil) 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.unordered_write: 0 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T08:43:42.611 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.row_cache: None 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.wal_filter: None 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.two_write_queues: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.manual_wal_flush: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.wal_compression: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.atomic_flush: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.log_readahead_size: 0 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T08:43:42.612 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_background_jobs: 2 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_background_compactions: -1 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_subcompactions: 1 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_total_wal_size: 0 2024-09-17T08:43:42.613 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_open_files: -1 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bytes_per_sync: 0 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_background_flushes: -1 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Compression algorithms supported: 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kZSTD supported: 0 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kXpressCompression supported: 0 2024-09-17T08:43:42.614 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kBZip2Compression supported: 0 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kLZ4Compression supported: 1 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kZlibCompression supported: 1 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: kSnappyCompression supported: 1 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.merge_operator: 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_filter: None 2024-09-17T08:43:42.615 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_filter_factory: None 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a6e3f7c7e0) 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cache_index_and_filter_blocks: 1 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: pin_top_level_index_and_filter: 1 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: index_type: 0 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: data_block_index_type: 0 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: index_shortening: 1 2024-09-17T08:43:42.616 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: data_block_hash_table_util_ratio: 0.750000 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: checksum: 4 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: no_block_cache: 0 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_cache: 0x55a6e3f731f0 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_cache_name: BinnedLRUCache 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_cache_options: 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: capacity : 536870912 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: num_shard_bits : 4 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: strict_capacity_limit : 0 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: high_pri_pool_ratio: 0.000 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_cache_compressed: (nil) 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: persistent_cache: (nil) 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_size: 4096 2024-09-17T08:43:42.617 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_size_deviation: 10 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_restart_interval: 16 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: index_block_restart_interval: 1 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: metadata_block_size: 4096 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: partition_filters: 0 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: use_delta_encoding: 1 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: filter_policy: bloomfilter 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: whole_key_filtering: 1 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: verify_compression: 0 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: read_amp_bytes_per_bit: 0 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: format_version: 5 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: enable_index_compression: 1 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: block_align: 0 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: max_auto_readahead_size: 262144 2024-09-17T08:43:42.618 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: prepopulate_block_cache: 0 2024-09-17T08:43:42.619 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: initial_auto_readahead_size: 8192 2024-09-17T08:43:42.619 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: num_file_reads_for_auto_readahead: 2 2024-09-17T08:43:42.619 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-17T08:43:42.619 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-17T08:43:42.621 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression: NoCompression 2024-09-17T08:43:42.621 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-17T08:43:42.621 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-17T08:43:42.621 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T08:43:42.621 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.num_levels: 7 2024-09-17T08:43:42.621 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T08:43:42.621 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.level: 32767 2024-09-17T08:43:42.622 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.enabled: false 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T08:43:42.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.arena_block_size: 1048576 2024-09-17T08:43:42.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T08:43:42.625 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.inplace_update_support: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.bloom_locality: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.max_successive_merges: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.force_consistency_checks: 1 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.ttl: 2592000 2024-09-17T08:43:42.626 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.enable_blob_files: false 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.min_blob_size: 0 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.blob_file_size: 268435456 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T08:43:42.627 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.309+0000 7f419ee20b00 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 16b96634-ad69-4210-9f84-7eb9ed3a49ad 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562622314618, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562622315105, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726562622, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "16b96634-ad69-4210-9f84-7eb9ed3a49ad", "db_session_id": "2R69ITV23AZZV3XOZV1Z", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726562622315224, "job": 1, "event": "recovery_finished"} 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a6e3f9ce00 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 4 rocksdb: DB pointer 0x55a6e4094000 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f4194beb640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f4194beb640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T08:43:42.628 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: ** DB Stats ** 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: ** Compaction Stats [default] ** 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:42.629 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: ** Compaction Stats [default] ** 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: AddFile(Keys): cumulative 0, interval 0 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:43:42.630 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Interval compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Block cache BinnedLRUCache@0x55a6e3f731f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: ** File Read Latency Histogram By Level [default] ** 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 0 using public_addrv [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.313+0000 7f419ee20b00 0 starting mon.c rank -1 at public addrs [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] at bind addrs [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.317+0000 7f419ee20b00 1 mon.c@-1(???) e0 preinit fsid 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 0 mon.c@-1(synchronizing).mds e1 new map 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: e1 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T08:43:42.631 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: legacy client fscid: -1 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: No filesystems configured 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T08:43:42.632 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:42:56.078494+0000 mgr.y (mgr.14150) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:57.889508+0000 mgr.y (mgr.14150) 15 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:57.893158+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:57.894232+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:57.897169+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:57.898094+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:42:57.899535+0000 mgr.y (mgr.14150) 16 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:42:57.994845+0000 mgr.y (mgr.14150) 17 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:42:58.074768+0000 mgr.y (mgr.14150) 18 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:42:58.078770+0000 mgr.y (mgr.14150) 19 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:42:58.155590+0000 mgr.y (mgr.14150) 20 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:58.310770+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:58.314180+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.633 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:42:58.317620+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:00.079135+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:02.079555+0000 mgr.y (mgr.14150) 22 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:04.079927+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:06.080224+0000 mgr.y (mgr.14150) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:06.289106+0000 mgr.y (mgr.14150) 25 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:07.290695+0000 mgr.y (mgr.14150) 26 : cephadm [INF] Deploying cephadm binary to smithi136 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:08.080571+0000 mgr.y (mgr.14150) 27 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:09.516594+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:09.517386+0000 mgr.y (mgr.14150) 28 : cephadm [INF] Added host smithi136 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:09.518186+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:09.817852+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:10.080989+0000 mgr.y (mgr.14150) 29 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:11.138725+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.634 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:11.976193+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:12.081387+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:14.081914+0000 mgr.y (mgr.14150) 31 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:16.082281+0000 mgr.y (mgr.14150) 32 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.506641+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.511941+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.516833+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.523994+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.525016+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.526144+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.527028+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:17.528265+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:43:42.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:17.632564+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:17.732637+0000 mgr.y (mgr.14150) 35 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.733252+0000 mgr.y (mgr.14150) 36 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:17.832572+0000 mgr.y (mgr.14150) 37 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.936740+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.944013+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:17.949528+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:18.082641+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:20.083049+0000 mgr.y (mgr.14150) 39 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:22.083491+0000 mgr.y (mgr.14150) 40 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:24.083913+0000 mgr.y (mgr.14150) 41 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:26.118901+0000 mon.a (mon.0) 123 : audit [INF] from='client.? 172.21.15.78:0/73328802' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:26.084367+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:26.149205+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.78:0/73328802' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:26.149262+0000 mon.a (mon.0) 125 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:28.084808+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:30.085261+0000 mgr.y (mgr.14150) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.727492+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.728992+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.732510+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.734443+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.744280+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.747961+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.749624+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:30.716955+0000 mgr.y (mgr.14150) 45 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:30.722507+0000 mgr.y (mgr.14150) 46 : cephadm [INF] Saving service mon spec with placement smithi078:172.21.15.78=a;smithi078:[v2:172.21.15.78:3301,v1:172.21.15.78:6790]=c;smithi136:172.21.15.136=b;count:3 2024-09-17T08:43:42.637 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:30.751586+0000 mgr.y (mgr.14150) 47 : cephadm [INF] Deploying daemon mon.b on smithi136 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:32.085754+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:34.086169+0000 mgr.y (mgr.14150) 49 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cluster 2024-09-17T08:43:36.086593+0000 mgr.y (mgr.14150) 50 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:36.833335+0000 mon.a (mon.0) 133 : audit [DBG] from='client.? 172.21.15.136:0/4019236158' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:37.013025+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:37.018936+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:37.025284+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:37.026444+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: audit 2024-09-17T08:43:37.028092+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: cephadm 2024-09-17T08:43:37.029861+0000 mgr.y (mgr.14150) 51 : cephadm [INF] Deploying daemon mon.c on smithi078 2024-09-17T08:43:42.638 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:42 smithi078 bash[32124]: debug 2024-09-17T08:43:42.333+0000 7f4197bf1640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-17T08:43:42.639 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:43:44.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:38.624295+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:38.626670+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:43:44.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:38.626793+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:38.626940+0000 mon.a (mon.0) 142 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:44.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:39.624919+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:40.087232+0000 mgr.y (mgr.14150) 53 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:40.624765+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:40.627631+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:41.624959+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:42.087692+0000 mgr.y (mgr.14150) 54 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:42.340847+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:42.624857+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:43.341674+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:43.625293+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:43.648986+0000 mon.a (mon.0) 150 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:43.657006+0000 mon.a (mon.0) 151 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:43.675474+0000 mon.a (mon.0) 152 : cluster [DBG] fsmap 2024-09-17T08:43:44.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:43.675527+0000 mon.a (mon.0) 153 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:44.046 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:43.675777+0000 mon.a (mon.0) 154 : cluster [DBG] mgrmap e13: y(active, since 75s) 2024-09-17T08:43:44.046 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: cluster 2024-09-17T08:43:43.676019+0000 mon.a (mon.0) 155 : cluster [INF] overall HEALTH_OK 2024-09-17T08:43:44.046 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:43.682320+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:44.046 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:43.689224+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:44.046 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:43.697087+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:44.046 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:43 smithi136 bash[24812]: audit 2024-09-17T08:43:43.704406+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:38.624295+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:38.626670+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:38.626793+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:38.626940+0000 mon.a (mon.0) 142 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:39.624919+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:40.087232+0000 mgr.y (mgr.14150) 53 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:40.624765+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:40.627631+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:41.624959+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:42.087692+0000 mgr.y (mgr.14150) 54 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:42.340847+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:44.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:42.624857+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:43.341674+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:43.625293+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:43.648986+0000 mon.a (mon.0) 150 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:43.657006+0000 mon.a (mon.0) 151 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:43.675474+0000 mon.a (mon.0) 152 : cluster [DBG] fsmap 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:43.675527+0000 mon.a (mon.0) 153 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:43.675777+0000 mon.a (mon.0) 154 : cluster [DBG] mgrmap e13: y(active, since 75s) 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: cluster 2024-09-17T08:43:43.676019+0000 mon.a (mon.0) 155 : cluster [INF] overall HEALTH_OK 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:43.682320+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:43.689224+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:43.697087+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:44.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:43 smithi078 bash[22670]: audit 2024-09-17T08:43:43.704406+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:45.104 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:43:44 smithi078 bash[22923]: debug 2024-09-17T08:43:44.625+0000 7f8f6162b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:44.088148+0000 mgr.y (mgr.14150) 55 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:44.349051+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:44.349481+0000 mon.a (mon.0) 163 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:44.350849+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:44.350955+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:44.351142+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:45.341842+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:46.088558+0000 mgr.y (mgr.14150) 56 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:46.342154+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:47.342132+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:48.088945+0000 mgr.y (mgr.14150) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:48.342275+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:49.342584+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.351305+0000 mon.a (mon.0) 171 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.357005+0000 mon.a (mon.0) 172 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.375464+0000 mon.a (mon.0) 173 : cluster [DBG] fsmap 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.375519+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.375778+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e13: y(active, since 81s) 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.376074+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.382785+0000 mon.a (mon.0) 177 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.382842+0000 mon.a (mon.0) 178 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: cluster 2024-09-17T08:43:49.382881+0000 mon.a (mon.0) 179 : cluster [WRN] mon.c (rank 2) addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] is down (out of quorum) 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:49.387860+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:49.392988+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:49.397971+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:49.403684+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:49 smithi136 bash[24812]: audit 2024-09-17T08:43:49.409585+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:44.088148+0000 mgr.y (mgr.14150) 55 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:44.349051+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:44.349481+0000 mon.a (mon.0) 163 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:44.350849+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:44.350955+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:44.351142+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:45.341842+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:46.088558+0000 mgr.y (mgr.14150) 56 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:46.342154+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:47.342132+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:48.088945+0000 mgr.y (mgr.14150) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:48.342275+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:49.342584+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.351305+0000 mon.a (mon.0) 171 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.357005+0000 mon.a (mon.0) 172 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.375464+0000 mon.a (mon.0) 173 : cluster [DBG] fsmap 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.375519+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.375778+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e13: y(active, since 81s) 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.376074+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.382785+0000 mon.a (mon.0) 177 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.382842+0000 mon.a (mon.0) 178 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: cluster 2024-09-17T08:43:49.382881+0000 mon.a (mon.0) 179 : cluster [WRN] mon.c (rank 2) addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] is down (out of quorum) 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:49.387860+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:49.392988+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:49.397971+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:49.403684+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:49.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:49 smithi078 bash[22670]: audit 2024-09-17T08:43:49.409585+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.010+0000 7f5ef81b9640 1 -- 172.21.15.136:0/261529328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5edc003530 msgr2=0x7f5edc0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:50.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.010+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/261529328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5edc003530 0x7f5edc0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00689f0 tx=0x7f5eec02c490 comp rx=0 tx=0).stop 2024-09-17T08:43:50.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.010+0000 7f5ef81b9640 1 -- 172.21.15.136:0/261529328 shutdown_connections 2024-09-17T08:43:50.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.010+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/261529328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5edc003530 0x7f5edc0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.010+0000 7f5ef81b9640 1 -- 172.21.15.136:0/261529328 >> 172.21.15.136:0/261529328 conn(0x7f5ef00fa440 msgr2=0x7f5ef00fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.010+0000 7f5ef81b9640 1 -- 172.21.15.136:0/261529328 shutdown_connections 2024-09-17T08:43:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.010+0000 7f5ef81b9640 1 -- 172.21.15.136:0/261529328 wait complete. 2024-09-17T08:43:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 Processor -- start 2024-09-17T08:43:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 -- start start 2024-09-17T08:43:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 0x7f5ef019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ef019d290 0x7f5ef0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 0x7f5ef0197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01a3940 con 0x7f5ef019d290 2024-09-17T08:43:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01a3ab0 con 0x7f5ef019c970 2024-09-17T08:43:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01a3c70 con 0x7f5ef0196ff0 2024-09-17T08:43:50.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ef019d290 0x7f5ef0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:50.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5f55640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 0x7f5ef019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:50.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef6756640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 0x7f5ef0197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:50.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ef019d290 0x7f5ef0196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.136:34028/0 (socket says 172.21.15.136:34028) 2024-09-17T08:43:50.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef6756640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 0x7f5ef0197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.136:49188/0 (socket says 172.21.15.136:49188) 2024-09-17T08:43:50.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 -- 172.21.15.136:0/3512595798 learned_addr learned my addr 172.21.15.136:0/3512595798 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef6756640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 msgr2=0x7f5ef0197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5f55640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 msgr2=0x7f5ef019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef6756640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 msgr2=0x7f5ef0197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5f55640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 msgr2=0x7f5ef019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef6756640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 0x7f5ef0197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5f55640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 0x7f5ef019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef6756640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 0x7f5ef0197480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5f55640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 0x7f5ef019cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 msgr2=0x7f5ef0197480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 0x7f5ef0197480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 msgr2=0x7f5ef019cd50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T08:43:50.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 0x7f5ef019cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 -- 172.21.15.136:0/3512595798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec012880 con 0x7f5ef019d290 2024-09-17T08:43:50.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef5754640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ef019d290 0x7f5ef0196a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000b520 tx=0x7f5ee000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:50.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ee6ffd640 1 -- 172.21.15.136:0/3512595798 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0004230 con 0x7f5ef019d290 2024-09-17T08:43:50.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ee6ffd640 1 -- 172.21.15.136:0/3512595798 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5ee0004390 con 0x7f5ef019d290 2024-09-17T08:43:50.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ee6ffd640 1 -- 172.21.15.136:0/3512595798 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0003aa0 con 0x7f5ef019d290 2024-09-17T08:43:50.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef01a3f50 con 0x7f5ef019d290 2024-09-17T08:43:50.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.014+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef01a43a0 con 0x7f5ef019d290 2024-09-17T08:43:50.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.018+0000 7f5ee6ffd640 1 -- 172.21.15.136:0/3512595798 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f5ee0003c00 con 0x7f5ef019d290 2024-09-17T08:43:50.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.018+0000 7f5ee6ffd640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f5ed4038be0 0x7f5ed403b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:50.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.018+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef0068ca0 con 0x7f5ef019d290 2024-09-17T08:43:50.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.018+0000 7f5ee6ffd640 1 -- 172.21.15.136:0/3512595798 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5ee004b0f0 con 0x7f5ef019d290 2024-09-17T08:43:50.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.018+0000 7f5ef5f55640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f5ed4038be0 0x7f5ed403b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:50.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.018+0000 7f5ef5f55640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f5ed4038be0 0x7f5ed403b0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5eec02ca80 tx=0x7f5eec0050e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:50.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.022+0000 7f5ee6ffd640 1 -- 172.21.15.136:0/3512595798 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5ee0020bb0 con 0x7f5ef019d290 2024-09-17T08:43:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5ef0106b40 con 0x7f5ef019d290 2024-09-17T08:43:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ee6ffd640 1 -- 172.21.15.136:0/3512595798 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7f5ee00207c0 con 0x7f5ef019d290 2024-09-17T08:43:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 3 2024-09-17T08:43:50.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-17T08:43:50.268 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":3,"fsid":"7121dba6-74d0-11ef-bceb-c7b262605968","modified":"2024-09-17T08:43:44.342639Z","created":"2024-09-17T08:41:24.274037Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3301","nonce":0},{"type":"v1","addr":"172.21.15.78:6790","nonce":0}]},"addr":"172.21.15.78:6790/0","public_addr":"172.21.15.78:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f5ed4038be0 msgr2=0x7f5ed403b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f5ed4038be0 0x7f5ed403b0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5eec02ca80 tx=0x7f5eec0050e0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ef019d290 msgr2=0x7f5ef0196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ef019d290 0x7f5ef0196a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000b520 tx=0x7f5ee000b9e0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 shutdown_connections 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f5ed4038be0 0x7f5ed403b0a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ef0196ff0 0x7f5ef0197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ef019d290 0x7f5ef0196a60 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000b520 tx=0x7f5ee000b9e0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 --2- 172.21.15.136:0/3512595798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ef019c970 0x7f5ef019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:50.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 >> 172.21.15.136:0/3512595798 conn(0x7f5ef00fa440 msgr2=0x7f5ef00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:50.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 shutdown_connections 2024-09-17T08:43:50.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:43:50.266+0000 7f5ef81b9640 1 -- 172.21.15.136:0/3512595798 wait complete. 2024-09-17T08:43:50.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:49.881069+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:49.882949+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: cephadm 2024-09-17T08:43:49.885289+0000 mgr.y (mgr.14150) 58 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: cephadm 2024-09-17T08:43:49.885848+0000 mgr.y (mgr.14150) 59 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: cephadm 2024-09-17T08:43:50.027592+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: cephadm 2024-09-17T08:43:50.031246+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: cluster 2024-09-17T08:43:50.089305+0000 mgr.y (mgr.14150) 62 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.160327+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.166079+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.171029+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.176844+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.182106+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.217805+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.222960+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.228231+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.233410+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: cephadm 2024-09-17T08:43:50.233981+0000 mgr.y (mgr.14150) 63 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.234388+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.235893+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.237260+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: cephadm 2024-09-17T08:43:50.238792+0000 mgr.y (mgr.14150) 64 : cephadm [INF] Reconfiguring daemon mon.a on smithi078 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.268310+0000 mon.a (mon.0) 199 : audit [DBG] from='client.? 172.21.15.136:0/3512595798' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T08:43:50.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:50 smithi136 bash[24812]: audit 2024-09-17T08:43:50.342814+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:50.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:49.881069+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:50.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:49.882949+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:50.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: cephadm 2024-09-17T08:43:49.885289+0000 mgr.y (mgr.14150) 58 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:43:50.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: cephadm 2024-09-17T08:43:49.885848+0000 mgr.y (mgr.14150) 59 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:43:50.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: cephadm 2024-09-17T08:43:50.027592+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:50.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: cephadm 2024-09-17T08:43:50.031246+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:50.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: cluster 2024-09-17T08:43:50.089305+0000 mgr.y (mgr.14150) 62 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.160327+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.166079+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.171029+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.176844+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.182106+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.217805+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.222960+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.228231+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.233410+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:50.856 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: cephadm 2024-09-17T08:43:50.233981+0000 mgr.y (mgr.14150) 63 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-17T08:43:50.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.234388+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:50.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.235893+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:50.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.237260+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:50.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: cephadm 2024-09-17T08:43:50.238792+0000 mgr.y (mgr.14150) 64 : cephadm [INF] Reconfiguring daemon mon.a on smithi078 2024-09-17T08:43:50.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.268310+0000 mon.a (mon.0) 199 : audit [DBG] from='client.? 172.21.15.136:0/3512595798' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T08:43:50.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:50 smithi078 bash[22670]: audit 2024-09-17T08:43:50.342814+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:50.920 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T08:43:50.921 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T08:43:51.639 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:46.344591+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-17T08:43:51.639 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.375360+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-17T08:43:51.639 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.376030+0000 mon.a (mon.0) 202 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:51.639 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.377546+0000 mon.b (mon.1) 3 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.401628+0000 mon.a (mon.0) 203 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.408892+0000 mon.a (mon.0) 204 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.409939+0000 mon.a (mon.0) 205 : cluster [DBG] fsmap 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.410021+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.410345+0000 mon.a (mon.0) 207 : cluster [DBG] mgrmap e13: y(active, since 83s) 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.410738+0000 mon.a (mon.0) 208 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.410794+0000 mon.a (mon.0) 209 : cluster [INF] Cluster is now healthy 2024-09-17T08:43:51.640 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[22670]: cluster 2024-09-17T08:43:51.417121+0000 mon.a (mon.0) 210 : cluster [INF] overall HEALTH_OK 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:38.624295+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:38.626670+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:38.626793+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:38.626940+0000 mon.a (mon.0) 142 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:39.624919+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:40.087232+0000 mgr.y (mgr.14150) 53 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:40.624765+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.641 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:40.627631+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:41.624959+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:42.087692+0000 mgr.y (mgr.14150) 54 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:42.340847+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:42.624857+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:43.341674+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:43.625293+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:43.648986+0000 mon.a (mon.0) 150 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:43.657006+0000 mon.a (mon.0) 151 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:43.675474+0000 mon.a (mon.0) 152 : cluster [DBG] fsmap 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:43.675527+0000 mon.a (mon.0) 153 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:43.675777+0000 mon.a (mon.0) 154 : cluster [DBG] mgrmap e13: y(active, since 75s) 2024-09-17T08:43:51.642 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:43.676019+0000 mon.a (mon.0) 155 : cluster [INF] overall HEALTH_OK 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:43.682320+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:43.689224+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:43.697087+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:43.704406+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:44.088148+0000 mgr.y (mgr.14150) 55 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:44.349051+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:44.349481+0000 mon.a (mon.0) 163 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:44.350849+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:44.350955+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:44.351142+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:45.341842+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:46.088558+0000 mgr.y (mgr.14150) 56 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:51.643 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:46.342154+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:47.342132+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:48.088945+0000 mgr.y (mgr.14150) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:48.342275+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.342584+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.351305+0000 mon.a (mon.0) 171 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.357005+0000 mon.a (mon.0) 172 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.375464+0000 mon.a (mon.0) 173 : cluster [DBG] fsmap 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.375519+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.375778+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e13: y(active, since 81s) 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.376074+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-17T08:43:51.644 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.382785+0000 mon.a (mon.0) 177 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.382842+0000 mon.a (mon.0) 178 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:49.382881+0000 mon.a (mon.0) 179 : cluster [WRN] mon.c (rank 2) addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] is down (out of quorum) 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.387860+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.392988+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.397971+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.403684+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.409585+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.881069+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:49.882949+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:51.645 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cephadm 2024-09-17T08:43:49.885289+0000 mgr.y (mgr.14150) 58 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cephadm 2024-09-17T08:43:49.885848+0000 mgr.y (mgr.14150) 59 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cephadm 2024-09-17T08:43:50.027592+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cephadm 2024-09-17T08:43:50.031246+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:50.089305+0000 mgr.y (mgr.14150) 62 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.160327+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.166079+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.171029+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.176844+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.182106+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.217805+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.222960+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.646 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.228231+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.233410+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cephadm 2024-09-17T08:43:50.233981+0000 mgr.y (mgr.14150) 63 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.234388+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.235893+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.237260+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cephadm 2024-09-17T08:43:50.238792+0000 mgr.y (mgr.14150) 64 : cephadm [INF] Reconfiguring daemon mon.a on smithi078 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.268310+0000 mon.a (mon.0) 199 : audit [DBG] from='client.? 172.21.15.136:0/3512595798' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T08:43:51.647 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: audit 2024-09-17T08:43:50.342814+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:46.344591+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.375360+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.376030+0000 mon.a (mon.0) 202 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.377546+0000 mon.b (mon.1) 3 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.401628+0000 mon.a (mon.0) 203 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.408892+0000 mon.a (mon.0) 204 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.409939+0000 mon.a (mon.0) 205 : cluster [DBG] fsmap 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.410021+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.410345+0000 mon.a (mon.0) 207 : cluster [DBG] mgrmap e13: y(active, since 83s) 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.410738+0000 mon.a (mon.0) 208 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.410794+0000 mon.a (mon.0) 209 : cluster [INF] Cluster is now healthy 2024-09-17T08:43:51.648 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:51 smithi078 bash[32124]: cluster 2024-09-17T08:43:51.417121+0000 mon.a (mon.0) 210 : cluster [INF] overall HEALTH_OK 2024-09-17T08:43:51.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:46.344591+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-17T08:43:51.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.375360+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-17T08:43:51.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.376030+0000 mon.a (mon.0) 202 : cluster [INF] mon.a calling monitor election 2024-09-17T08:43:51.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.377546+0000 mon.b (mon.1) 3 : cluster [INF] mon.b calling monitor election 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.401628+0000 mon.a (mon.0) 203 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.408892+0000 mon.a (mon.0) 204 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.409939+0000 mon.a (mon.0) 205 : cluster [DBG] fsmap 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.410021+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.410345+0000 mon.a (mon.0) 207 : cluster [DBG] mgrmap e13: y(active, since 83s) 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.410738+0000 mon.a (mon.0) 208 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.410794+0000 mon.a (mon.0) 209 : cluster [INF] Cluster is now healthy 2024-09-17T08:43:51.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:51 smithi136 bash[24812]: cluster 2024-09-17T08:43:51.417121+0000 mon.a (mon.0) 210 : cluster [INF] overall HEALTH_OK 2024-09-17T08:43:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: cluster 2024-09-17T08:43:52.089732+0000 mgr.y (mgr.14150) 65 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: audit 2024-09-17T08:43:52.329413+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: audit 2024-09-17T08:43:52.333877+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: cephadm 2024-09-17T08:43:52.334657+0000 mgr.y (mgr.14150) 66 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: audit 2024-09-17T08:43:52.334925+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: audit 2024-09-17T08:43:52.335689+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: audit 2024-09-17T08:43:52.336458+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: cephadm 2024-09-17T08:43:52.337276+0000 mgr.y (mgr.14150) 67 : cephadm [INF] Reconfiguring daemon mon.c on smithi078 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[22670]: audit 2024-09-17T08:43:52.342049+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: cluster 2024-09-17T08:43:52.089732+0000 mgr.y (mgr.14150) 65 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: audit 2024-09-17T08:43:52.329413+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: audit 2024-09-17T08:43:52.333877+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: cephadm 2024-09-17T08:43:52.334657+0000 mgr.y (mgr.14150) 66 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: audit 2024-09-17T08:43:52.334925+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: audit 2024-09-17T08:43:52.335689+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:53.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: audit 2024-09-17T08:43:52.336458+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:53.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: cephadm 2024-09-17T08:43:52.337276+0000 mgr.y (mgr.14150) 67 : cephadm [INF] Reconfiguring daemon mon.c on smithi078 2024-09-17T08:43:53.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:53 smithi078 bash[32124]: audit 2024-09-17T08:43:52.342049+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:53.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: cluster 2024-09-17T08:43:52.089732+0000 mgr.y (mgr.14150) 65 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:53.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: audit 2024-09-17T08:43:52.329413+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:53.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: audit 2024-09-17T08:43:52.333877+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:53.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: cephadm 2024-09-17T08:43:52.334657+0000 mgr.y (mgr.14150) 66 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-17T08:43:53.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: audit 2024-09-17T08:43:52.334925+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:53.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: audit 2024-09-17T08:43:52.335689+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:53.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: audit 2024-09-17T08:43:52.336458+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:53.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: cephadm 2024-09-17T08:43:52.337276+0000 mgr.y (mgr.14150) 67 : cephadm [INF] Reconfiguring daemon mon.c on smithi078 2024-09-17T08:43:53.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:53 smithi136 bash[24812]: audit 2024-09-17T08:43:52.342049+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: cluster 2024-09-17T08:43:54.090148+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: audit 2024-09-17T08:43:54.181035+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: audit 2024-09-17T08:43:54.185737+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: cephadm 2024-09-17T08:43:54.186661+0000 mgr.y (mgr.14150) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: audit 2024-09-17T08:43:54.187007+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: audit 2024-09-17T08:43:54.188052+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: audit 2024-09-17T08:43:54.188949+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:55.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:55 smithi136 bash[24812]: cephadm 2024-09-17T08:43:54.189975+0000 mgr.y (mgr.14150) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi136 2024-09-17T08:43:55.594 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: cluster 2024-09-17T08:43:54.090148+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: audit 2024-09-17T08:43:54.181035+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: audit 2024-09-17T08:43:54.185737+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: cephadm 2024-09-17T08:43:54.186661+0000 mgr.y (mgr.14150) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: audit 2024-09-17T08:43:54.187007+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: audit 2024-09-17T08:43:54.188052+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: audit 2024-09-17T08:43:54.188949+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[32124]: cephadm 2024-09-17T08:43:54.189975+0000 mgr.y (mgr.14150) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi136 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: cluster 2024-09-17T08:43:54.090148+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: audit 2024-09-17T08:43:54.181035+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: audit 2024-09-17T08:43:54.185737+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: cephadm 2024-09-17T08:43:54.186661+0000 mgr.y (mgr.14150) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: audit 2024-09-17T08:43:54.187007+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: audit 2024-09-17T08:43:54.188052+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: audit 2024-09-17T08:43:54.188949+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:55 smithi078 bash[22670]: cephadm 2024-09-17T08:43:54.189975+0000 mgr.y (mgr.14150) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi136 2024-09-17T08:43:57.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:57 smithi136 bash[24812]: cluster 2024-09-17T08:43:56.090613+0000 mgr.y (mgr.14150) 71 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:57.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:57 smithi136 bash[24812]: audit 2024-09-17T08:43:56.140670+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:57 smithi136 bash[24812]: audit 2024-09-17T08:43:56.148196+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:57 smithi136 bash[24812]: audit 2024-09-17T08:43:56.150588+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:57.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:57 smithi136 bash[24812]: audit 2024-09-17T08:43:56.154597+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:57.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:57 smithi136 bash[24812]: audit 2024-09-17T08:43:56.156324+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:57.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:57 smithi136 bash[24812]: audit 2024-09-17T08:43:56.167732+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[22670]: cluster 2024-09-17T08:43:56.090613+0000 mgr.y (mgr.14150) 71 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[22670]: audit 2024-09-17T08:43:56.140670+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[22670]: audit 2024-09-17T08:43:56.148196+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[22670]: audit 2024-09-17T08:43:56.150588+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[22670]: audit 2024-09-17T08:43:56.154597+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[22670]: audit 2024-09-17T08:43:56.156324+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[22670]: audit 2024-09-17T08:43:56.167732+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[32124]: cluster 2024-09-17T08:43:56.090613+0000 mgr.y (mgr.14150) 71 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[32124]: audit 2024-09-17T08:43:56.140670+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[32124]: audit 2024-09-17T08:43:56.148196+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[32124]: audit 2024-09-17T08:43:56.150588+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[32124]: audit 2024-09-17T08:43:56.154597+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[32124]: audit 2024-09-17T08:43:56.156324+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:43:57.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:57 smithi078 bash[32124]: audit 2024-09-17T08:43:56.167732+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:43:58.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/717261366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf180ff4e0 msgr2=0x7fdf18105ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:58.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/717261366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf180ff4e0 0x7fdf18105ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009900 tx=0x7fdf0802a400 comp rx=0 tx=0).stop 2024-09-17T08:43:58.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/717261366 shutdown_connections 2024-09-17T08:43:58.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/717261366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf181063e0 0x7fdf1810cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/717261366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf180ff4e0 0x7fdf18105ca0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/717261366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf180feb30 0x7fdf180fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/717261366 >> 172.21.15.78:0/717261366 conn(0x7fdf18074200 msgr2=0x7fdf18074610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:58.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/717261366 shutdown_connections 2024-09-17T08:43:58.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/717261366 wait complete. 2024-09-17T08:43:58.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 Processor -- start 2024-09-17T08:43:58.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- start start 2024-09-17T08:43:58.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf180feb30 0x7fdf180ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:58.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf180ff4e0 0x7fdf180ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:58.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf181063e0 0x7fdf18100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:58.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf181a3b50 con 0x7fdf180ff4e0 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf181a3cc0 con 0x7fdf180feb30 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf1dc7e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf181a3e80 con 0x7fdf181063e0 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf0ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf180ff4e0 0x7fdf180ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf17fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf181063e0 0x7fdf18100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf0ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf180ff4e0 0x7fdf180ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40866/0 (socket says 172.21.15.78:40866) 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf17fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf181063e0 0x7fdf18100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57454/0 (socket says 172.21.15.78:57454) 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.413+0000 7fdf0ffff640 1 -- 172.21.15.78:0/44770135 learned_addr learned my addr 172.21.15.78:0/44770135 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf177fe640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf180feb30 0x7fdf180ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf17fff640 1 -- 172.21.15.78:0/44770135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf180feb30 msgr2=0x7fdf180ffab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf17fff640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf180feb30 0x7fdf180ffab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf17fff640 1 -- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf180ff4e0 msgr2=0x7fdf180ffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:58.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf17fff640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf180ff4e0 0x7fdf180ffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf17fff640 1 -- 172.21.15.78:0/44770135 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009490 con 0x7fdf181063e0 2024-09-17T08:43:58.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf17fff640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf181063e0 0x7fdf18100530 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000e940 tx=0x7fdf1000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:58.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf157fa640 1 -- 172.21.15.78:0/44770135 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10004d20 con 0x7fdf181063e0 2024-09-17T08:43:58.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf157fa640 1 -- 172.21.15.78:0/44770135 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fdf10004e80 con 0x7fdf181063e0 2024-09-17T08:43:58.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf08009560 con 0x7fdf181063e0 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf157fa640 1 -- 172.21.15.78:0/44770135 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10005950 con 0x7fdf181063e0 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf181a4520 con 0x7fdf181063e0 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf157fa640 1 -- 172.21.15.78:0/44770135 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fdf1000cb20 con 0x7fdf181063e0 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf157fa640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdf040388e0 0x7fdf0403ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf157fa640 1 -- 172.21.15.78:0/44770135 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdf1004ca10 con 0x7fdf181063e0 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf177fe640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdf040388e0 0x7fdf0403ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf180680d0 con 0x7fdf181063e0 2024-09-17T08:43:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.417+0000 7fdf177fe640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdf040388e0 0x7fdf0403ada0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009cf0 tx=0x7fdf00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:43:58.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.421+0000 7fdf157fa640 1 -- 172.21.15.78:0/44770135 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdf100178c0 con 0x7fdf181063e0 2024-09-17T08:43:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.597+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fdf180fef10 con 0x7fdf181063e0 2024-09-17T08:43:58.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf157fa640 1 -- 172.21.15.78:0/44770135 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7fdf100178c0 con 0x7fdf181063e0 2024-09-17T08:43:58.602 INFO:teuthology.orchestra.run.smithi078.stdout:# minimal ceph.conf for 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:43:58.602 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-17T08:43:58.602 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:43:58.602 INFO:teuthology.orchestra.run.smithi078.stdout: mon_host = [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-17T08:43:58.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdf040388e0 msgr2=0x7fdf0403ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:58.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdf040388e0 0x7fdf0403ada0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009cf0 tx=0x7fdf00005f90 comp rx=0 tx=0).stop 2024-09-17T08:43:58.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf181063e0 msgr2=0x7fdf18100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:43:58.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf181063e0 0x7fdf18100530 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000e940 tx=0x7fdf1000ee00 comp rx=0 tx=0).stop 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 shutdown_connections 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fdf040388e0 0x7fdf0403ada0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdf181063e0 0x7fdf18100530 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf180ff4e0 0x7fdf180ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 --2- 172.21.15.78:0/44770135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf180feb30 0x7fdf180ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 >> 172.21.15.78:0/44770135 conn(0x7fdf18074200 msgr2=0x7fdf18103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 shutdown_connections 2024-09-17T08:43:58.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:43:58.601+0000 7fdf1dc7e640 1 -- 172.21.15.78:0/44770135 wait complete. 2024-09-17T08:43:59.273 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T08:43:59.273 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:43:59.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T08:43:59.287 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:43:59.287 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:43:59.344 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:43:59.344 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T08:43:59.359 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:43:59.359 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:43:59.411 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:59 smithi136 bash[24812]: cluster 2024-09-17T08:43:58.091001+0000 mgr.y (mgr.14150) 72 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:59.411 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:43:59 smithi136 bash[24812]: audit 2024-09-17T08:43:58.602742+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.78:0/44770135' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:59.414 INFO:tasks.cephadm:Adding mgr.y on smithi078 2024-09-17T08:43:59.415 INFO:tasks.cephadm:Adding mgr.x on smithi136 2024-09-17T08:43:59.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply mgr '2;smithi078=y;smithi136=x' 2024-09-17T08:43:59.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:59 smithi078 bash[22670]: cluster 2024-09-17T08:43:58.091001+0000 mgr.y (mgr.14150) 72 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:59.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:43:59 smithi078 bash[22670]: audit 2024-09-17T08:43:58.602742+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.78:0/44770135' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:43:59.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:59 smithi078 bash[32124]: cluster 2024-09-17T08:43:58.091001+0000 mgr.y (mgr.14150) 72 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:43:59.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:43:59 smithi078 bash[32124]: audit 2024-09-17T08:43:58.602742+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.78:0/44770135' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:01.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:01 smithi136 bash[24812]: cluster 2024-09-17T08:44:00.091380+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:01 smithi078 bash[22670]: cluster 2024-09-17T08:44:00.091380+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:01 smithi078 bash[32124]: cluster 2024-09-17T08:44:00.091380+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:03.113 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:44:03.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:03 smithi136 bash[24812]: cluster 2024-09-17T08:44:02.091721+0000 mgr.y (mgr.14150) 74 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:03 smithi078 bash[32124]: cluster 2024-09-17T08:44:02.091721+0000 mgr.y (mgr.14150) 74 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:03.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:03 smithi078 bash[22670]: cluster 2024-09-17T08:44:02.091721+0000 mgr.y (mgr.14150) 74 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:05.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:05 smithi136 bash[24812]: cluster 2024-09-17T08:44:04.092124+0000 mgr.y (mgr.14150) 75 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:05.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:05 smithi078 bash[22670]: cluster 2024-09-17T08:44:04.092124+0000 mgr.y (mgr.14150) 75 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:05.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:05 smithi078 bash[32124]: cluster 2024-09-17T08:44:04.092124+0000 mgr.y (mgr.14150) 75 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 -- 172.21.15.136:0/765136599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f80ffe60 msgr2=0x7f11f8100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/765136599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f80ffe60 0x7f11f8100260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009900 tx=0x7f11e802a410 comp rx=0 tx=0).stop 2024-09-17T08:44:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 -- 172.21.15.136:0/765136599 shutdown_connections 2024-09-17T08:44:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/765136599 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11f8101980 0x7f11f81082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/765136599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11f8100fc0 0x7f11f8101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/765136599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f80ffe60 0x7f11f8100260 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 -- 172.21.15.136:0/765136599 >> 172.21.15.136:0/765136599 conn(0x7f11f80fb5f0 msgr2=0x7f11f80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:44:06.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 -- 172.21.15.136:0/765136599 shutdown_connections 2024-09-17T08:44:06.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:05.997+0000 7f11fdbd1640 1 -- 172.21.15.136:0/765136599 wait complete. 2024-09-17T08:44:06.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 Processor -- start 2024-09-17T08:44:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 -- start start 2024-09-17T08:44:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11f80ffe60 0x7f11f8074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11f8100fc0 0x7f11f80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f8101980 0x7f11f8072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8073570 con 0x7f11f8100fc0 2024-09-17T08:44:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80736e0 con 0x7f11f8101980 2024-09-17T08:44:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f819f3a0 con 0x7f11f80ffe60 2024-09-17T08:44:06.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f8101980 0x7f11f8072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:06.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f8101980 0x7f11f8072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47892/0 (socket says 172.21.15.136:47892) 2024-09-17T08:44:06.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 -- 172.21.15.136:0/1835140137 learned_addr learned my addr 172.21.15.136:0/1835140137 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:44:06.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f6ffd640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11f8100fc0 0x7f11f80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:06.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f77fe640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11f80ffe60 0x7f11f8074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:06.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 -- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11f80ffe60 msgr2=0x7f11f8074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11f80ffe60 0x7f11f8074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 -- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11f8100fc0 msgr2=0x7f11f80728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11f8100fc0 0x7f11f80728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 -- 172.21.15.136:0/1835140137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8009560 con 0x7f11f8101980 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f6ffd640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11f8100fc0 0x7f11f80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f7fff640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f8101980 0x7f11f8072de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11f000b9a0 tx=0x7f11f000be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f4ff9640 1 -- 172.21.15.136:0/1835140137 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f000cba0 con 0x7f11f8101980 2024-09-17T08:44:06.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f4ff9640 1 -- 172.21.15.136:0/1835140137 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f11f000cd00 con 0x7f11f8101980 2024-09-17T08:44:06.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f4ff9640 1 -- 172.21.15.136:0/1835140137 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00075d0 con 0x7f11f8101980 2024-09-17T08:44:06.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f819f650 con 0x7f11f8101980 2024-09-17T08:44:06.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f819fb80 con 0x7f11f8101980 2024-09-17T08:44:06.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f4ff9640 1 -- 172.21.15.136:0/1835140137 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f11f0014440 con 0x7f11f8101980 2024-09-17T08:44:06.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f4ff9640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f11e00389f0 0x7f11e003aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:06.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f4ff9640 1 -- 172.21.15.136:0/1835140137 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f11f004ae20 con 0x7f11f8101980 2024-09-17T08:44:06.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f8100260 con 0x7f11f8101980 2024-09-17T08:44:06.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.001+0000 7f11f77fe640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f11e00389f0 0x7f11e003aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:06.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.005+0000 7f11f77fe640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f11e00389f0 0x7f11e003aeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f11e8000c00 tx=0x7f11e8004db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:44:06.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.009+0000 7f11f4ff9640 1 -- 172.21.15.136:0/1835140137 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f11f0019030 con 0x7f11f8101980 2024-09-17T08:44:06.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.185+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi078=y;smithi136=x", "target": ["mon-mgr", ""]}) v1 -- 0x7f11f810ade0 con 0x7f11e00389f0 2024-09-17T08:44:06.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.197+0000 7f11f4ff9640 1 -- 172.21.15.136:0/1835140137 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f11f810ade0 con 0x7f11e00389f0 2024-09-17T08:44:06.202 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mgr update... 2024-09-17T08:44:06.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f11e00389f0 msgr2=0x7f11e003aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:06.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f11e00389f0 0x7f11e003aeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f11e8000c00 tx=0x7f11e8004db0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f8101980 msgr2=0x7f11f8072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:06.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f8101980 0x7f11f8072de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11f000b9a0 tx=0x7f11f000be60 comp rx=0 tx=0).stop 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 shutdown_connections 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f11e00389f0 0x7f11e003aeb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f8101980 0x7f11f8072de0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11f8100fc0 0x7f11f80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 --2- 172.21.15.136:0/1835140137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11f80ffe60 0x7f11f8074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 >> 172.21.15.136:0/1835140137 conn(0x7f11f80fb5f0 msgr2=0x7f11f80fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 shutdown_connections 2024-09-17T08:44:06.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:44:06.201+0000 7f11fdbd1640 1 -- 172.21.15.136:0/1835140137 wait complete. 2024-09-17T08:44:07.085 DEBUG:teuthology.orchestra.run.smithi136:mgr.x> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.x.service 2024-09-17T08:44:07.088 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T08:44:07.088 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:44:07.088 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T08:44:07.094 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T08:44:07.094 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-17T08:44:07.142 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T08:44:07.142 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:07.142 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-17T08:44:07.142 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:07.143 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 08:34:52.530508853 +0000 2024-09-17T08:44:07.143 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 08:34:52.274511134 +0000 2024-09-17T08:44:07.143 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 08:34:52.274511134 +0000 2024-09-17T08:44:07.143 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-17T08:44:07.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T08:44:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T08:44:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T08:44:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000409316 s, 1.3 MB/s 2024-09-17T08:44:07.199 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T08:44:07.249 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-17T08:44:07.298 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T08:44:07.298 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:07.298 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-17T08:44:07.298 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:07.298 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 08:34:53.014504541 +0000 2024-09-17T08:44:07.298 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 08:34:52.766506750 +0000 2024-09-17T08:44:07.299 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 08:34:52.766506750 +0000 2024-09-17T08:44:07.299 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-17T08:44:07.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T08:44:07.353 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T08:44:07.353 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T08:44:07.353 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00039383 s, 1.3 MB/s 2024-09-17T08:44:07.354 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T08:44:07.403 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 08:34:53.486500336 +0000 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 08:34:53.258502366 +0000 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 08:34:53.258502366 +0000 2024-09-17T08:44:07.450 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-17T08:44:07.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T08:44:07.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: cluster 2024-09-17T08:44:06.092494+0000 mgr.y (mgr.14150) 76 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:07.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.193169+0000 mgr.y (mgr.14150) 77 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi078=y;smithi136=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:44:07.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: cephadm 2024-09-17T08:44:06.196128+0000 mgr.y (mgr.14150) 78 : cephadm [INF] Saving service mgr spec with placement smithi078=y;smithi136=x;count:2 2024-09-17T08:44:07.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.202146+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:07.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.203802+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:07.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.207031+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:07.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.209010+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.218167+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.221475+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.226971+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.228640+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: audit 2024-09-17T08:44:06.230423+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[22670]: cephadm 2024-09-17T08:44:06.232807+0000 mgr.y (mgr.14150) 79 : cephadm [INF] Deploying daemon mgr.x on smithi136 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: cluster 2024-09-17T08:44:06.092494+0000 mgr.y (mgr.14150) 76 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.193169+0000 mgr.y (mgr.14150) 77 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi078=y;smithi136=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: cephadm 2024-09-17T08:44:06.196128+0000 mgr.y (mgr.14150) 78 : cephadm [INF] Saving service mgr spec with placement smithi078=y;smithi136=x;count:2 2024-09-17T08:44:07.503 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.202146+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.203802+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.207031+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.209010+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.218167+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.221475+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.226971+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.228640+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: audit 2024-09-17T08:44:06.230423+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:07.504 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:07 smithi078 bash[32124]: cephadm 2024-09-17T08:44:06.232807+0000 mgr.y (mgr.14150) 79 : cephadm [INF] Deploying daemon mgr.x on smithi136 2024-09-17T08:44:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T08:44:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T08:44:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000398667 s, 1.3 MB/s 2024-09-17T08:44:07.506 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T08:44:07.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: cluster 2024-09-17T08:44:06.092494+0000 mgr.y (mgr.14150) 76 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.193169+0000 mgr.y (mgr.14150) 77 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi078=y;smithi136=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: cephadm 2024-09-17T08:44:06.196128+0000 mgr.y (mgr.14150) 78 : cephadm [INF] Saving service mgr spec with placement smithi078=y;smithi136=x;count:2 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.202146+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.203802+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.207031+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.209010+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.218167+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.221475+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.226971+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T08:44:07.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.228640+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T08:44:07.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: audit 2024-09-17T08:44:06.230423+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:07.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:07 smithi136 bash[24812]: cephadm 2024-09-17T08:44:06.232807+0000 mgr.y (mgr.14150) 79 : cephadm [INF] Deploying daemon mgr.x on smithi136 2024-09-17T08:44:07.556 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-17T08:44:07.602 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T08:44:07.602 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:07.602 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-17T08:44:07.602 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:07.602 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 08:34:53.994495810 +0000 2024-09-17T08:44:07.603 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 08:34:53.742498054 +0000 2024-09-17T08:44:07.603 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 08:34:53.742498054 +0000 2024-09-17T08:44:07.603 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-17T08:44:07.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T08:44:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T08:44:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T08:44:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00033905 s, 1.5 MB/s 2024-09-17T08:44:07.657 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T08:44:07.707 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:44:07.707 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T08:44:07.713 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T08:44:07.713 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-17 08:34:52.259107576 +0000 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-17 08:34:52.255107613 +0000 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-17 08:34:52.255107613 +0000 2024-09-17T08:44:07.760 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-09-17T08:44:07.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T08:44:07.814 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-17T08:44:07.814 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-17T08:44:07.814 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000402211 s, 1.3 MB/s 2024-09-17T08:44:07.815 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T08:44:07.863 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-09-17T08:44:07.914 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T08:44:07.915 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:07.915 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-17T08:44:07.915 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:07.915 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-17 08:34:53.019100788 +0000 2024-09-17T08:44:07.915 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-17 08:34:52.755103146 +0000 2024-09-17T08:44:07.915 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-17 08:34:52.755103146 +0000 2024-09-17T08:44:07.915 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-09-17T08:44:07.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T08:44:07.972 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-17T08:44:07.972 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-17T08:44:07.972 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000271236 s, 1.9 MB/s 2024-09-17T08:44:07.973 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T08:44:08.019 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-17 08:34:53.475096715 +0000 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-17 08:34:53.259098645 +0000 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-17 08:34:53.259098645 +0000 2024-09-17T08:44:08.066 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-09-17T08:44:08.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T08:44:08.119 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-17T08:44:08.119 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-17T08:44:08.119 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000284814 s, 1.8 MB/s 2024-09-17T08:44:08.120 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T08:44:08.170 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-09-17T08:44:08.218 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T08:44:08.219 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T08:44:08.219 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-17T08:44:08.219 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T08:44:08.219 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-17 08:34:53.959092391 +0000 2024-09-17T08:44:08.219 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-17 08:34:53.711094607 +0000 2024-09-17T08:44:08.219 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-17 08:34:53.711094607 +0000 2024-09-17T08:44:08.219 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-09-17T08:44:08.219 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T08:44:08.273 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-17T08:44:08.273 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-17T08:44:08.273 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000308384 s, 1.7 MB/s 2024-09-17T08:44:08.274 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T08:44:08.324 INFO:tasks.cephadm:Deploying osd.0 on smithi078 with /dev/vg_nvme/lv_4... 2024-09-17T08:44:08.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-17T08:44:09.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:08 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:09.035 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:08 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:09.035 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:08 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:09.035 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:08 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:09.294 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:09.294 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:09 smithi136 systemd[1]: Started Ceph mgr.x for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:44:09.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:09.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:09 smithi136 bash[24812]: cluster 2024-09-17T08:44:08.092927+0000 mgr.y (mgr.14150) 80 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:09.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:09 smithi136 bash[24812]: audit 2024-09-17T08:44:09.173520+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:09 smithi136 bash[24812]: audit 2024-09-17T08:44:09.180612+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:09 smithi136 bash[24812]: audit 2024-09-17T08:44:09.189924+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:09 smithi136 bash[24812]: audit 2024-09-17T08:44:09.198970+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[32124]: cluster 2024-09-17T08:44:08.092927+0000 mgr.y (mgr.14150) 80 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[32124]: audit 2024-09-17T08:44:09.173520+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[32124]: audit 2024-09-17T08:44:09.180612+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[32124]: audit 2024-09-17T08:44:09.189924+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[32124]: audit 2024-09-17T08:44:09.198970+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[22670]: cluster 2024-09-17T08:44:08.092927+0000 mgr.y (mgr.14150) 80 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:09.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[22670]: audit 2024-09-17T08:44:09.173520+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[22670]: audit 2024-09-17T08:44:09.180612+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[22670]: audit 2024-09-17T08:44:09.189924+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:09.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:09 smithi078 bash[22670]: audit 2024-09-17T08:44:09.198970+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:10.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:10 smithi136 bash[24812]: audit 2024-09-17T08:44:09.256934+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:10.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:10 smithi136 bash[24812]: audit 2024-09-17T08:44:09.402967+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:10.545 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:10 smithi136 bash[25711]: debug 2024-09-17T08:44:10.261+0000 7fe5cc747640 1 -- 172.21.15.136:0/84054734 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559023932d00 con 0x559023925400 2024-09-17T08:44:10.545 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:10 smithi136 bash[25711]: debug 2024-09-17T08:44:10.373+0000 7fe5cefb0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T08:44:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:10 smithi078 bash[32124]: audit 2024-09-17T08:44:09.256934+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:10 smithi078 bash[32124]: audit 2024-09-17T08:44:09.402967+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:10 smithi078 bash[22670]: audit 2024-09-17T08:44:09.256934+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:10.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:10 smithi078 bash[22670]: audit 2024-09-17T08:44:09.402967+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:11.767 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:11 smithi136 bash[24812]: cluster 2024-09-17T08:44:10.093401+0000 mgr.y (mgr.14150) 81 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:11.768 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:11 smithi136 bash[25711]: debug 2024-09-17T08:44:11.553+0000 7fe5cefb0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T08:44:11.768 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:11 smithi136 bash[25711]: debug 2024-09-17T08:44:11.617+0000 7fe5cefb0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T08:44:11.768 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:11 smithi136 bash[25711]: debug 2024-09-17T08:44:11.765+0000 7fe5cefb0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T08:44:11.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:11 smithi078 bash[22670]: cluster 2024-09-17T08:44:10.093401+0000 mgr.y (mgr.14150) 81 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:11.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:11 smithi078 bash[32124]: cluster 2024-09-17T08:44:10.093401+0000 mgr.y (mgr.14150) 81 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:12.719 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:12 smithi136 bash[25711]: debug 2024-09-17T08:44:12.397+0000 7fe5cefb0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T08:44:12.720 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:12 smithi136 bash[25711]: debug 2024-09-17T08:44:12.465+0000 7fe5cefb0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T08:44:12.720 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:12 smithi136 bash[25711]: debug 2024-09-17T08:44:12.533+0000 7fe5cefb0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T08:44:13.003 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:44:13.044 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:12 smithi136 bash[25711]: debug 2024-09-17T08:44:12.717+0000 7fe5cefb0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T08:44:13.045 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:12 smithi136 bash[25711]: debug 2024-09-17T08:44:12.789+0000 7fe5cefb0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T08:44:13.045 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:12 smithi136 bash[25711]: debug 2024-09-17T08:44:12.857+0000 7fe5cefb0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T08:44:13.366 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:13 smithi136 bash[25711]: debug 2024-09-17T08:44:13.105+0000 7fe5cefb0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T08:44:13.366 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:13 smithi136 bash[25711]: debug 2024-09-17T08:44:13.173+0000 7fe5cefb0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T08:44:13.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:13 smithi136 bash[24812]: cluster 2024-09-17T08:44:12.093833+0000 mgr.y (mgr.14150) 82 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:13.691 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:13 smithi136 bash[25711]: debug 2024-09-17T08:44:13.361+0000 7fe5cefb0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T08:44:13.691 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:13 smithi136 bash[25711]: debug 2024-09-17T08:44:13.437+0000 7fe5cefb0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T08:44:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:13 smithi078 bash[32124]: cluster 2024-09-17T08:44:12.093833+0000 mgr.y (mgr.14150) 82 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:13.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:13 smithi078 bash[22670]: cluster 2024-09-17T08:44:12.093833+0000 mgr.y (mgr.14150) 82 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:14.023 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:13 smithi136 bash[25711]: debug 2024-09-17T08:44:13.685+0000 7fe5cefb0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T08:44:14.023 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:13 smithi136 bash[25711]: debug 2024-09-17T08:44:13.861+0000 7fe5cefb0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:44:14.023 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:14 smithi136 bash[25711]: debug 2024-09-17T08:44:14.017+0000 7fe5cefb0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T08:44:14.291 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:14 smithi136 bash[25711]: debug 2024-09-17T08:44:14.101+0000 7fe5cefb0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T08:44:14.544 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:14 smithi136 bash[25711]: debug 2024-09-17T08:44:14.289+0000 7fe5cefb0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:44:15.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: cluster 2024-09-17T08:44:14.094299+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:15.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.256878+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.260485+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.706839+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.708398+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.716344+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.759470+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.760936+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[22670]: audit 2024-09-17T08:44:14.761981+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: cluster 2024-09-17T08:44:14.094299+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.256878+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.260485+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.706839+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:15.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.708398+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:15.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.716344+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.759470+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T08:44:15.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.760936+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T08:44:15.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:15 smithi078 bash[32124]: audit 2024-09-17T08:44:14.761981+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:15.379 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[25711]: debug 2024-09-17T08:44:15.081+0000 7fe5cefb0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[25711]: debug 2024-09-17T08:44:15.157+0000 7fe5cefb0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: cluster 2024-09-17T08:44:14.094299+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.256878+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.260485+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.706839+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.708398+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.716344+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.759470+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.760936+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T08:44:15.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[24812]: audit 2024-09-17T08:44:14.761981+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:15.794 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[25711]: debug 2024-09-17T08:44:15.377+0000 7fe5cefb0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T08:44:15.794 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[25711]: debug 2024-09-17T08:44:15.449+0000 7fe5cefb0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T08:44:16.267 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[25711]: debug 2024-09-17T08:44:15.829+0000 7fe5cefb0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T08:44:16.268 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:44:15 smithi136 bash[25711]: debug 2024-09-17T08:44:15.905+0000 7fe5cefb0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T08:44:16.527 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[32124]: cephadm 2024-09-17T08:44:14.758967+0000 mgr.y (mgr.14150) 84 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-17T08:44:16.527 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[32124]: cephadm 2024-09-17T08:44:14.763193+0000 mgr.y (mgr.14150) 85 : cephadm [INF] Reconfiguring daemon mgr.y on smithi078 2024-09-17T08:44:16.527 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[32124]: cluster 2024-09-17T08:44:15.931365+0000 mon.a (mon.0) 251 : cluster [DBG] Standby manager daemon x started 2024-09-17T08:44:16.527 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[32124]: audit 2024-09-17T08:44:15.932928+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T08:44:16.527 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[32124]: audit 2024-09-17T08:44:15.933924+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T08:44:16.527 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[32124]: audit 2024-09-17T08:44:15.935154+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T08:44:16.527 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[32124]: audit 2024-09-17T08:44:15.935559+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T08:44:16.528 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[22670]: cephadm 2024-09-17T08:44:14.758967+0000 mgr.y (mgr.14150) 84 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-17T08:44:16.528 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[22670]: cephadm 2024-09-17T08:44:14.763193+0000 mgr.y (mgr.14150) 85 : cephadm [INF] Reconfiguring daemon mgr.y on smithi078 2024-09-17T08:44:16.528 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[22670]: cluster 2024-09-17T08:44:15.931365+0000 mon.a (mon.0) 251 : cluster [DBG] Standby manager daemon x started 2024-09-17T08:44:16.528 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[22670]: audit 2024-09-17T08:44:15.932928+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T08:44:16.528 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[22670]: audit 2024-09-17T08:44:15.933924+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T08:44:16.528 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[22670]: audit 2024-09-17T08:44:15.935154+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T08:44:16.528 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:16 smithi078 bash[22670]: audit 2024-09-17T08:44:15.935559+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T08:44:16.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:16 smithi136 bash[24812]: cephadm 2024-09-17T08:44:14.758967+0000 mgr.y (mgr.14150) 84 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-17T08:44:16.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:16 smithi136 bash[24812]: cephadm 2024-09-17T08:44:14.763193+0000 mgr.y (mgr.14150) 85 : cephadm [INF] Reconfiguring daemon mgr.y on smithi078 2024-09-17T08:44:16.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:16 smithi136 bash[24812]: cluster 2024-09-17T08:44:15.931365+0000 mon.a (mon.0) 251 : cluster [DBG] Standby manager daemon x started 2024-09-17T08:44:16.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:16 smithi136 bash[24812]: audit 2024-09-17T08:44:15.932928+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T08:44:16.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:16 smithi136 bash[24812]: audit 2024-09-17T08:44:15.933924+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T08:44:16.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:16 smithi136 bash[24812]: audit 2024-09-17T08:44:15.935154+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T08:44:16.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:16 smithi136 bash[24812]: audit 2024-09-17T08:44:15.935559+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.136:0/3983318395' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T08:44:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-17T08:44:17.014 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-17T08:44:17.029 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2024-09-17T08:44:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2024-09-17T08:44:17.029 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131161 s, 799 MB/s 2024-09-17T08:44:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2024-09-17T08:44:17.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:17 smithi078 bash[22670]: cluster 2024-09-17T08:44:16.094735+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:17.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:17 smithi078 bash[22670]: cluster 2024-09-17T08:44:16.277231+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e14: y(active, since 108s), standbys: x 2024-09-17T08:44:17.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:17 smithi078 bash[22670]: audit 2024-09-17T08:44:16.277610+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T08:44:17.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:17 smithi078 bash[32124]: cluster 2024-09-17T08:44:16.094735+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:17.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:17 smithi078 bash[32124]: cluster 2024-09-17T08:44:16.277231+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e14: y(active, since 108s), standbys: x 2024-09-17T08:44:17.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:17 smithi078 bash[32124]: audit 2024-09-17T08:44:16.277610+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T08:44:17.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:17 smithi136 bash[24812]: cluster 2024-09-17T08:44:16.094735+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:17.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:17 smithi136 bash[24812]: cluster 2024-09-17T08:44:16.277231+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e14: y(active, since 108s), standbys: x 2024-09-17T08:44:17.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:17 smithi136 bash[24812]: audit 2024-09-17T08:44:16.277610+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T08:44:17.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_4 2024-09-17T08:44:18.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:18 smithi136 bash[24812]: audit 2024-09-17T08:44:17.544645+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:18 smithi136 bash[24812]: audit 2024-09-17T08:44:17.553186+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:18 smithi136 bash[24812]: audit 2024-09-17T08:44:17.555201+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:18.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:18 smithi136 bash[24812]: audit 2024-09-17T08:44:17.557401+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:18.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:18 smithi136 bash[24812]: audit 2024-09-17T08:44:17.558490+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:18.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:18 smithi136 bash[24812]: audit 2024-09-17T08:44:17.564795+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:18 smithi136 bash[24812]: cluster 2024-09-17T08:44:18.095067+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:18.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[32124]: audit 2024-09-17T08:44:17.544645+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[32124]: audit 2024-09-17T08:44:17.553186+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[32124]: audit 2024-09-17T08:44:17.555201+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[32124]: audit 2024-09-17T08:44:17.557401+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[32124]: audit 2024-09-17T08:44:17.558490+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[32124]: audit 2024-09-17T08:44:17.564795+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[32124]: cluster 2024-09-17T08:44:18.095067+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[22670]: audit 2024-09-17T08:44:17.544645+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[22670]: audit 2024-09-17T08:44:17.553186+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[22670]: audit 2024-09-17T08:44:17.555201+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[22670]: audit 2024-09-17T08:44:17.557401+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[22670]: audit 2024-09-17T08:44:17.558490+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[22670]: audit 2024-09-17T08:44:17.564795+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:18.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:18 smithi078 bash[22670]: cluster 2024-09-17T08:44:18.095067+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:21.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:21 smithi136 bash[24812]: cluster 2024-09-17T08:44:20.095479+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:21 smithi078 bash[32124]: cluster 2024-09-17T08:44:20.095479+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:21.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:21 smithi078 bash[22670]: cluster 2024-09-17T08:44:20.095479+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:22.560 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:44:23.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:23 smithi136 bash[24812]: cluster 2024-09-17T08:44:22.095903+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:23.592 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:23 smithi078 bash[22670]: cluster 2024-09-17T08:44:22.095903+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:23.592 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:23 smithi078 bash[32124]: cluster 2024-09-17T08:44:22.095903+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 -- 172.21.15.78:0/3633783188 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 msgr2=0x7f8224102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 --2- 172.21.15.78:0/3633783188 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224102450 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f821c009ca0 tx=0x7f821c02a8c0 comp rx=0 tx=0).stop 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 -- 172.21.15.78:0/3633783188 shutdown_connections 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 --2- 172.21.15.78:0/3633783188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8224103c10 0x7f822410a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 --2- 172.21.15.78:0/3633783188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8224103250 0x7f82241036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 --2- 172.21.15.78:0/3633783188 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224102450 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 -- 172.21.15.78:0/3633783188 >> 172.21.15.78:0/3633783188 conn(0x7f82240fd7e0 msgr2=0x7f82240ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 -- 172.21.15.78:0/3633783188 shutdown_connections 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.345+0000 7f822967a640 1 -- 172.21.15.78:0/3633783188 wait complete. 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 Processor -- start 2024-09-17T08:44:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 -- start start 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8224103250 0x7f8224197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8224103c10 0x7f822419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822419f050 con 0x7f8224103c10 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822419f1c0 con 0x7f8224103250 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822419f380 con 0x7f8224102050 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f82237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8224103c10 0x7f822419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35886/0 (socket says 172.21.15.78:35886) 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 -- 172.21.15.78:0/3823471475 learned_addr learned my addr 172.21.15.78:0/3823471475 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:44:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f82227fc640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8224103250 0x7f8224197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 -- 172.21.15.78:0/3823471475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8224103250 msgr2=0x7f8224197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8224103250 0x7f8224197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 -- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8224103c10 msgr2=0x7f822419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8224103c10 0x7f822419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 -- 172.21.15.78:0/3823471475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009490 con 0x7f8224102050 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f82237fe640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8224103c10 0x7f822419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f8222ffd640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224197550 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f821c005e30 tx=0x7f821c030f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f821bfff640 1 -- 172.21.15.78:0/3823471475 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c003c70 con 0x7f8224102050 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f821bfff640 1 -- 172.21.15.78:0/3823471475 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f821c040070 con 0x7f8224102050 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c009900 con 0x7f8224102050 2024-09-17T08:44:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f821bfff640 1 -- 172.21.15.78:0/3823471475 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c004450 con 0x7f8224102050 2024-09-17T08:44:25.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822419f970 con 0x7f8224102050 2024-09-17T08:44:25.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8224102450 con 0x7f8224102050 2024-09-17T08:44:25.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f821bfff640 1 -- 172.21.15.78:0/3823471475 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7f821c042030 con 0x7f8224102050 2024-09-17T08:44:25.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f821bfff640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f821006cd80 0x7f821006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:44:25.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f821bfff640 1 -- 172.21.15.78:0/3823471475 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f821c0ac430 con 0x7f8224102050 2024-09-17T08:44:25.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.349+0000 7f82227fc640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f821006cd80 0x7f821006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:44:25.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.353+0000 7f82227fc640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f821006cd80 0x7f821006f240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8224198a70 tx=0x7f820c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:44:25.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.357+0000 7f821bfff640 1 -- 172.21.15.78:0/3823471475 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f821c0779b0 con 0x7f8224102050 2024-09-17T08:44:25.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:25.537+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f822410cf80 con 0x7f821006cd80 2024-09-17T08:44:25.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:25 smithi136 bash[24812]: cluster 2024-09-17T08:44:24.096351+0000 mgr.y (mgr.14150) 90 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:25.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:25 smithi078 bash[22670]: cluster 2024-09-17T08:44:24.096351+0000 mgr.y (mgr.14150) 90 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:25.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:25 smithi078 bash[32124]: cluster 2024-09-17T08:44:24.096351+0000 mgr.y (mgr.14150) 90 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:26 smithi136 bash[24812]: audit 2024-09-17T08:44:25.546187+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:44:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:26 smithi136 bash[24812]: audit 2024-09-17T08:44:25.549983+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:44:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:26 smithi136 bash[24812]: audit 2024-09-17T08:44:25.551153+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:26 smithi078 bash[32124]: audit 2024-09-17T08:44:25.546187+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:44:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:26 smithi078 bash[32124]: audit 2024-09-17T08:44:25.549983+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:44:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:26 smithi078 bash[32124]: audit 2024-09-17T08:44:25.551153+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:26 smithi078 bash[22670]: audit 2024-09-17T08:44:25.546187+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:44:26.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:26 smithi078 bash[22670]: audit 2024-09-17T08:44:25.549983+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:44:26.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:26 smithi078 bash[22670]: audit 2024-09-17T08:44:25.551153+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:27 smithi136 bash[24812]: audit 2024-09-17T08:44:25.543244+0000 mgr.y (mgr.14150) 91 : audit [DBG] from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:44:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:27 smithi136 bash[24812]: cluster 2024-09-17T08:44:26.096779+0000 mgr.y (mgr.14150) 92 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:27.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:27 smithi078 bash[32124]: audit 2024-09-17T08:44:25.543244+0000 mgr.y (mgr.14150) 91 : audit [DBG] from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:44:27.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:27 smithi078 bash[32124]: cluster 2024-09-17T08:44:26.096779+0000 mgr.y (mgr.14150) 92 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:27 smithi078 bash[22670]: audit 2024-09-17T08:44:25.543244+0000 mgr.y (mgr.14150) 91 : audit [DBG] from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:44:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:27 smithi078 bash[22670]: cluster 2024-09-17T08:44:26.096779+0000 mgr.y (mgr.14150) 92 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:29.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:29 smithi136 bash[24812]: cluster 2024-09-17T08:44:28.097199+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:29 smithi078 bash[22670]: cluster 2024-09-17T08:44:28.097199+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:29 smithi078 bash[32124]: cluster 2024-09-17T08:44:28.097199+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:31.428 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:31 smithi078 bash[22670]: cluster 2024-09-17T08:44:30.097612+0000 mgr.y (mgr.14150) 94 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:31.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:31 smithi078 bash[32124]: cluster 2024-09-17T08:44:30.097612+0000 mgr.y (mgr.14150) 94 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:31.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:31 smithi136 bash[24812]: cluster 2024-09-17T08:44:30.097612+0000 mgr.y (mgr.14150) 94 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:33.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:33 smithi078 bash[32124]: cluster 2024-09-17T08:44:32.097959+0000 mgr.y (mgr.14150) 95 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:33.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:33 smithi078 bash[22670]: cluster 2024-09-17T08:44:32.097959+0000 mgr.y (mgr.14150) 95 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:33.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:33 smithi136 bash[24812]: cluster 2024-09-17T08:44:32.097959+0000 mgr.y (mgr.14150) 95 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:34.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:34 smithi136 bash[24812]: audit 2024-09-17T08:44:33.674981+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.15.78:0/2267526741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd390083-c887-4412-9871-258ea390ed44"}]: dispatch 2024-09-17T08:44:34.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:34 smithi136 bash[24812]: audit 2024-09-17T08:44:33.679675+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.15.78:0/2267526741' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd390083-c887-4412-9871-258ea390ed44"}]': finished 2024-09-17T08:44:34.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:34 smithi136 bash[24812]: cluster 2024-09-17T08:44:33.679710+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-17T08:44:34.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:34 smithi136 bash[24812]: audit 2024-09-17T08:44:33.679794+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:44:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[22670]: audit 2024-09-17T08:44:33.674981+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.15.78:0/2267526741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd390083-c887-4412-9871-258ea390ed44"}]: dispatch 2024-09-17T08:44:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[22670]: audit 2024-09-17T08:44:33.679675+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.15.78:0/2267526741' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd390083-c887-4412-9871-258ea390ed44"}]': finished 2024-09-17T08:44:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[22670]: cluster 2024-09-17T08:44:33.679710+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-17T08:44:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[22670]: audit 2024-09-17T08:44:33.679794+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:44:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[32124]: audit 2024-09-17T08:44:33.674981+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.15.78:0/2267526741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd390083-c887-4412-9871-258ea390ed44"}]: dispatch 2024-09-17T08:44:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[32124]: audit 2024-09-17T08:44:33.679675+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.15.78:0/2267526741' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd390083-c887-4412-9871-258ea390ed44"}]': finished 2024-09-17T08:44:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[32124]: cluster 2024-09-17T08:44:33.679710+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-17T08:44:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:34 smithi078 bash[32124]: audit 2024-09-17T08:44:33.679794+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:44:35.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:35 smithi136 bash[24812]: cluster 2024-09-17T08:44:34.098236+0000 mgr.y (mgr.14150) 96 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:35.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:35 smithi136 bash[24812]: audit 2024-09-17T08:44:34.272050+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? 172.21.15.78:0/3862543882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:44:35.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:35 smithi078 bash[32124]: cluster 2024-09-17T08:44:34.098236+0000 mgr.y (mgr.14150) 96 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:35.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:35 smithi078 bash[32124]: audit 2024-09-17T08:44:34.272050+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? 172.21.15.78:0/3862543882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:44:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:35 smithi078 bash[22670]: cluster 2024-09-17T08:44:34.098236+0000 mgr.y (mgr.14150) 96 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:35.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:35 smithi078 bash[22670]: audit 2024-09-17T08:44:34.272050+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? 172.21.15.78:0/3862543882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:44:37.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:37 smithi136 bash[24812]: cluster 2024-09-17T08:44:36.098648+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:37.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:37 smithi078 bash[22670]: cluster 2024-09-17T08:44:36.098648+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:37.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:37 smithi078 bash[32124]: cluster 2024-09-17T08:44:36.098648+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:39.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:39 smithi136 bash[24812]: cluster 2024-09-17T08:44:38.099207+0000 mgr.y (mgr.14150) 98 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:39.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:39 smithi078 bash[22670]: cluster 2024-09-17T08:44:38.099207+0000 mgr.y (mgr.14150) 98 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:39.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:39 smithi078 bash[32124]: cluster 2024-09-17T08:44:38.099207+0000 mgr.y (mgr.14150) 98 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:41.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:41 smithi136 bash[24812]: cluster 2024-09-17T08:44:40.099679+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:41.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:41 smithi078 bash[22670]: cluster 2024-09-17T08:44:40.099679+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:41.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:41 smithi078 bash[32124]: cluster 2024-09-17T08:44:40.099679+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:43.511 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:43 smithi078 bash[32124]: cluster 2024-09-17T08:44:42.100088+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:43.511 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:43 smithi078 bash[22670]: cluster 2024-09-17T08:44:42.100088+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:43.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:43 smithi136 bash[24812]: cluster 2024-09-17T08:44:42.100088+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:45.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:45 smithi136 bash[24812]: cluster 2024-09-17T08:44:44.100521+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:45.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:45 smithi078 bash[22670]: cluster 2024-09-17T08:44:44.100521+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:45 smithi078 bash[32124]: cluster 2024-09-17T08:44:44.100521+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:46.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:46 smithi078 bash[22670]: audit 2024-09-17T08:44:45.770132+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T08:44:46.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:46 smithi078 bash[22670]: audit 2024-09-17T08:44:45.771870+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:46.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:46 smithi136 bash[24812]: audit 2024-09-17T08:44:45.770132+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T08:44:46.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:46 smithi136 bash[24812]: audit 2024-09-17T08:44:45.771870+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:46.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:46 smithi078 bash[32124]: audit 2024-09-17T08:44:45.770132+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T08:44:46.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:46 smithi078 bash[32124]: audit 2024-09-17T08:44:45.771870+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:47.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:47 smithi078 bash[22670]: cephadm 2024-09-17T08:44:45.773448+0000 mgr.y (mgr.14150) 102 : cephadm [INF] Deploying daemon osd.0 on smithi078 2024-09-17T08:44:47.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:47 smithi078 bash[22670]: cluster 2024-09-17T08:44:46.100818+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:47.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:47 smithi078 bash[32124]: cephadm 2024-09-17T08:44:45.773448+0000 mgr.y (mgr.14150) 102 : cephadm [INF] Deploying daemon osd.0 on smithi078 2024-09-17T08:44:47.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:47 smithi078 bash[32124]: cluster 2024-09-17T08:44:46.100818+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:47.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:47 smithi136 bash[24812]: cephadm 2024-09-17T08:44:45.773448+0000 mgr.y (mgr.14150) 102 : cephadm [INF] Deploying daemon osd.0 on smithi078 2024-09-17T08:44:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:47 smithi136 bash[24812]: cluster 2024-09-17T08:44:46.100818+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:49 smithi078 bash[22670]: cluster 2024-09-17T08:44:48.101196+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:49 smithi078 bash[32124]: cluster 2024-09-17T08:44:48.101196+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:49.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:49 smithi136 bash[24812]: cluster 2024-09-17T08:44:48.101196+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:50.065 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:44:49 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:50.065 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:49 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:50.065 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:49 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:50.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:50 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:50.315 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:50 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:50.315 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:44:50 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:44:51.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:51 smithi136 bash[24812]: cluster 2024-09-17T08:44:50.101619+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:51.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:51 smithi136 bash[24812]: audit 2024-09-17T08:44:50.344285+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:51.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:51 smithi136 bash[24812]: audit 2024-09-17T08:44:50.348082+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:51.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:51 smithi136 bash[24812]: audit 2024-09-17T08:44:50.352612+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[22670]: cluster 2024-09-17T08:44:50.101619+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[22670]: audit 2024-09-17T08:44:50.344285+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[22670]: audit 2024-09-17T08:44:50.348082+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[22670]: audit 2024-09-17T08:44:50.352612+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[32124]: cluster 2024-09-17T08:44:50.101619+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[32124]: audit 2024-09-17T08:44:50.344285+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:44:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[32124]: audit 2024-09-17T08:44:50.348082+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:51 smithi078 bash[32124]: audit 2024-09-17T08:44:50.352612+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:53.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:53 smithi136 bash[24812]: cluster 2024-09-17T08:44:52.102125+0000 mgr.y (mgr.14150) 106 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:53 smithi078 bash[22670]: cluster 2024-09-17T08:44:52.102125+0000 mgr.y (mgr.14150) 106 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:53.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:53 smithi078 bash[32124]: cluster 2024-09-17T08:44:52.102125+0000 mgr.y (mgr.14150) 106 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:55.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:55 smithi136 bash[24812]: cluster 2024-09-17T08:44:54.102695+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:55 smithi078 bash[22670]: cluster 2024-09-17T08:44:54.102695+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:55.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:55 smithi078 bash[32124]: cluster 2024-09-17T08:44:54.102695+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:56.483 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[32124]: audit 2024-09-17T08:44:55.420364+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[32124]: audit 2024-09-17T08:44:55.424177+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[32124]: audit 2024-09-17T08:44:55.864313+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[32124]: audit 2024-09-17T08:44:55.865785+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[32124]: audit 2024-09-17T08:44:55.875285+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[32124]: cluster 2024-09-17T08:44:56.103094+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[22670]: audit 2024-09-17T08:44:55.420364+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[22670]: audit 2024-09-17T08:44:55.424177+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[22670]: audit 2024-09-17T08:44:55.864313+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:56.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[22670]: audit 2024-09-17T08:44:55.865785+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:56.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[22670]: audit 2024-09-17T08:44:55.875285+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:56 smithi078 bash[22670]: cluster 2024-09-17T08:44:56.103094+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:56.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:56 smithi136 bash[24812]: audit 2024-09-17T08:44:55.420364+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:56 smithi136 bash[24812]: audit 2024-09-17T08:44:55.424177+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:56 smithi136 bash[24812]: audit 2024-09-17T08:44:55.864313+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:44:56.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:56 smithi136 bash[24812]: audit 2024-09-17T08:44:55.865785+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:44:56.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:56 smithi136 bash[24812]: audit 2024-09-17T08:44:55.875285+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:44:56.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:56 smithi136 bash[24812]: cluster 2024-09-17T08:44:56.103094+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:58.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:57 smithi136 bash[24812]: audit 2024-09-17T08:44:56.897193+0000 mon.a (mon.0) 277 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T08:44:58.326 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:57 smithi078 bash[22670]: audit 2024-09-17T08:44:56.897193+0000 mon.a (mon.0) 277 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T08:44:58.326 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:57 smithi078 bash[32124]: audit 2024-09-17T08:44:56.897193+0000 mon.a (mon.0) 277 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T08:44:58.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.980+0000 7f821bfff640 1 -- 172.21.15.78:0/3823471475 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f822410cf80 con 0x7f821006cd80 2024-09-17T08:44:58.985 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 0 on host 'smithi078' 2024-09-17T08:44:58.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f821006cd80 msgr2=0x7f821006f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:58.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f821006cd80 0x7f821006f240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8224198a70 tx=0x7f820c00a4c0 comp rx=0 tx=0).stop 2024-09-17T08:44:58.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 msgr2=0x7f8224197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224197550 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f821c005e30 tx=0x7f821c030f50 comp rx=0 tx=0).stop 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 shutdown_connections 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f821006cd80 0x7f821006f240 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8224103c10 0x7f822419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8224103250 0x7f8224197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 --2- 172.21.15.78:0/3823471475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8224102050 0x7f8224197550 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 >> 172.21.15.78:0/3823471475 conn(0x7f82240fd7e0 msgr2=0x7f82240ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 shutdown_connections 2024-09-17T08:44:58.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:44:58.984+0000 7f822967a640 1 -- 172.21.15.78:0/3823471475 wait complete. 2024-09-17T08:44:59.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[22670]: audit 2024-09-17T08:44:57.885731+0000 mon.a (mon.0) 278 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T08:44:59.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[22670]: cluster 2024-09-17T08:44:57.885807+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-17T08:44:59.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[22670]: audit 2024-09-17T08:44:57.885964+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:44:59.184 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[22670]: audit 2024-09-17T08:44:57.887070+0000 mon.a (mon.0) 281 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:44:59.184 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[22670]: cluster 2024-09-17T08:44:58.103399+0000 mgr.y (mgr.14150) 109 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:59.184 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[32124]: audit 2024-09-17T08:44:57.885731+0000 mon.a (mon.0) 278 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T08:44:59.184 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[32124]: cluster 2024-09-17T08:44:57.885807+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-17T08:44:59.184 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[32124]: audit 2024-09-17T08:44:57.885964+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:44:59.184 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[32124]: audit 2024-09-17T08:44:57.887070+0000 mon.a (mon.0) 281 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:44:59.184 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:58 smithi078 bash[32124]: cluster 2024-09-17T08:44:58.103399+0000 mgr.y (mgr.14150) 109 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:59.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:58 smithi136 bash[24812]: audit 2024-09-17T08:44:57.885731+0000 mon.a (mon.0) 278 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T08:44:59.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:58 smithi136 bash[24812]: cluster 2024-09-17T08:44:57.885807+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-17T08:44:59.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:58 smithi136 bash[24812]: audit 2024-09-17T08:44:57.885964+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:44:59.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:58 smithi136 bash[24812]: audit 2024-09-17T08:44:57.887070+0000 mon.a (mon.0) 281 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:44:59.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:58 smithi136 bash[24812]: cluster 2024-09-17T08:44:58.103399+0000 mgr.y (mgr.14150) 109 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T08:44:59.592 DEBUG:teuthology.orchestra.run.smithi078:osd.0> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T08:44:59.595 INFO:tasks.cephadm:Deploying osd.1 on smithi078 with /dev/vg_nvme/lv_3... 2024-09-17T08:44:59.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-17T08:45:00.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:59 smithi136 bash[24812]: audit 2024-09-17T08:44:58.896750+0000 mon.a (mon.0) 282 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:45:00.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:59 smithi136 bash[24812]: cluster 2024-09-17T08:44:58.896884+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-17T08:45:00.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:59 smithi136 bash[24812]: audit 2024-09-17T08:44:58.897321+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:00.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:59 smithi136 bash[24812]: audit 2024-09-17T08:44:58.904244+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:00.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:59 smithi136 bash[24812]: audit 2024-09-17T08:44:58.973684+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:00.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:59 smithi136 bash[24812]: audit 2024-09-17T08:44:58.978295+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:00.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:44:59 smithi136 bash[24812]: audit 2024-09-17T08:44:58.982984+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[22670]: audit 2024-09-17T08:44:58.896750+0000 mon.a (mon.0) 282 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:45:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[22670]: cluster 2024-09-17T08:44:58.896884+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-17T08:45:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[22670]: audit 2024-09-17T08:44:58.897321+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[22670]: audit 2024-09-17T08:44:58.904244+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[22670]: audit 2024-09-17T08:44:58.973684+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[22670]: audit 2024-09-17T08:44:58.978295+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[22670]: audit 2024-09-17T08:44:58.982984+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[32124]: audit 2024-09-17T08:44:58.896750+0000 mon.a (mon.0) 282 : audit [INF] from='osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[32124]: cluster 2024-09-17T08:44:58.896884+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[32124]: audit 2024-09-17T08:44:58.897321+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[32124]: audit 2024-09-17T08:44:58.904244+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[32124]: audit 2024-09-17T08:44:58.973684+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[32124]: audit 2024-09-17T08:44:58.978295+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:00.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:44:59 smithi078 bash[32124]: audit 2024-09-17T08:44:58.982984+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:01.178 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:00 smithi136 bash[24812]: cluster 2024-09-17T08:44:57.869950+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:45:01.178 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:00 smithi136 bash[24812]: cluster 2024-09-17T08:44:57.870036+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:45:01.178 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:00 smithi136 bash[24812]: cluster 2024-09-17T08:44:59.896976+0000 mon.a (mon.0) 289 : cluster [INF] osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] boot 2024-09-17T08:45:01.178 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:00 smithi136 bash[24812]: cluster 2024-09-17T08:44:59.897105+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-17T08:45:01.178 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:00 smithi136 bash[24812]: audit 2024-09-17T08:44:59.897755+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:01.178 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:00 smithi136 bash[24812]: cluster 2024-09-17T08:45:00.103808+0000 mgr.y (mgr.14150) 110 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[22670]: cluster 2024-09-17T08:44:57.869950+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:45:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[22670]: cluster 2024-09-17T08:44:57.870036+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:45:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[22670]: cluster 2024-09-17T08:44:59.896976+0000 mon.a (mon.0) 289 : cluster [INF] osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] boot 2024-09-17T08:45:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[22670]: cluster 2024-09-17T08:44:59.897105+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-17T08:45:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[22670]: audit 2024-09-17T08:44:59.897755+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[22670]: cluster 2024-09-17T08:45:00.103808+0000 mgr.y (mgr.14150) 110 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:01.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[32124]: cluster 2024-09-17T08:44:57.869950+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:45:01.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[32124]: cluster 2024-09-17T08:44:57.870036+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:45:01.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[32124]: cluster 2024-09-17T08:44:59.896976+0000 mon.a (mon.0) 289 : cluster [INF] osd.0 [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] boot 2024-09-17T08:45:01.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[32124]: cluster 2024-09-17T08:44:59.897105+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-17T08:45:01.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[32124]: audit 2024-09-17T08:44:59.897755+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:45:01.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:00 smithi078 bash[32124]: cluster 2024-09-17T08:45:00.103808+0000 mgr.y (mgr.14150) 110 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:02.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:01 smithi136 bash[24812]: cluster 2024-09-17T08:45:00.915037+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-17T08:45:02.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:01 smithi078 bash[22670]: cluster 2024-09-17T08:45:00.915037+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-17T08:45:02.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:01 smithi078 bash[32124]: cluster 2024-09-17T08:45:00.915037+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-17T08:45:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:02 smithi136 bash[24812]: cluster 2024-09-17T08:45:02.104261+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:02 smithi078 bash[22670]: cluster 2024-09-17T08:45:02.104261+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:03.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:02 smithi078 bash[32124]: cluster 2024-09-17T08:45:02.104261+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:45:05.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:05 smithi078 bash[22670]: cluster 2024-09-17T08:45:04.104722+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:05.425 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:05 smithi078 bash[32124]: cluster 2024-09-17T08:45:04.104722+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:05.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:05 smithi136 bash[24812]: cluster 2024-09-17T08:45:04.104722+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:07.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:07 smithi136 bash[24812]: cluster 2024-09-17T08:45:06.105203+0000 mgr.y (mgr.14150) 113 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:07 smithi078 bash[22670]: cluster 2024-09-17T08:45:06.105203+0000 mgr.y (mgr.14150) 113 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:07 smithi078 bash[32124]: cluster 2024-09-17T08:45:06.105203+0000 mgr.y (mgr.14150) 113 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-17T08:45:08.559 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-17T08:45:08.577 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2024-09-17T08:45:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2024-09-17T08:45:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0155959 s, 672 MB/s 2024-09-17T08:45:08.577 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 2024-09-17T08:45:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2024-09-17T08:45:09.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_3 2024-09-17T08:45:09.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:09 smithi136 bash[24812]: cluster 2024-09-17T08:45:08.105519+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:09.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:09 smithi078 bash[22670]: cluster 2024-09-17T08:45:08.105519+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:09 smithi078 bash[32124]: cluster 2024-09-17T08:45:08.105519+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: cephadm 2024-09-17T08:45:09.851118+0000 mgr.y (mgr.14150) 115 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: audit 2024-09-17T08:45:09.858359+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: audit 2024-09-17T08:45:09.865570+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: audit 2024-09-17T08:45:09.867003+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: cephadm 2024-09-17T08:45:09.868014+0000 mgr.y (mgr.14150) 116 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 16241M 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: audit 2024-09-17T08:45:09.874322+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: audit 2024-09-17T08:45:09.876453+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: audit 2024-09-17T08:45:09.877961+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: audit 2024-09-17T08:45:09.885656+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:10 smithi136 bash[24812]: cluster 2024-09-17T08:45:10.105956+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:11.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: cephadm 2024-09-17T08:45:09.851118+0000 mgr.y (mgr.14150) 115 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:45:11.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: audit 2024-09-17T08:45:09.858359+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: audit 2024-09-17T08:45:09.865570+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: audit 2024-09-17T08:45:09.867003+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: cephadm 2024-09-17T08:45:09.868014+0000 mgr.y (mgr.14150) 116 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 16241M 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: audit 2024-09-17T08:45:09.874322+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: audit 2024-09-17T08:45:09.876453+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: audit 2024-09-17T08:45:09.877961+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: audit 2024-09-17T08:45:09.885656+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[22670]: cluster 2024-09-17T08:45:10.105956+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: cephadm 2024-09-17T08:45:09.851118+0000 mgr.y (mgr.14150) 115 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: audit 2024-09-17T08:45:09.858359+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: audit 2024-09-17T08:45:09.865570+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: audit 2024-09-17T08:45:09.867003+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:45:11.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: cephadm 2024-09-17T08:45:09.868014+0000 mgr.y (mgr.14150) 116 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 16241M 2024-09-17T08:45:11.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: audit 2024-09-17T08:45:09.874322+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: audit 2024-09-17T08:45:09.876453+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:11.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: audit 2024-09-17T08:45:09.877961+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:45:11.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: audit 2024-09-17T08:45:09.885656+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:11.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:10 smithi078 bash[32124]: cluster 2024-09-17T08:45:10.105956+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:13.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:13 smithi136 bash[24812]: cluster 2024-09-17T08:45:12.106433+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:13 smithi078 bash[22670]: cluster 2024-09-17T08:45:12.106433+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:13.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:13 smithi078 bash[32124]: cluster 2024-09-17T08:45:12.106433+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:13.967 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:45:15.348 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:15 smithi078 bash[32124]: cluster 2024-09-17T08:45:14.106922+0000 mgr.y (mgr.14150) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:15.348 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:15 smithi078 bash[22670]: cluster 2024-09-17T08:45:14.106922+0000 mgr.y (mgr.14150) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:15.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:15 smithi136 bash[24812]: cluster 2024-09-17T08:45:14.106922+0000 mgr.y (mgr.14150) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- 172.21.15.78:0/2425902715 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21900fe130 msgr2=0x7f21900fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:45:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 --2- 172.21.15.78:0/2425902715 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21900fe130 0x7f21900fe530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2180009ca0 tx=0x7f218002a8b0 comp rx=0 tx=0).stop 2024-09-17T08:45:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- 172.21.15.78:0/2425902715 shutdown_connections 2024-09-17T08:45:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 --2- 172.21.15.78:0/2425902715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2190101ad0 0x7f2190108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 --2- 172.21.15.78:0/2425902715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2190101110 0x7f2190101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 --2- 172.21.15.78:0/2425902715 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21900fe130 0x7f21900fe530 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- 172.21.15.78:0/2425902715 >> 172.21.15.78:0/2425902715 conn(0x7f21900f9ca0 msgr2=0x7f21900fc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- 172.21.15.78:0/2425902715 shutdown_connections 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- 172.21.15.78:0/2425902715 wait complete. 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 Processor -- start 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- start start 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900fe130 0x7f21901952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2190101110 0x7f2190195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2190101ad0 0x7f219019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219019cdd0 con 0x7f21900fe130 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219019cf40 con 0x7f2190101ad0 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219019d100 con 0x7f2190101110 2024-09-17T08:45:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2194956640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900fe130 0x7f21901952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2190101110 0x7f2190195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2194956640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900fe130 0x7f21901952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50360/0 (socket says 172.21.15.78:50360) 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2194956640 1 -- 172.21.15.78:0/102540064 learned_addr learned my addr 172.21.15.78:0/102540064 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2195157640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2190101ad0 0x7f219019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218ffff640 1 -- 172.21.15.78:0/102540064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2190101ad0 msgr2=0x7f219019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218ffff640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2190101ad0 0x7f219019c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218ffff640 1 -- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900fe130 msgr2=0x7f21901952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218ffff640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900fe130 0x7f21901952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218ffff640 1 -- 172.21.15.78:0/102540064 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184009490 con 0x7f2190101110 2024-09-17T08:45:16.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2195157640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2190101ad0 0x7f219019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:45:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2194956640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900fe130 0x7f21901952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:45:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218ffff640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2190101110 0x7f2190195810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f218400e9f0 tx=0x7f218400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:45:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218dffb640 1 -- 172.21.15.78:0/102540064 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218400cd80 con 0x7f2190101110 2024-09-17T08:45:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218dffb640 1 -- 172.21.15.78:0/102540064 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f2184004470 con 0x7f2190101110 2024-09-17T08:45:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2180009900 con 0x7f2190101110 2024-09-17T08:45:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f218dffb640 1 -- 172.21.15.78:0/102540064 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184003e00 con 0x7f2190101110 2024-09-17T08:45:16.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.840+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219019d7a0 con 0x7f2190101110 2024-09-17T08:45:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.844+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21900fe530 con 0x7f2190101110 2024-09-17T08:45:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.844+0000 7f218dffb640 1 -- 172.21.15.78:0/102540064 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7f2184003f60 con 0x7f2190101110 2024-09-17T08:45:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.844+0000 7f218dffb640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f217806cd80 0x7f217806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:45:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.844+0000 7f218dffb640 1 -- 172.21.15.78:0/102540064 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f2184014070 con 0x7f2190101110 2024-09-17T08:45:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.844+0000 7f2194956640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f217806cd80 0x7f217806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:45:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.844+0000 7f2194956640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f217806cd80 0x7f217806f240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2180000f80 tx=0x7f2180030540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:45:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:16.848+0000 7f218dffb640 1 -- 172.21.15.78:0/102540064 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2184056930 con 0x7f2190101110 2024-09-17T08:45:17.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:17.028+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f219010ae10 con 0x7f217806cd80 2024-09-17T08:45:17.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:17 smithi136 bash[24812]: cluster 2024-09-17T08:45:16.107511+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:17.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:17 smithi136 bash[24812]: audit 2024-09-17T08:45:17.038782+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:45:17.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:17 smithi136 bash[24812]: audit 2024-09-17T08:45:17.044135+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:45:17.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:17 smithi136 bash[24812]: audit 2024-09-17T08:45:17.045293+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:17.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[22670]: cluster 2024-09-17T08:45:16.107511+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:17.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[22670]: audit 2024-09-17T08:45:17.038782+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:45:17.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[22670]: audit 2024-09-17T08:45:17.044135+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:45:17.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[22670]: audit 2024-09-17T08:45:17.045293+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[32124]: cluster 2024-09-17T08:45:16.107511+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[32124]: audit 2024-09-17T08:45:17.038782+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:45:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[32124]: audit 2024-09-17T08:45:17.044135+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:45:17.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:17 smithi078 bash[32124]: audit 2024-09-17T08:45:17.045293+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:18.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:18 smithi136 bash[24812]: audit 2024-09-17T08:45:17.032812+0000 mgr.y (mgr.14150) 121 : audit [DBG] from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:45:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:18 smithi078 bash[22670]: audit 2024-09-17T08:45:17.032812+0000 mgr.y (mgr.14150) 121 : audit [DBG] from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:45:18.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:18 smithi078 bash[32124]: audit 2024-09-17T08:45:17.032812+0000 mgr.y (mgr.14150) 121 : audit [DBG] from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:45:19.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:19 smithi136 bash[24812]: cluster 2024-09-17T08:45:18.108004+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:19 smithi078 bash[22670]: cluster 2024-09-17T08:45:18.108004+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:19 smithi078 bash[32124]: cluster 2024-09-17T08:45:18.108004+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:21.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:21 smithi136 bash[24812]: cluster 2024-09-17T08:45:20.108452+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:21 smithi078 bash[22670]: cluster 2024-09-17T08:45:20.108452+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:21 smithi078 bash[32124]: cluster 2024-09-17T08:45:20.108452+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:23.296 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:23 smithi078 bash[22670]: cluster 2024-09-17T08:45:22.108927+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:23.297 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:23 smithi078 bash[32124]: cluster 2024-09-17T08:45:22.108927+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:23.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:23 smithi136 bash[24812]: cluster 2024-09-17T08:45:22.108927+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:25.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:25 smithi136 bash[24812]: cluster 2024-09-17T08:45:24.109402+0000 mgr.y (mgr.14150) 125 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:25.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:25 smithi078 bash[22670]: cluster 2024-09-17T08:45:24.109402+0000 mgr.y (mgr.14150) 125 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:25 smithi078 bash[32124]: cluster 2024-09-17T08:45:24.109402+0000 mgr.y (mgr.14150) 125 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:26 smithi136 bash[24812]: audit 2024-09-17T08:45:25.445727+0000 mon.c (mon.2) 5 : audit [INF] from='client.? 172.21.15.78:0/3478032665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]: dispatch 2024-09-17T08:45:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:26 smithi136 bash[24812]: audit 2024-09-17T08:45:25.446647+0000 mon.a (mon.0) 303 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]: dispatch 2024-09-17T08:45:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:26 smithi136 bash[24812]: audit 2024-09-17T08:45:25.453129+0000 mon.a (mon.0) 304 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]': finished 2024-09-17T08:45:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:26 smithi136 bash[24812]: cluster 2024-09-17T08:45:25.453178+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-17T08:45:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:26 smithi136 bash[24812]: audit 2024-09-17T08:45:25.453289+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:26.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:26 smithi136 bash[24812]: audit 2024-09-17T08:45:26.094694+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.78:0/3420087121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:45:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[22670]: audit 2024-09-17T08:45:25.445727+0000 mon.c (mon.2) 5 : audit [INF] from='client.? 172.21.15.78:0/3478032665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]: dispatch 2024-09-17T08:45:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[22670]: audit 2024-09-17T08:45:25.446647+0000 mon.a (mon.0) 303 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]: dispatch 2024-09-17T08:45:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[22670]: audit 2024-09-17T08:45:25.453129+0000 mon.a (mon.0) 304 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]': finished 2024-09-17T08:45:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[22670]: cluster 2024-09-17T08:45:25.453178+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-17T08:45:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[22670]: audit 2024-09-17T08:45:25.453289+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[22670]: audit 2024-09-17T08:45:26.094694+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.78:0/3420087121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:45:26.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[32124]: audit 2024-09-17T08:45:25.445727+0000 mon.c (mon.2) 5 : audit [INF] from='client.? 172.21.15.78:0/3478032665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]: dispatch 2024-09-17T08:45:26.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[32124]: audit 2024-09-17T08:45:25.446647+0000 mon.a (mon.0) 303 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]: dispatch 2024-09-17T08:45:26.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[32124]: audit 2024-09-17T08:45:25.453129+0000 mon.a (mon.0) 304 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df02033a-c192-474c-8e90-ad746ec2147c"}]': finished 2024-09-17T08:45:26.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[32124]: cluster 2024-09-17T08:45:25.453178+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-17T08:45:26.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[32124]: audit 2024-09-17T08:45:25.453289+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:26.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:26 smithi078 bash[32124]: audit 2024-09-17T08:45:26.094694+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.78:0/3420087121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:45:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:27 smithi136 bash[24812]: cluster 2024-09-17T08:45:26.109810+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:27.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:27 smithi078 bash[22670]: cluster 2024-09-17T08:45:26.109810+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:27.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:27 smithi078 bash[32124]: cluster 2024-09-17T08:45:26.109810+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:29.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:29 smithi136 bash[24812]: cluster 2024-09-17T08:45:28.110238+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:29 smithi078 bash[22670]: cluster 2024-09-17T08:45:28.110238+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:29 smithi078 bash[32124]: cluster 2024-09-17T08:45:28.110238+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:31.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:31 smithi136 bash[24812]: cluster 2024-09-17T08:45:30.110712+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:31 smithi078 bash[22670]: cluster 2024-09-17T08:45:30.110712+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:31 smithi078 bash[32124]: cluster 2024-09-17T08:45:30.110712+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:33.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:33 smithi136 bash[24812]: cluster 2024-09-17T08:45:32.111041+0000 mgr.y (mgr.14150) 129 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:33 smithi078 bash[22670]: cluster 2024-09-17T08:45:32.111041+0000 mgr.y (mgr.14150) 129 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:33.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:33 smithi078 bash[32124]: cluster 2024-09-17T08:45:32.111041+0000 mgr.y (mgr.14150) 129 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:35.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:35 smithi078 bash[22670]: cluster 2024-09-17T08:45:34.111474+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:35.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:35 smithi078 bash[32124]: cluster 2024-09-17T08:45:34.111474+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:35.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:35 smithi136 bash[24812]: cluster 2024-09-17T08:45:34.111474+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:37.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:37 smithi078 bash[32124]: cluster 2024-09-17T08:45:36.111938+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:37 smithi078 bash[22670]: cluster 2024-09-17T08:45:36.111938+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:37.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:37 smithi136 bash[24812]: cluster 2024-09-17T08:45:36.111938+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:38.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:38 smithi078 bash[22670]: audit 2024-09-17T08:45:37.712774+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T08:45:38.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:38 smithi078 bash[22670]: audit 2024-09-17T08:45:37.714386+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:38.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:38 smithi078 bash[32124]: audit 2024-09-17T08:45:37.712774+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T08:45:38.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:38 smithi078 bash[32124]: audit 2024-09-17T08:45:37.714386+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:38.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:38 smithi136 bash[24812]: audit 2024-09-17T08:45:37.712774+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T08:45:38.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:38 smithi136 bash[24812]: audit 2024-09-17T08:45:37.714386+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:39 smithi078 bash[22670]: cephadm 2024-09-17T08:45:37.715677+0000 mgr.y (mgr.14150) 132 : cephadm [INF] Deploying daemon osd.1 on smithi078 2024-09-17T08:45:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:39 smithi078 bash[22670]: cluster 2024-09-17T08:45:38.112424+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:39 smithi078 bash[32124]: cephadm 2024-09-17T08:45:37.715677+0000 mgr.y (mgr.14150) 132 : cephadm [INF] Deploying daemon osd.1 on smithi078 2024-09-17T08:45:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:39 smithi078 bash[32124]: cluster 2024-09-17T08:45:38.112424+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:39.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:39 smithi136 bash[24812]: cephadm 2024-09-17T08:45:37.715677+0000 mgr.y (mgr.14150) 132 : cephadm [INF] Deploying daemon osd.1 on smithi078 2024-09-17T08:45:39.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:39 smithi136 bash[24812]: cluster 2024-09-17T08:45:38.112424+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:41.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:41 smithi078 bash[22670]: cluster 2024-09-17T08:45:40.112890+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:41.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:41 smithi078 bash[32124]: cluster 2024-09-17T08:45:40.112890+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:41.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:41 smithi136 bash[24812]: cluster 2024-09-17T08:45:40.112890+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:42.141 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:42.142 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:42.142 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:42.142 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:42.492 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:42.492 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:42.493 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:42.493 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:45:42 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:45:43.491 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[22670]: cluster 2024-09-17T08:45:42.113232+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:43.491 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[22670]: audit 2024-09-17T08:45:42.418880+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:43.491 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[22670]: audit 2024-09-17T08:45:42.424820+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:43.491 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[22670]: audit 2024-09-17T08:45:42.431162+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:43.492 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[32124]: cluster 2024-09-17T08:45:42.113232+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:43.492 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[32124]: audit 2024-09-17T08:45:42.418880+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:43.492 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[32124]: audit 2024-09-17T08:45:42.424820+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:43.492 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:43 smithi078 bash[32124]: audit 2024-09-17T08:45:42.431162+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:43.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:43 smithi136 bash[24812]: cluster 2024-09-17T08:45:42.113232+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:43.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:43 smithi136 bash[24812]: audit 2024-09-17T08:45:42.418880+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:43.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:43 smithi136 bash[24812]: audit 2024-09-17T08:45:42.424820+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:43.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:43 smithi136 bash[24812]: audit 2024-09-17T08:45:42.431162+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:45.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:45 smithi136 bash[24812]: cluster 2024-09-17T08:45:44.113670+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:45 smithi078 bash[22670]: cluster 2024-09-17T08:45:44.113670+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:45 smithi078 bash[32124]: cluster 2024-09-17T08:45:44.113670+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:47.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:47 smithi136 bash[24812]: cluster 2024-09-17T08:45:46.114139+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:47.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:47 smithi078 bash[22670]: cluster 2024-09-17T08:45:46.114139+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:47.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:47 smithi078 bash[32124]: cluster 2024-09-17T08:45:46.114139+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[22670]: audit 2024-09-17T08:45:47.536367+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[22670]: audit 2024-09-17T08:45:47.540170+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[22670]: audit 2024-09-17T08:45:47.540942+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[22670]: audit 2024-09-17T08:45:47.541629+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[22670]: audit 2024-09-17T08:45:47.546084+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[22670]: cluster 2024-09-17T08:45:48.114724+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[32124]: audit 2024-09-17T08:45:47.536367+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[32124]: audit 2024-09-17T08:45:47.540170+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[32124]: audit 2024-09-17T08:45:47.540942+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:48.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[32124]: audit 2024-09-17T08:45:47.541629+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:45:48.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[32124]: audit 2024-09-17T08:45:47.546084+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:48 smithi078 bash[32124]: cluster 2024-09-17T08:45:48.114724+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:48.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:48 smithi136 bash[24812]: audit 2024-09-17T08:45:47.536367+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:48 smithi136 bash[24812]: audit 2024-09-17T08:45:47.540170+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:48 smithi136 bash[24812]: audit 2024-09-17T08:45:47.540942+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:45:48.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:48 smithi136 bash[24812]: audit 2024-09-17T08:45:47.541629+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:45:48.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:48 smithi136 bash[24812]: audit 2024-09-17T08:45:47.546084+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:48.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:48 smithi136 bash[24812]: cluster 2024-09-17T08:45:48.114724+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:49.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:49 smithi078 bash[22670]: audit 2024-09-17T08:45:48.981457+0000 mon.a (mon.0) 317 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T08:45:49.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:49 smithi078 bash[32124]: audit 2024-09-17T08:45:48.981457+0000 mon.a (mon.0) 317 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T08:45:50.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:49 smithi136 bash[24812]: audit 2024-09-17T08:45:48.981457+0000 mon.a (mon.0) 317 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T08:45:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[22670]: audit 2024-09-17T08:45:49.561754+0000 mon.a (mon.0) 318 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T08:45:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[22670]: cluster 2024-09-17T08:45:49.561871+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-17T08:45:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[22670]: audit 2024-09-17T08:45:49.562142+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[22670]: audit 2024-09-17T08:45:49.563040+0000 mon.a (mon.0) 321 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:45:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[22670]: cluster 2024-09-17T08:45:50.115199+0000 mgr.y (mgr.14150) 139 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:50.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[32124]: audit 2024-09-17T08:45:49.561754+0000 mon.a (mon.0) 318 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T08:45:50.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[32124]: cluster 2024-09-17T08:45:49.561871+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-17T08:45:50.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[32124]: audit 2024-09-17T08:45:49.562142+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:50.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[32124]: audit 2024-09-17T08:45:49.563040+0000 mon.a (mon.0) 321 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:45:50.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:50 smithi078 bash[32124]: cluster 2024-09-17T08:45:50.115199+0000 mgr.y (mgr.14150) 139 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:51.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:50 smithi136 bash[24812]: audit 2024-09-17T08:45:49.561754+0000 mon.a (mon.0) 318 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T08:45:51.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:50 smithi136 bash[24812]: cluster 2024-09-17T08:45:49.561871+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-17T08:45:51.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:50 smithi136 bash[24812]: audit 2024-09-17T08:45:49.562142+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:51.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:50 smithi136 bash[24812]: audit 2024-09-17T08:45:49.563040+0000 mon.a (mon.0) 321 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:45:51.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:50 smithi136 bash[24812]: cluster 2024-09-17T08:45:50.115199+0000 mgr.y (mgr.14150) 139 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:51.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.360+0000 7f218dffb640 1 -- 172.21.15.78:0/102540064 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f219010ae10 con 0x7f217806cd80 2024-09-17T08:45:51.363 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 1 on host 'smithi078' 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f217806cd80 msgr2=0x7f217806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f217806cd80 0x7f217806f240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2180000f80 tx=0x7f2180030540 comp rx=0 tx=0).stop 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2190101110 msgr2=0x7f2190195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2190101110 0x7f2190195810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f218400e9f0 tx=0x7f218400eeb0 comp rx=0 tx=0).stop 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 shutdown_connections 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f217806cd80 0x7f217806f240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2190101ad0 0x7f219019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2190101110 0x7f2190195810 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 --2- 172.21.15.78:0/102540064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900fe130 0x7f21901952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:45:51.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 >> 172.21.15.78:0/102540064 conn(0x7f21900f9ca0 msgr2=0x7f21900fb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:45:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 shutdown_connections 2024-09-17T08:45:51.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:45:51.364+0000 7f2196bba640 1 -- 172.21.15.78:0/102540064 wait complete. 2024-09-17T08:45:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: audit 2024-09-17T08:45:50.561374+0000 mon.a (mon.0) 322 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: cluster 2024-09-17T08:45:50.561443+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: audit 2024-09-17T08:45:50.561918+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: audit 2024-09-17T08:45:50.565898+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: audit 2024-09-17T08:45:51.343961+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: audit 2024-09-17T08:45:51.351447+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: audit 2024-09-17T08:45:51.359935+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[22670]: audit 2024-09-17T08:45:51.566149+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:51.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: audit 2024-09-17T08:45:50.561374+0000 mon.a (mon.0) 322 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:45:51.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: cluster 2024-09-17T08:45:50.561443+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-17T08:45:51.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: audit 2024-09-17T08:45:50.561918+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:51.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: audit 2024-09-17T08:45:50.565898+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:51.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: audit 2024-09-17T08:45:51.343961+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:51.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: audit 2024-09-17T08:45:51.351447+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:51.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: audit 2024-09-17T08:45:51.359935+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:51.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:51 smithi078 bash[32124]: audit 2024-09-17T08:45:51.566149+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:52.027 DEBUG:teuthology.orchestra.run.smithi078:osd.1> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T08:45:52.029 INFO:tasks.cephadm:Deploying osd.2 on smithi078 with /dev/vg_nvme/lv_2... 2024-09-17T08:45:52.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-17T08:45:52.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: audit 2024-09-17T08:45:50.561374+0000 mon.a (mon.0) 322 : audit [INF] from='osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:45:52.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: cluster 2024-09-17T08:45:50.561443+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-17T08:45:52.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: audit 2024-09-17T08:45:50.561918+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:52.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: audit 2024-09-17T08:45:50.565898+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:52.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: audit 2024-09-17T08:45:51.343961+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:45:52.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: audit 2024-09-17T08:45:51.351447+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:52.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: audit 2024-09-17T08:45:51.359935+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:45:52.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:51 smithi136 bash[24812]: audit 2024-09-17T08:45:51.566149+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[32124]: cluster 2024-09-17T08:45:50.021519+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[32124]: cluster 2024-09-17T08:45:50.021650+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[32124]: cluster 2024-09-17T08:45:51.572842+0000 mon.a (mon.0) 330 : cluster [INF] osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] boot 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[32124]: cluster 2024-09-17T08:45:51.572881+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[32124]: audit 2024-09-17T08:45:51.573268+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[32124]: cluster 2024-09-17T08:45:52.115635+0000 mgr.y (mgr.14150) 140 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[22670]: cluster 2024-09-17T08:45:50.021519+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:45:52.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[22670]: cluster 2024-09-17T08:45:50.021650+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:45:52.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[22670]: cluster 2024-09-17T08:45:51.572842+0000 mon.a (mon.0) 330 : cluster [INF] osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] boot 2024-09-17T08:45:52.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[22670]: cluster 2024-09-17T08:45:51.572881+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-17T08:45:52.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[22670]: audit 2024-09-17T08:45:51.573268+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:52.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:52 smithi078 bash[22670]: cluster 2024-09-17T08:45:52.115635+0000 mgr.y (mgr.14150) 140 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:53.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:52 smithi136 bash[24812]: cluster 2024-09-17T08:45:50.021519+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:45:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:52 smithi136 bash[24812]: cluster 2024-09-17T08:45:50.021650+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:45:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:52 smithi136 bash[24812]: cluster 2024-09-17T08:45:51.572842+0000 mon.a (mon.0) 330 : cluster [INF] osd.1 [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] boot 2024-09-17T08:45:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:52 smithi136 bash[24812]: cluster 2024-09-17T08:45:51.572881+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-17T08:45:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:52 smithi136 bash[24812]: audit 2024-09-17T08:45:51.573268+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:45:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:52 smithi136 bash[24812]: cluster 2024-09-17T08:45:52.115635+0000 mgr.y (mgr.14150) 140 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T08:45:53.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:53 smithi078 bash[32124]: cluster 2024-09-17T08:45:52.589710+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-17T08:45:53.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:53 smithi078 bash[22670]: cluster 2024-09-17T08:45:52.589710+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-17T08:45:54.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:53 smithi136 bash[24812]: cluster 2024-09-17T08:45:52.589710+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-17T08:45:54.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:54 smithi078 bash[32124]: cluster 2024-09-17T08:45:54.116099+0000 mgr.y (mgr.14150) 141 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:54.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:54 smithi078 bash[22670]: cluster 2024-09-17T08:45:54.116099+0000 mgr.y (mgr.14150) 141 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:55.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:54 smithi136 bash[24812]: cluster 2024-09-17T08:45:54.116099+0000 mgr.y (mgr.14150) 141 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:56.190 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:45:57.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:57 smithi136 bash[24812]: cluster 2024-09-17T08:45:56.116620+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:57 smithi078 bash[22670]: cluster 2024-09-17T08:45:56.116620+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:57 smithi078 bash[32124]: cluster 2024-09-17T08:45:56.116620+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:59.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:45:59 smithi136 bash[24812]: cluster 2024-09-17T08:45:58.117128+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:45:59 smithi078 bash[32124]: cluster 2024-09-17T08:45:58.117128+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:45:59.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:45:59 smithi078 bash[22670]: cluster 2024-09-17T08:45:58.117128+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:00.960 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-17T08:46:01.153 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-17T08:46:01.169 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2024-09-17T08:46:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2024-09-17T08:46:01.169 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0140264 s, 748 MB/s 2024-09-17T08:46:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2024-09-17T08:46:01.478 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:01 smithi078 bash[22670]: cluster 2024-09-17T08:46:00.117486+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:01.480 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:01 smithi078 bash[32124]: cluster 2024-09-17T08:46:00.117486+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:01.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:01 smithi136 bash[24812]: cluster 2024-09-17T08:46:00.117486+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:02.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_2 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: cluster 2024-09-17T08:46:02.117908+0000 mgr.y (mgr.14150) 145 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: cephadm 2024-09-17T08:46:02.425024+0000 mgr.y (mgr.14150) 146 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.433795+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.442510+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.444738+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.446597+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.455926+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.458188+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.459732+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:03.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:03 smithi136 bash[24812]: audit 2024-09-17T08:46:02.468403+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: cluster 2024-09-17T08:46:02.117908+0000 mgr.y (mgr.14150) 145 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: cephadm 2024-09-17T08:46:02.425024+0000 mgr.y (mgr.14150) 146 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.433795+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.442510+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.444738+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.446597+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.455926+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.458188+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.459732+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[22670]: audit 2024-09-17T08:46:02.468403+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: cluster 2024-09-17T08:46:02.117908+0000 mgr.y (mgr.14150) 145 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: cephadm 2024-09-17T08:46:02.425024+0000 mgr.y (mgr.14150) 146 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.433795+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.442510+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.444738+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.446597+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.455926+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.458188+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.459732+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:03 smithi078 bash[32124]: audit 2024-09-17T08:46:02.468403+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:04.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:04 smithi136 bash[24812]: cephadm 2024-09-17T08:46:02.447836+0000 mgr.y (mgr.14150) 147 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 8120M 2024-09-17T08:46:04.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:04 smithi136 bash[24812]: cluster 2024-09-17T08:46:04.118363+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:04.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:04 smithi078 bash[22670]: cephadm 2024-09-17T08:46:02.447836+0000 mgr.y (mgr.14150) 147 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 8120M 2024-09-17T08:46:04.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:04 smithi078 bash[22670]: cluster 2024-09-17T08:46:04.118363+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:04.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:04 smithi078 bash[32124]: cephadm 2024-09-17T08:46:02.447836+0000 mgr.y (mgr.14150) 147 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 8120M 2024-09-17T08:46:04.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:04 smithi078 bash[32124]: cluster 2024-09-17T08:46:04.118363+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:06.716 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:46:07.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:07 smithi136 bash[24812]: cluster 2024-09-17T08:46:06.118825+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:07 smithi078 bash[22670]: cluster 2024-09-17T08:46:06.118825+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:07 smithi078 bash[32124]: cluster 2024-09-17T08:46:06.118825+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:09.446 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:09 smithi078 bash[22670]: cluster 2024-09-17T08:46:08.119253+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:09.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:09 smithi078 bash[32124]: cluster 2024-09-17T08:46:08.119253+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:09.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:09 smithi136 bash[24812]: cluster 2024-09-17T08:46:08.119253+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:09.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- 172.21.15.78:0/3072782241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 msgr2=0x7f41d41055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:46:09.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/3072782241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 0x7f41d41055f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009900 tx=0x7f41c802a3f0 comp rx=0 tx=0).stop 2024-09-17T08:46:09.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- 172.21.15.78:0/3072782241 shutdown_connections 2024-09-17T08:46:09.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/3072782241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41d4105b30 0x7f41d4107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:09.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/3072782241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 0x7f41d41055f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:09.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/3072782241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41d41008d0 0x7f41d4102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:09.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- 172.21.15.78:0/3072782241 >> 172.21.15.78:0/3072782241 conn(0x7f41d40fa4d0 msgr2=0x7f41d40fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:46:09.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- 172.21.15.78:0/3072782241 shutdown_connections 2024-09-17T08:46:09.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- 172.21.15.78:0/3072782241 wait complete. 2024-09-17T08:46:09.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 Processor -- start 2024-09-17T08:46:09.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- start start 2024-09-17T08:46:09.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41d41008d0 0x7f41d4197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 0x7f41d4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41d4105b30 0x7f41d419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d419f010 con 0x7f41d4105b30 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d419f180 con 0x7f41d41008d0 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.600+0000 7f41d8d7e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d419f340 con 0x7f41d4103200 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d1d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 0x7f41d4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41d4105b30 0x7f41d419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d1d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 0x7f41d4197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:56588/0 (socket says 172.21.15.78:56588) 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d1d9b640 1 -- 172.21.15.78:0/4202075717 learned_addr learned my addr 172.21.15.78:0/4202075717 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d259c640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41d41008d0 0x7f41d4197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d2d9d640 1 -- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 msgr2=0x7f41d4197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:46:09.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d2d9d640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 0x7f41d4197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d2d9d640 1 -- 172.21.15.78:0/4202075717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41d41008d0 msgr2=0x7f41d4197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d2d9d640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41d41008d0 0x7f41d4197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d2d9d640 1 -- 172.21.15.78:0/4202075717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc009840 con 0x7f41d4105b30 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d2d9d640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41d4105b30 0x7f41d419ead0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00ec50 tx=0x7f41cc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41c37fe640 1 -- 172.21.15.78:0/4202075717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc003b70 con 0x7f41d4105b30 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41c37fe640 1 -- 172.21.15.78:0/4202075717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f41cc00ce70 con 0x7f41d4105b30 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c8009560 con 0x7f41d4105b30 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41c37fe640 1 -- 172.21.15.78:0/4202075717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc010690 con 0x7f41d4105b30 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d419f940 con 0x7f41d4105b30 2024-09-17T08:46:09.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d41035e0 con 0x7f41d4105b30 2024-09-17T08:46:09.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41c37fe640 1 -- 172.21.15.78:0/4202075717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7f41cc004020 con 0x7f41d4105b30 2024-09-17T08:46:09.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41c37fe640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f41bc06cd80 0x7f41bc06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:46:09.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41c37fe640 1 -- 172.21.15.78:0/4202075717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2199+0+0 (secure 0 0 0) 0x7f41cc014070 con 0x7f41d4105b30 2024-09-17T08:46:09.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d259c640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f41bc06cd80 0x7f41bc06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:46:09.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.604+0000 7f41d259c640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f41bc06cd80 0x7f41bc06f240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41c4005fd0 tx=0x7f41c4005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:46:09.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.608+0000 7f41c37fe640 1 -- 172.21.15.78:0/4202075717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f41cc056c40 con 0x7f41d4105b30 2024-09-17T08:46:09.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:09.788+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f41d410ae30 con 0x7f41bc06cd80 2024-09-17T08:46:10.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:10 smithi136 bash[24812]: audit 2024-09-17T08:46:09.799693+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:46:10.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:10 smithi136 bash[24812]: audit 2024-09-17T08:46:09.803543+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:46:10.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:10 smithi136 bash[24812]: audit 2024-09-17T08:46:09.804913+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:10 smithi078 bash[32124]: audit 2024-09-17T08:46:09.799693+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:46:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:10 smithi078 bash[32124]: audit 2024-09-17T08:46:09.803543+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:46:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:10 smithi078 bash[32124]: audit 2024-09-17T08:46:09.804913+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:10 smithi078 bash[22670]: audit 2024-09-17T08:46:09.799693+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:46:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:10 smithi078 bash[22670]: audit 2024-09-17T08:46:09.803543+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:46:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:10 smithi078 bash[22670]: audit 2024-09-17T08:46:09.804913+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:11.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:11 smithi136 bash[24812]: audit 2024-09-17T08:46:09.793780+0000 mgr.y (mgr.14150) 151 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:46:11.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:11 smithi136 bash[24812]: cluster 2024-09-17T08:46:10.119626+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:11 smithi078 bash[32124]: audit 2024-09-17T08:46:09.793780+0000 mgr.y (mgr.14150) 151 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:46:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:11 smithi078 bash[32124]: cluster 2024-09-17T08:46:10.119626+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:11 smithi078 bash[22670]: audit 2024-09-17T08:46:09.793780+0000 mgr.y (mgr.14150) 151 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:46:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:11 smithi078 bash[22670]: cluster 2024-09-17T08:46:10.119626+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:13.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:13 smithi136 bash[24812]: cluster 2024-09-17T08:46:12.119951+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:13 smithi078 bash[22670]: cluster 2024-09-17T08:46:12.119951+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:13.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:13 smithi078 bash[32124]: cluster 2024-09-17T08:46:12.119951+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:15.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:15 smithi136 bash[24812]: cluster 2024-09-17T08:46:14.120316+0000 mgr.y (mgr.14150) 154 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:15.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:15 smithi078 bash[22670]: cluster 2024-09-17T08:46:14.120316+0000 mgr.y (mgr.14150) 154 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:15.569 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:15 smithi078 bash[32124]: cluster 2024-09-17T08:46:14.120316+0000 mgr.y (mgr.14150) 154 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:17.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:17 smithi136 bash[24812]: cluster 2024-09-17T08:46:16.120847+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:17 smithi078 bash[22670]: cluster 2024-09-17T08:46:16.120847+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:17 smithi078 bash[32124]: cluster 2024-09-17T08:46:16.120847+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:18.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:18 smithi136 bash[24812]: audit 2024-09-17T08:46:18.002616+0000 mon.a (mon.0) 345 : audit [INF] from='client.? 172.21.15.78:0/4000560018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40d1111b-74f6-4d54-a1ab-d64ba1a626d8"}]: dispatch 2024-09-17T08:46:18.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:18 smithi136 bash[24812]: audit 2024-09-17T08:46:18.007517+0000 mon.a (mon.0) 346 : audit [INF] from='client.? 172.21.15.78:0/4000560018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d1111b-74f6-4d54-a1ab-d64ba1a626d8"}]': finished 2024-09-17T08:46:18.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:18 smithi136 bash[24812]: cluster 2024-09-17T08:46:18.007553+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-17T08:46:18.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:18 smithi136 bash[24812]: audit 2024-09-17T08:46:18.007779+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[32124]: audit 2024-09-17T08:46:18.002616+0000 mon.a (mon.0) 345 : audit [INF] from='client.? 172.21.15.78:0/4000560018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40d1111b-74f6-4d54-a1ab-d64ba1a626d8"}]: dispatch 2024-09-17T08:46:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[32124]: audit 2024-09-17T08:46:18.007517+0000 mon.a (mon.0) 346 : audit [INF] from='client.? 172.21.15.78:0/4000560018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d1111b-74f6-4d54-a1ab-d64ba1a626d8"}]': finished 2024-09-17T08:46:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[32124]: cluster 2024-09-17T08:46:18.007553+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-17T08:46:18.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[32124]: audit 2024-09-17T08:46:18.007779+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[22670]: audit 2024-09-17T08:46:18.002616+0000 mon.a (mon.0) 345 : audit [INF] from='client.? 172.21.15.78:0/4000560018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40d1111b-74f6-4d54-a1ab-d64ba1a626d8"}]: dispatch 2024-09-17T08:46:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[22670]: audit 2024-09-17T08:46:18.007517+0000 mon.a (mon.0) 346 : audit [INF] from='client.? 172.21.15.78:0/4000560018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d1111b-74f6-4d54-a1ab-d64ba1a626d8"}]': finished 2024-09-17T08:46:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[22670]: cluster 2024-09-17T08:46:18.007553+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-17T08:46:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:18 smithi078 bash[22670]: audit 2024-09-17T08:46:18.007779+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:19.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:19 smithi136 bash[24812]: cluster 2024-09-17T08:46:18.121393+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:19.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:19 smithi136 bash[24812]: audit 2024-09-17T08:46:18.676102+0000 mon.a (mon.0) 349 : audit [DBG] from='client.? 172.21.15.78:0/766272918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:46:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:19 smithi078 bash[22670]: cluster 2024-09-17T08:46:18.121393+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:19 smithi078 bash[22670]: audit 2024-09-17T08:46:18.676102+0000 mon.a (mon.0) 349 : audit [DBG] from='client.? 172.21.15.78:0/766272918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:46:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:19 smithi078 bash[32124]: cluster 2024-09-17T08:46:18.121393+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:19 smithi078 bash[32124]: audit 2024-09-17T08:46:18.676102+0000 mon.a (mon.0) 349 : audit [DBG] from='client.? 172.21.15.78:0/766272918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:46:21.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:21 smithi136 bash[24812]: cluster 2024-09-17T08:46:20.121978+0000 mgr.y (mgr.14150) 157 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:21 smithi078 bash[22670]: cluster 2024-09-17T08:46:20.121978+0000 mgr.y (mgr.14150) 157 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:21 smithi078 bash[32124]: cluster 2024-09-17T08:46:20.121978+0000 mgr.y (mgr.14150) 157 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:23.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:23 smithi136 bash[24812]: cluster 2024-09-17T08:46:22.122577+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:23.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:23 smithi078 bash[22670]: cluster 2024-09-17T08:46:22.122577+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:23.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:23 smithi078 bash[32124]: cluster 2024-09-17T08:46:22.122577+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:25.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:25 smithi136 bash[24812]: cluster 2024-09-17T08:46:24.123088+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:25 smithi078 bash[22670]: cluster 2024-09-17T08:46:24.123088+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:25 smithi078 bash[32124]: cluster 2024-09-17T08:46:24.123088+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:27 smithi136 bash[24812]: cluster 2024-09-17T08:46:26.123596+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:27.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:27 smithi078 bash[22670]: cluster 2024-09-17T08:46:26.123596+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:27 smithi078 bash[32124]: cluster 2024-09-17T08:46:26.123596+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:29.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:29 smithi078 bash[22670]: cluster 2024-09-17T08:46:28.124111+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:29.485 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:29 smithi078 bash[32124]: cluster 2024-09-17T08:46:28.124111+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:29.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:29 smithi136 bash[24812]: cluster 2024-09-17T08:46:28.124111+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:31.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:31 smithi136 bash[24812]: cluster 2024-09-17T08:46:30.124684+0000 mgr.y (mgr.14150) 162 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:31.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:31 smithi136 bash[24812]: audit 2024-09-17T08:46:30.533762+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T08:46:31.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:31 smithi136 bash[24812]: audit 2024-09-17T08:46:30.535341+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:31 smithi078 bash[22670]: cluster 2024-09-17T08:46:30.124684+0000 mgr.y (mgr.14150) 162 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:31 smithi078 bash[22670]: audit 2024-09-17T08:46:30.533762+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T08:46:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:31 smithi078 bash[22670]: audit 2024-09-17T08:46:30.535341+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:31 smithi078 bash[32124]: cluster 2024-09-17T08:46:30.124684+0000 mgr.y (mgr.14150) 162 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:31 smithi078 bash[32124]: audit 2024-09-17T08:46:30.533762+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T08:46:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:31 smithi078 bash[32124]: audit 2024-09-17T08:46:30.535341+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:32.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:32 smithi136 bash[24812]: cephadm 2024-09-17T08:46:30.536695+0000 mgr.y (mgr.14150) 163 : cephadm [INF] Deploying daemon osd.2 on smithi078 2024-09-17T08:46:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:32 smithi078 bash[32124]: cephadm 2024-09-17T08:46:30.536695+0000 mgr.y (mgr.14150) 163 : cephadm [INF] Deploying daemon osd.2 on smithi078 2024-09-17T08:46:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:32 smithi078 bash[22670]: cephadm 2024-09-17T08:46:30.536695+0000 mgr.y (mgr.14150) 163 : cephadm [INF] Deploying daemon osd.2 on smithi078 2024-09-17T08:46:33.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:33 smithi136 bash[24812]: cluster 2024-09-17T08:46:32.125168+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:33 smithi078 bash[22670]: cluster 2024-09-17T08:46:32.125168+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:33 smithi078 bash[32124]: cluster 2024-09-17T08:46:32.125168+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:35.048 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:46:34 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.048 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:34 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.049 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:46:34 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.049 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:34 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.049 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:46:34 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:46:35 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:35 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:35 smithi078 bash[22670]: cluster 2024-09-17T08:46:34.125627+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:35.354 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:46:35 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.354 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:46:35 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:35 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:46:35.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:35 smithi078 bash[32124]: cluster 2024-09-17T08:46:34.125627+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:35.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:35 smithi136 bash[24812]: cluster 2024-09-17T08:46:34.125627+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:36.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:36 smithi136 bash[24812]: audit 2024-09-17T08:46:35.322127+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:46:36.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:36 smithi136 bash[24812]: audit 2024-09-17T08:46:35.327925+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:36.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:36 smithi136 bash[24812]: audit 2024-09-17T08:46:35.334490+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:36 smithi078 bash[32124]: audit 2024-09-17T08:46:35.322127+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:46:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:36 smithi078 bash[32124]: audit 2024-09-17T08:46:35.327925+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:36 smithi078 bash[32124]: audit 2024-09-17T08:46:35.334490+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:36.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:36 smithi078 bash[22670]: audit 2024-09-17T08:46:35.322127+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:46:36.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:36 smithi078 bash[22670]: audit 2024-09-17T08:46:35.327925+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:36.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:36 smithi078 bash[22670]: audit 2024-09-17T08:46:35.334490+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:37.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:37 smithi078 bash[32124]: cluster 2024-09-17T08:46:36.126117+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:37.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:37 smithi078 bash[22670]: cluster 2024-09-17T08:46:36.126117+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:37 smithi136 bash[24812]: cluster 2024-09-17T08:46:36.126117+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:39.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:39 smithi078 bash[22670]: cluster 2024-09-17T08:46:38.126638+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:39.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:39 smithi078 bash[32124]: cluster 2024-09-17T08:46:38.126638+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:39.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:39 smithi136 bash[24812]: cluster 2024-09-17T08:46:38.126638+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:41.478 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[22670]: cluster 2024-09-17T08:46:40.127138+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:41.478 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[22670]: audit 2024-09-17T08:46:40.472596+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.478 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[22670]: audit 2024-09-17T08:46:40.478724+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[22670]: audit 2024-09-17T08:46:40.893925+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[22670]: audit 2024-09-17T08:46:40.894717+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[22670]: audit 2024-09-17T08:46:40.899387+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[32124]: cluster 2024-09-17T08:46:40.127138+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[32124]: audit 2024-09-17T08:46:40.472596+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[32124]: audit 2024-09-17T08:46:40.478724+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[32124]: audit 2024-09-17T08:46:40.893925+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:41.479 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[32124]: audit 2024-09-17T08:46:40.894717+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:41.480 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:41 smithi078 bash[32124]: audit 2024-09-17T08:46:40.899387+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:41 smithi136 bash[24812]: cluster 2024-09-17T08:46:40.127138+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:41.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:41 smithi136 bash[24812]: audit 2024-09-17T08:46:40.472596+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:41 smithi136 bash[24812]: audit 2024-09-17T08:46:40.478724+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:41.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:41 smithi136 bash[24812]: audit 2024-09-17T08:46:40.893925+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:41.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:41 smithi136 bash[24812]: audit 2024-09-17T08:46:40.894717+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:41.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:41 smithi136 bash[24812]: audit 2024-09-17T08:46:40.899387+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:42.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:42 smithi078 bash[22670]: audit 2024-09-17T08:46:42.025605+0000 mon.a (mon.0) 360 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T08:46:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:42 smithi078 bash[32124]: audit 2024-09-17T08:46:42.025605+0000 mon.a (mon.0) 360 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T08:46:42.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:42 smithi136 bash[24812]: audit 2024-09-17T08:46:42.025605+0000 mon.a (mon.0) 360 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T08:46:43.670 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[22670]: cluster 2024-09-17T08:46:42.127711+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:43.670 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[22670]: audit 2024-09-17T08:46:42.360149+0000 mon.a (mon.0) 361 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T08:46:43.670 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[22670]: cluster 2024-09-17T08:46:42.360193+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-17T08:46:43.670 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[22670]: audit 2024-09-17T08:46:42.360302+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:43.670 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[22670]: audit 2024-09-17T08:46:42.361071+0000 mon.a (mon.0) 364 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:46:43.671 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[32124]: cluster 2024-09-17T08:46:42.127711+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:43.671 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[32124]: audit 2024-09-17T08:46:42.360149+0000 mon.a (mon.0) 361 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T08:46:43.671 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[32124]: cluster 2024-09-17T08:46:42.360193+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-17T08:46:43.671 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[32124]: audit 2024-09-17T08:46:42.360302+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:43.671 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:43 smithi078 bash[32124]: audit 2024-09-17T08:46:42.361071+0000 mon.a (mon.0) 364 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:46:43.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:43 smithi136 bash[24812]: cluster 2024-09-17T08:46:42.127711+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:43.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:43 smithi136 bash[24812]: audit 2024-09-17T08:46:42.360149+0000 mon.a (mon.0) 361 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T08:46:43.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:43 smithi136 bash[24812]: cluster 2024-09-17T08:46:42.360193+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-17T08:46:43.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:43 smithi136 bash[24812]: audit 2024-09-17T08:46:42.360302+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:43.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:43 smithi136 bash[24812]: audit 2024-09-17T08:46:42.361071+0000 mon.a (mon.0) 364 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:46:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.139+0000 7f41c37fe640 1 -- 172.21.15.78:0/4202075717 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f41d410ae30 con 0x7f41bc06cd80 2024-09-17T08:46:44.142 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 2 on host 'smithi078' 2024-09-17T08:46:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f41bc06cd80 msgr2=0x7f41bc06f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f41bc06cd80 0x7f41bc06f240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41c4005fd0 tx=0x7f41c4005e20 comp rx=0 tx=0).stop 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41d4105b30 msgr2=0x7f41d419ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41d4105b30 0x7f41d419ead0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00ec50 tx=0x7f41cc00c6a0 comp rx=0 tx=0).stop 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 shutdown_connections 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f41bc06cd80 0x7f41bc06f240 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41d4105b30 0x7f41d419ead0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41d4103200 0x7f41d4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 --2- 172.21.15.78:0/4202075717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41d41008d0 0x7f41d4197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 >> 172.21.15.78:0/4202075717 conn(0x7f41d40fa4d0 msgr2=0x7f41d41014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 shutdown_connections 2024-09-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:46:44.143+0000 7f41d8d7e640 1 -- 172.21.15.78:0/4202075717 wait complete. 2024-09-17T08:46:44.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:43.359156+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: cluster 2024-09-17T08:46:43.359237+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:43.359834+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:43.364122+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:43.889258+0000 mon.a (mon.0) 369 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:44.127367+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:44.132504+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:44.138832+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[22670]: audit 2024-09-17T08:46:44.364169+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:43.359156+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: cluster 2024-09-17T08:46:43.359237+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:43.359834+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:43.364122+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:43.889258+0000 mon.a (mon.0) 369 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:44.127367+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:44.132504+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:44.138832+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:44.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:44 smithi078 bash[32124]: audit 2024-09-17T08:46:44.364169+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:43.359156+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:46:44.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: cluster 2024-09-17T08:46:43.359237+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-17T08:46:44.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:43.359834+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:43.364122+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:43.889258+0000 mon.a (mon.0) 369 : audit [INF] from='osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081]' entity='osd.2' 2024-09-17T08:46:44.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:44.127367+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:46:44.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:44.132504+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:44.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:44.138832+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:44.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:44 smithi136 bash[24812]: audit 2024-09-17T08:46:44.364169+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:44.799 DEBUG:teuthology.orchestra.run.smithi078:osd.2> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T08:46:44.802 INFO:tasks.cephadm:Deploying osd.3 on smithi078 with /dev/vg_nvme/lv_1... 2024-09-17T08:46:44.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-17T08:46:45.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:45 smithi136 bash[24812]: cluster 2024-09-17T08:46:43.001189+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:46:45.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:45 smithi136 bash[24812]: cluster 2024-09-17T08:46:43.001279+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:46:45.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:45 smithi136 bash[24812]: cluster 2024-09-17T08:46:44.128122+0000 mgr.y (mgr.14150) 170 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:45.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:45 smithi136 bash[24812]: cluster 2024-09-17T08:46:44.890088+0000 mon.a (mon.0) 374 : cluster [INF] osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] boot 2024-09-17T08:46:45.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:45 smithi136 bash[24812]: cluster 2024-09-17T08:46:44.890118+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-17T08:46:45.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:45 smithi136 bash[24812]: audit 2024-09-17T08:46:44.890764+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[22670]: cluster 2024-09-17T08:46:43.001189+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:46:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[22670]: cluster 2024-09-17T08:46:43.001279+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:46:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[22670]: cluster 2024-09-17T08:46:44.128122+0000 mgr.y (mgr.14150) 170 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[22670]: cluster 2024-09-17T08:46:44.890088+0000 mon.a (mon.0) 374 : cluster [INF] osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] boot 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[22670]: cluster 2024-09-17T08:46:44.890118+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[22670]: audit 2024-09-17T08:46:44.890764+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[32124]: cluster 2024-09-17T08:46:43.001189+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[32124]: cluster 2024-09-17T08:46:43.001279+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[32124]: cluster 2024-09-17T08:46:44.128122+0000 mgr.y (mgr.14150) 170 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[32124]: cluster 2024-09-17T08:46:44.890088+0000 mon.a (mon.0) 374 : cluster [INF] osd.2 [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] boot 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[32124]: cluster 2024-09-17T08:46:44.890118+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-17T08:46:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:45 smithi078 bash[32124]: audit 2024-09-17T08:46:44.890764+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:46:47.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:46 smithi136 bash[24812]: cluster 2024-09-17T08:46:45.899512+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-17T08:46:47.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:46 smithi136 bash[24812]: cluster 2024-09-17T08:46:46.128580+0000 mgr.y (mgr.14150) 171 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:47.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:46 smithi136 bash[24812]: audit 2024-09-17T08:46:46.234701+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:46:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:46 smithi078 bash[22670]: cluster 2024-09-17T08:46:45.899512+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-17T08:46:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:46 smithi078 bash[22670]: cluster 2024-09-17T08:46:46.128580+0000 mgr.y (mgr.14150) 171 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:46 smithi078 bash[22670]: audit 2024-09-17T08:46:46.234701+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:46:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:46 smithi078 bash[32124]: cluster 2024-09-17T08:46:45.899512+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-17T08:46:47.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:46 smithi078 bash[32124]: cluster 2024-09-17T08:46:46.128580+0000 mgr.y (mgr.14150) 171 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:47.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:46 smithi078 bash[32124]: audit 2024-09-17T08:46:46.234701+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:46:48.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:47 smithi136 bash[24812]: audit 2024-09-17T08:46:46.915430+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T08:46:48.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:47 smithi136 bash[24812]: cluster 2024-09-17T08:46:46.915547+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-17T08:46:48.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:47 smithi136 bash[24812]: audit 2024-09-17T08:46:46.917344+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:46:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:47 smithi078 bash[32124]: audit 2024-09-17T08:46:46.915430+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T08:46:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:47 smithi078 bash[32124]: cluster 2024-09-17T08:46:46.915547+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-17T08:46:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:47 smithi078 bash[32124]: audit 2024-09-17T08:46:46.917344+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:46:48.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:47 smithi078 bash[22670]: audit 2024-09-17T08:46:46.915430+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T08:46:48.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:47 smithi078 bash[22670]: cluster 2024-09-17T08:46:46.915547+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-17T08:46:48.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:47 smithi078 bash[22670]: audit 2024-09-17T08:46:46.917344+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:46:48.984 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:46:49.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:48 smithi136 bash[24812]: audit 2024-09-17T08:46:47.915871+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T08:46:49.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:48 smithi136 bash[24812]: cluster 2024-09-17T08:46:47.916114+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-17T08:46:49.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:48 smithi136 bash[24812]: cluster 2024-09-17T08:46:48.129119+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v141: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:49.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:48 smithi078 bash[22670]: audit 2024-09-17T08:46:47.915871+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T08:46:49.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:48 smithi078 bash[22670]: cluster 2024-09-17T08:46:47.916114+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-17T08:46:49.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:48 smithi078 bash[22670]: cluster 2024-09-17T08:46:48.129119+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v141: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:48 smithi078 bash[32124]: audit 2024-09-17T08:46:47.915871+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T08:46:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:48 smithi078 bash[32124]: cluster 2024-09-17T08:46:47.916114+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-17T08:46:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:48 smithi078 bash[32124]: cluster 2024-09-17T08:46:48.129119+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v141: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:50.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:49 smithi136 bash[24812]: cluster 2024-09-17T08:46:48.931317+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-17T08:46:50.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:49 smithi136 bash[24812]: cluster 2024-09-17T08:46:48.951518+0000 mon.a (mon.0) 385 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-17T08:46:50.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:49 smithi136 bash[24812]: audit 2024-09-17T08:46:49.214152+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:50.378 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:49 smithi078 bash[22670]: cluster 2024-09-17T08:46:48.931317+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-17T08:46:50.378 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:49 smithi078 bash[22670]: cluster 2024-09-17T08:46:48.951518+0000 mon.a (mon.0) 385 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-17T08:46:50.378 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:49 smithi078 bash[22670]: audit 2024-09-17T08:46:49.214152+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:50.378 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:49 smithi078 bash[32124]: cluster 2024-09-17T08:46:48.931317+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-17T08:46:50.378 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:49 smithi078 bash[32124]: cluster 2024-09-17T08:46:48.951518+0000 mon.a (mon.0) 385 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-17T08:46:50.378 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:49 smithi078 bash[32124]: audit 2024-09-17T08:46:49.214152+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:51.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:50 smithi136 bash[24812]: cluster 2024-09-17T08:46:50.129504+0000 mgr.y (mgr.14150) 173 : cluster [DBG] pgmap v143: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:51.330 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:50 smithi078 bash[32124]: cluster 2024-09-17T08:46:50.129504+0000 mgr.y (mgr.14150) 173 : cluster [DBG] pgmap v143: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:51.331 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:50 smithi078 bash[22670]: cluster 2024-09-17T08:46:50.129504+0000 mgr.y (mgr.14150) 173 : cluster [DBG] pgmap v143: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:53.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.002634+0000 mon.a (mon.0) 387 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.884885+0000 mon.a (mon.0) 388 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.885967+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.886738+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.887096+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.889987+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.890113+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:52 smithi136 bash[24812]: audit 2024-09-17T08:46:51.890295+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:53.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.002634+0000 mon.a (mon.0) 387 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.884885+0000 mon.a (mon.0) 388 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.885967+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.886738+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.887096+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.889987+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.890113+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[22670]: audit 2024-09-17T08:46:51.890295+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.002634+0000 mon.a (mon.0) 387 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.884885+0000 mon.a (mon.0) 388 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:53.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.885967+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:53.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.886738+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:53.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.887096+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:53.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.889987+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:53.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.890113+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:53.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:52 smithi078 bash[32124]: audit 2024-09-17T08:46:51.890295+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:53.643 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-17T08:46:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-17T08:46:53.822 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2024-09-17T08:46:53.822 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2024-09-17T08:46:53.822 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0147355 s, 712 MB/s 2024-09-17T08:46:53.822 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:51.889717+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: cluster 2024-09-17T08:46:52.129951+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v144: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:52.781538+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:52.832054+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:52.834879+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:52.835259+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:52.835599+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:52.835896+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:54.034 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[22670]: audit 2024-09-17T08:46:53.712296+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:51.889717+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: cluster 2024-09-17T08:46:52.129951+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v144: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:52.781538+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:52.832054+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:52.834879+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:52.835259+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:52.835599+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:52.835896+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:54.035 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:53 smithi078 bash[32124]: audit 2024-09-17T08:46:53.712296+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:54.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:51.889717+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:54.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: cluster 2024-09-17T08:46:52.129951+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v144: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:54.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:52.781538+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:54.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:52.832054+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:54.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:52.834879+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T08:46:54.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:52.835259+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:46:54.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:52.835599+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:46:54.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:52.835896+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:46:54.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:53 smithi136 bash[24812]: audit 2024-09-17T08:46:53.712296+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T08:46:54.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_1 2024-09-17T08:46:55.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:54 smithi136 bash[24812]: cluster 2024-09-17T08:46:54.130311+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:55.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:54 smithi078 bash[22670]: cluster 2024-09-17T08:46:54.130311+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:54 smithi078 bash[32124]: cluster 2024-09-17T08:46:54.130311+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: cephadm 2024-09-17T08:46:55.053235+0000 mgr.y (mgr.14150) 176 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.057844+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.062275+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.063131+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.063768+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.064355+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: cephadm 2024-09-17T08:46:55.064806+0000 mgr.y (mgr.14150) 177 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 5413M 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.068542+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.069746+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.070313+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[22670]: audit 2024-09-17T08:46:55.074278+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: cephadm 2024-09-17T08:46:55.053235+0000 mgr.y (mgr.14150) 176 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.057844+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.062275+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.063131+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.063768+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.064355+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: cephadm 2024-09-17T08:46:55.064806+0000 mgr.y (mgr.14150) 177 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 5413M 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.068542+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.069746+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:56.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.070313+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:56.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:56 smithi078 bash[32124]: audit 2024-09-17T08:46:55.074278+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: cephadm 2024-09-17T08:46:55.053235+0000 mgr.y (mgr.14150) 176 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.057844+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.062275+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.063131+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.063768+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.064355+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: cephadm 2024-09-17T08:46:55.064806+0000 mgr.y (mgr.14150) 177 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 5413M 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.068542+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.069746+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.070313+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:46:56.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:56 smithi136 bash[24812]: audit 2024-09-17T08:46:55.074278+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:46:57.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:57 smithi078 bash[22670]: cluster 2024-09-17T08:46:56.130744+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:57.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:57 smithi078 bash[32124]: cluster 2024-09-17T08:46:56.130744+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:57.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:57 smithi136 bash[24812]: cluster 2024-09-17T08:46:56.130744+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:46:59.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:46:59 smithi136 bash[24812]: cluster 2024-09-17T08:46:58.131347+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-17T08:46:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:46:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:46:59 smithi078 bash[22670]: cluster 2024-09-17T08:46:58.131347+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-17T08:46:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:46:59 smithi078 bash[32124]: cluster 2024-09-17T08:46:58.131347+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-17T08:47:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:01 smithi078 bash[22670]: cluster 2024-09-17T08:47:00.131961+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-17T08:47:01.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:01 smithi078 bash[32124]: cluster 2024-09-17T08:47:00.131961+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-17T08:47:01.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:01 smithi136 bash[24812]: cluster 2024-09-17T08:47:00.131961+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-17T08:47:02.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- 172.21.15.78:0/3274830384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b90105b40 msgr2=0x7f3b90107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:02.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 --2- 172.21.15.78:0/3274830384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b90105b40 0x7f3b90107f90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009ca0 tx=0x7f3b8002a8c0 comp rx=0 tx=0).stop 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- 172.21.15.78:0/3274830384 shutdown_connections 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 --2- 172.21.15.78:0/3274830384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b90105b40 0x7f3b90107f90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 --2- 172.21.15.78:0/3274830384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b90103210 0x7f3b90105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 --2- 172.21.15.78:0/3274830384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b901008e0 0x7f3b90102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- 172.21.15.78:0/3274830384 >> 172.21.15.78:0/3274830384 conn(0x7f3b900fa520 msgr2=0x7f3b900fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- 172.21.15.78:0/3274830384 shutdown_connections 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- 172.21.15.78:0/3274830384 wait complete. 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 Processor -- start 2024-09-17T08:47:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- start start 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b901008e0 0x7f3b901952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b90103210 0x7f3b901957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b90105b40 0x7f3b9019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9019cda0 con 0x7f3b901008e0 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9019cf10 con 0x7f3b90103210 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9019d0d0 con 0x7f3b90105b40 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b901008e0 0x7f3b901952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b901008e0 0x7f3b901952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43806/0 (socket says 172.21.15.78:43806) 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 -- 172.21.15.78:0/1890539731 learned_addr learned my addr 172.21.15.78:0/1890539731 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95806640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b90105b40 0x7f3b9019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b94804640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b90103210 0x7f3b901957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 -- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b90105b40 msgr2=0x7f3b9019c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b90105b40 0x7f3b9019c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 -- 172.21.15.78:0/1890539731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b90103210 msgr2=0x7f3b901957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b90103210 0x7f3b901957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 -- 172.21.15.78:0/1890539731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80009900 con 0x7f3b901008e0 2024-09-17T08:47:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b95005640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b901008e0 0x7f3b901952a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e9f0 tx=0x7f3b8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:47:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b8e7fc640 1 -- 172.21.15.78:0/1890539731 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88009720 con 0x7f3b901008e0 2024-09-17T08:47:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b8e7fc640 1 -- 172.21.15.78:0/1890539731 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f3b8800cd80 con 0x7f3b901008e0 2024-09-17T08:47:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9019d3b0 con 0x7f3b901008e0 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b8e7fc640 1 -- 172.21.15.78:0/1890539731 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88004e40 con 0x7f3b901008e0 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.599+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9019d8b0 con 0x7f3b901008e0 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.603+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b901035f0 con 0x7f3b901008e0 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.603+0000 7f3b8e7fc640 1 -- 172.21.15.78:0/1890539731 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7f3b88005000 con 0x7f3b901008e0 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.603+0000 7f3b8e7fc640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3b7806ce00 0x7f3b7806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.603+0000 7f3b8e7fc640 1 -- 172.21.15.78:0/1890539731 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3017+0+0 (secure 0 0 0) 0x7f3b88014070 con 0x7f3b901008e0 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.603+0000 7f3b94804640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3b7806ce00 0x7f3b7806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.603+0000 7f3b94804640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3b7806ce00 0x7f3b7806f2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b901967c0 tx=0x7f3b8400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:47:02.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.607+0000 7f3b8e7fc640 1 -- 172.21.15.78:0/1890539731 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3b880569b0 con 0x7f3b901008e0 2024-09-17T08:47:02.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:02.779+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b900608f0 con 0x7f3b7806ce00 2024-09-17T08:47:03.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:03 smithi136 bash[24812]: cluster 2024-09-17T08:47:02.132617+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-17T08:47:03.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:03 smithi136 bash[24812]: audit 2024-09-17T08:47:02.793069+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:47:03.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:03 smithi136 bash[24812]: audit 2024-09-17T08:47:02.798411+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:47:03.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:03 smithi136 bash[24812]: audit 2024-09-17T08:47:02.799820+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[22670]: cluster 2024-09-17T08:47:02.132617+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-17T08:47:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[22670]: audit 2024-09-17T08:47:02.793069+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:47:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[22670]: audit 2024-09-17T08:47:02.798411+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:47:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[22670]: audit 2024-09-17T08:47:02.799820+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[32124]: cluster 2024-09-17T08:47:02.132617+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-17T08:47:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[32124]: audit 2024-09-17T08:47:02.793069+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:47:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[32124]: audit 2024-09-17T08:47:02.798411+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:47:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:03 smithi078 bash[32124]: audit 2024-09-17T08:47:02.799820+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:04.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:04 smithi136 bash[24812]: audit 2024-09-17T08:47:02.787156+0000 mgr.y (mgr.14150) 182 : audit [DBG] from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:47:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:04 smithi078 bash[22670]: audit 2024-09-17T08:47:02.787156+0000 mgr.y (mgr.14150) 182 : audit [DBG] from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:47:04.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:04 smithi078 bash[32124]: audit 2024-09-17T08:47:02.787156+0000 mgr.y (mgr.14150) 182 : audit [DBG] from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:47:05.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:05 smithi136 bash[24812]: cluster 2024-09-17T08:47:04.133134+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-17T08:47:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:05 smithi078 bash[22670]: cluster 2024-09-17T08:47:04.133134+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-17T08:47:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:05 smithi078 bash[32124]: cluster 2024-09-17T08:47:04.133134+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-17T08:47:07.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:07 smithi136 bash[24812]: cluster 2024-09-17T08:47:06.133722+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T08:47:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:07 smithi078 bash[22670]: cluster 2024-09-17T08:47:06.133722+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T08:47:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:07 smithi078 bash[32124]: cluster 2024-09-17T08:47:06.133722+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T08:47:09.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:09 smithi136 bash[24812]: cluster 2024-09-17T08:47:08.134432+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T08:47:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:09 smithi078 bash[22670]: cluster 2024-09-17T08:47:08.134432+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T08:47:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:09 smithi078 bash[32124]: cluster 2024-09-17T08:47:08.134432+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T08:47:11.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:11 smithi136 bash[24812]: cluster 2024-09-17T08:47:10.135119+0000 mgr.y (mgr.14150) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:11.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:11 smithi136 bash[24812]: audit 2024-09-17T08:47:11.063004+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.78:0/2974924546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]: dispatch 2024-09-17T08:47:11.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:11 smithi136 bash[24812]: audit 2024-09-17T08:47:11.063429+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]: dispatch 2024-09-17T08:47:11.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:11 smithi136 bash[24812]: audit 2024-09-17T08:47:11.070623+0000 mon.a (mon.0) 412 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]': finished 2024-09-17T08:47:11.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:11 smithi136 bash[24812]: cluster 2024-09-17T08:47:11.070768+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-17T08:47:11.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:11 smithi136 bash[24812]: audit 2024-09-17T08:47:11.071031+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[22670]: cluster 2024-09-17T08:47:10.135119+0000 mgr.y (mgr.14150) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[22670]: audit 2024-09-17T08:47:11.063004+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.78:0/2974924546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]: dispatch 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[22670]: audit 2024-09-17T08:47:11.063429+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]: dispatch 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[22670]: audit 2024-09-17T08:47:11.070623+0000 mon.a (mon.0) 412 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]': finished 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[22670]: cluster 2024-09-17T08:47:11.070768+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[22670]: audit 2024-09-17T08:47:11.071031+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[32124]: cluster 2024-09-17T08:47:10.135119+0000 mgr.y (mgr.14150) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[32124]: audit 2024-09-17T08:47:11.063004+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.78:0/2974924546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]: dispatch 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[32124]: audit 2024-09-17T08:47:11.063429+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]: dispatch 2024-09-17T08:47:11.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[32124]: audit 2024-09-17T08:47:11.070623+0000 mon.a (mon.0) 412 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5abaea7b-fc8a-4cea-8b72-19fda0086dbe"}]': finished 2024-09-17T08:47:11.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[32124]: cluster 2024-09-17T08:47:11.070768+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-17T08:47:11.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:11 smithi078 bash[32124]: audit 2024-09-17T08:47:11.071031+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:12.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:12 smithi136 bash[24812]: audit 2024-09-17T08:47:11.707114+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.78:0/2542729089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:47:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:12 smithi078 bash[22670]: audit 2024-09-17T08:47:11.707114+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.78:0/2542729089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:47:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:12 smithi078 bash[32124]: audit 2024-09-17T08:47:11.707114+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.78:0/2542729089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:47:13.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:13 smithi136 bash[24812]: cluster 2024-09-17T08:47:12.135660+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:13 smithi078 bash[22670]: cluster 2024-09-17T08:47:12.135660+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:13 smithi078 bash[32124]: cluster 2024-09-17T08:47:12.135660+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:15.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:15 smithi136 bash[24812]: cluster 2024-09-17T08:47:14.136094+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:15 smithi078 bash[22670]: cluster 2024-09-17T08:47:14.136094+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:15 smithi078 bash[32124]: cluster 2024-09-17T08:47:14.136094+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:17.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:17 smithi136 bash[24812]: cluster 2024-09-17T08:47:16.136678+0000 mgr.y (mgr.14150) 189 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:17 smithi078 bash[22670]: cluster 2024-09-17T08:47:16.136678+0000 mgr.y (mgr.14150) 189 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:17 smithi078 bash[32124]: cluster 2024-09-17T08:47:16.136678+0000 mgr.y (mgr.14150) 189 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:19.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:19 smithi136 bash[24812]: cluster 2024-09-17T08:47:18.137250+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:19 smithi078 bash[22670]: cluster 2024-09-17T08:47:18.137250+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:19 smithi078 bash[32124]: cluster 2024-09-17T08:47:18.137250+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:21.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:21 smithi136 bash[24812]: cluster 2024-09-17T08:47:20.137778+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:21 smithi078 bash[22670]: cluster 2024-09-17T08:47:20.137778+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:21 smithi078 bash[32124]: cluster 2024-09-17T08:47:20.137778+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:23.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:23 smithi136 bash[24812]: cluster 2024-09-17T08:47:22.138279+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:23.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:23 smithi078 bash[22670]: cluster 2024-09-17T08:47:22.138279+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:23.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:23 smithi078 bash[32124]: cluster 2024-09-17T08:47:22.138279+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:24.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:24 smithi136 bash[24812]: audit 2024-09-17T08:47:23.614517+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T08:47:24.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:24 smithi136 bash[24812]: audit 2024-09-17T08:47:23.616389+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:24 smithi078 bash[22670]: audit 2024-09-17T08:47:23.614517+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T08:47:24.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:24 smithi078 bash[22670]: audit 2024-09-17T08:47:23.616389+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:24 smithi078 bash[32124]: audit 2024-09-17T08:47:23.614517+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T08:47:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:24 smithi078 bash[32124]: audit 2024-09-17T08:47:23.616389+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:25.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:25 smithi136 bash[24812]: cephadm 2024-09-17T08:47:23.617895+0000 mgr.y (mgr.14150) 193 : cephadm [INF] Deploying daemon osd.3 on smithi078 2024-09-17T08:47:25.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:25 smithi136 bash[24812]: cluster 2024-09-17T08:47:24.138917+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:25 smithi078 bash[22670]: cephadm 2024-09-17T08:47:23.617895+0000 mgr.y (mgr.14150) 193 : cephadm [INF] Deploying daemon osd.3 on smithi078 2024-09-17T08:47:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:25 smithi078 bash[22670]: cluster 2024-09-17T08:47:24.138917+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:25.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:25 smithi078 bash[32124]: cephadm 2024-09-17T08:47:23.617895+0000 mgr.y (mgr.14150) 193 : cephadm [INF] Deploying daemon osd.3 on smithi078 2024-09-17T08:47:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:25 smithi078 bash[32124]: cluster 2024-09-17T08:47:24.138917+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:27 smithi136 bash[24812]: cluster 2024-09-17T08:47:26.139504+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:27.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:27 smithi078 bash[22670]: cluster 2024-09-17T08:47:26.139504+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:27 smithi078 bash[32124]: cluster 2024-09-17T08:47:26.139504+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:27.930 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:47:27 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:27.930 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:47:27 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:27.931 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:27 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:27.931 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:47:27 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:27.931 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:27 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:27.932 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:47:27 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:28.264 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:28 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:28.265 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:47:28 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:28.265 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:28 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:28.266 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:47:28 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:28.266 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:47:28 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:28.266 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:47:28 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:47:28.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:28 smithi136 bash[24812]: audit 2024-09-17T08:47:28.197365+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:47:28.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:28 smithi136 bash[24812]: audit 2024-09-17T08:47:28.201291+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:28.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:28 smithi136 bash[24812]: audit 2024-09-17T08:47:28.207515+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:28 smithi078 bash[32124]: audit 2024-09-17T08:47:28.197365+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:47:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:28 smithi078 bash[32124]: audit 2024-09-17T08:47:28.201291+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:28 smithi078 bash[32124]: audit 2024-09-17T08:47:28.207515+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:28.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:28 smithi078 bash[22670]: audit 2024-09-17T08:47:28.197365+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:47:28.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:28 smithi078 bash[22670]: audit 2024-09-17T08:47:28.201291+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:28.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:28 smithi078 bash[22670]: audit 2024-09-17T08:47:28.207515+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:29.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:29 smithi136 bash[24812]: cluster 2024-09-17T08:47:28.140101+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:29.551 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:29 smithi078 bash[32124]: cluster 2024-09-17T08:47:28.140101+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:29.552 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:29 smithi078 bash[22670]: cluster 2024-09-17T08:47:28.140101+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:31.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:31 smithi136 bash[24812]: cluster 2024-09-17T08:47:30.140655+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:31 smithi078 bash[22670]: cluster 2024-09-17T08:47:30.140655+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:31 smithi078 bash[32124]: cluster 2024-09-17T08:47:30.140655+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:33.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:33 smithi136 bash[24812]: cluster 2024-09-17T08:47:32.141211+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:33 smithi078 bash[22670]: cluster 2024-09-17T08:47:32.141211+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:33 smithi078 bash[32124]: cluster 2024-09-17T08:47:32.141211+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:34.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:34 smithi136 bash[24812]: audit 2024-09-17T08:47:33.381548+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:34 smithi136 bash[24812]: audit 2024-09-17T08:47:33.388044+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:34 smithi136 bash[24812]: audit 2024-09-17T08:47:33.388860+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:34.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:34 smithi136 bash[24812]: audit 2024-09-17T08:47:33.389542+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:47:34.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:34 smithi136 bash[24812]: audit 2024-09-17T08:47:33.396164+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.806 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[22670]: audit 2024-09-17T08:47:33.381548+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[22670]: audit 2024-09-17T08:47:33.388044+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[22670]: audit 2024-09-17T08:47:33.388860+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[22670]: audit 2024-09-17T08:47:33.389542+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[22670]: audit 2024-09-17T08:47:33.396164+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[32124]: audit 2024-09-17T08:47:33.381548+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[32124]: audit 2024-09-17T08:47:33.388044+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[32124]: audit 2024-09-17T08:47:33.388860+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[32124]: audit 2024-09-17T08:47:33.389542+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:47:34.807 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:34 smithi078 bash[32124]: audit 2024-09-17T08:47:33.396164+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:35.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:35 smithi136 bash[24812]: cluster 2024-09-17T08:47:34.141649+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:35.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:35 smithi136 bash[24812]: audit 2024-09-17T08:47:34.812244+0000 mon.c (mon.2) 11 : audit [INF] from='osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T08:47:35.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:35 smithi136 bash[24812]: audit 2024-09-17T08:47:34.812581+0000 mon.a (mon.0) 425 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T08:47:35.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:35 smithi078 bash[22670]: cluster 2024-09-17T08:47:34.141649+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:35.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:35 smithi078 bash[22670]: audit 2024-09-17T08:47:34.812244+0000 mon.c (mon.2) 11 : audit [INF] from='osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T08:47:35.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:35 smithi078 bash[22670]: audit 2024-09-17T08:47:34.812581+0000 mon.a (mon.0) 425 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T08:47:35.826 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:35 smithi078 bash[32124]: cluster 2024-09-17T08:47:34.141649+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:35.827 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:35 smithi078 bash[32124]: audit 2024-09-17T08:47:34.812244+0000 mon.c (mon.2) 11 : audit [INF] from='osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T08:47:35.827 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:35 smithi078 bash[32124]: audit 2024-09-17T08:47:34.812581+0000 mon.a (mon.0) 425 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T08:47:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[22670]: audit 2024-09-17T08:47:35.408417+0000 mon.a (mon.0) 426 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T08:47:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[22670]: cluster 2024-09-17T08:47:35.408545+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-17T08:47:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[22670]: audit 2024-09-17T08:47:35.409273+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:36.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[22670]: audit 2024-09-17T08:47:35.411745+0000 mon.c (mon.2) 12 : audit [INF] from='osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:47:36.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[22670]: audit 2024-09-17T08:47:35.418248+0000 mon.a (mon.0) 429 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:47:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[32124]: audit 2024-09-17T08:47:35.408417+0000 mon.a (mon.0) 426 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T08:47:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[32124]: cluster 2024-09-17T08:47:35.408545+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-17T08:47:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[32124]: audit 2024-09-17T08:47:35.409273+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[32124]: audit 2024-09-17T08:47:35.411745+0000 mon.c (mon.2) 12 : audit [INF] from='osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:47:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:36 smithi078 bash[32124]: audit 2024-09-17T08:47:35.418248+0000 mon.a (mon.0) 429 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:47:36.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:36 smithi136 bash[24812]: audit 2024-09-17T08:47:35.408417+0000 mon.a (mon.0) 426 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T08:47:36.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:36 smithi136 bash[24812]: cluster 2024-09-17T08:47:35.408545+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-17T08:47:36.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:36 smithi136 bash[24812]: audit 2024-09-17T08:47:35.409273+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:36.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:36 smithi136 bash[24812]: audit 2024-09-17T08:47:35.411745+0000 mon.c (mon.2) 12 : audit [INF] from='osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:47:36.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:36 smithi136 bash[24812]: audit 2024-09-17T08:47:35.418248+0000 mon.a (mon.0) 429 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-17T08:47:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.935+0000 7f3b8e7fc640 1 -- 172.21.15.78:0/1890539731 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3b900608f0 con 0x7f3b7806ce00 2024-09-17T08:47:36.939 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 3 on host 'smithi078' 2024-09-17T08:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3b7806ce00 msgr2=0x7f3b7806f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3b7806ce00 0x7f3b7806f2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b901967c0 tx=0x7f3b8400a4c0 comp rx=0 tx=0).stop 2024-09-17T08:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b901008e0 msgr2=0x7f3b901952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b901008e0 0x7f3b901952a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e9f0 tx=0x7f3b8800edf0 comp rx=0 tx=0).stop 2024-09-17T08:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 shutdown_connections 2024-09-17T08:47:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f3b7806ce00 0x7f3b7806f2c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b90105b40 0x7f3b9019c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b90103210 0x7f3b901957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 --2- 172.21.15.78:0/1890539731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b901008e0 0x7f3b901952a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 >> 172.21.15.78:0/1890539731 conn(0x7f3b900fa520 msgr2=0x7f3b901014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 shutdown_connections 2024-09-17T08:47:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:47:36.939+0000 7f3b97269640 1 -- 172.21.15.78:0/1890539731 wait complete. 2024-09-17T08:47:37.556 DEBUG:teuthology.orchestra.run.smithi078:osd.3> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T08:47:37.558 INFO:tasks.cephadm:Deploying osd.4 on smithi136 with /dev/vg_nvme/lv_4... 2024-09-17T08:47:37.559 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: cluster 2024-09-17T08:47:36.141974+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: audit 2024-09-17T08:47:36.427606+0000 mon.a (mon.0) 430 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: cluster 2024-09-17T08:47:36.427777+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: audit 2024-09-17T08:47:36.428175+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: audit 2024-09-17T08:47:36.435789+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: audit 2024-09-17T08:47:36.928722+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: audit 2024-09-17T08:47:36.932796+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: audit 2024-09-17T08:47:36.938678+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:37.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:37 smithi136 bash[24812]: audit 2024-09-17T08:47:36.964296+0000 mon.a (mon.0) 437 : audit [INF] from='osd.3 ' entity='osd.3' 2024-09-17T08:47:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: cluster 2024-09-17T08:47:36.141974+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: audit 2024-09-17T08:47:36.427606+0000 mon.a (mon.0) 430 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: cluster 2024-09-17T08:47:36.427777+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: audit 2024-09-17T08:47:36.428175+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: audit 2024-09-17T08:47:36.435789+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: audit 2024-09-17T08:47:36.928722+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: audit 2024-09-17T08:47:36.932796+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: audit 2024-09-17T08:47:36.938678+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[22670]: audit 2024-09-17T08:47:36.964296+0000 mon.a (mon.0) 437 : audit [INF] from='osd.3 ' entity='osd.3' 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: cluster 2024-09-17T08:47:36.141974+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: audit 2024-09-17T08:47:36.427606+0000 mon.a (mon.0) 430 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-17T08:47:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: cluster 2024-09-17T08:47:36.427777+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-17T08:47:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: audit 2024-09-17T08:47:36.428175+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: audit 2024-09-17T08:47:36.435789+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: audit 2024-09-17T08:47:36.928722+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:47:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: audit 2024-09-17T08:47:36.932796+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: audit 2024-09-17T08:47:36.938678+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:37 smithi078 bash[32124]: audit 2024-09-17T08:47:36.964296+0000 mon.a (mon.0) 437 : audit [INF] from='osd.3 ' entity='osd.3' 2024-09-17T08:47:38.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:38 smithi136 bash[24812]: cluster 2024-09-17T08:47:35.822658+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:47:38.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:38 smithi136 bash[24812]: cluster 2024-09-17T08:47:35.822749+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:47:38.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:38 smithi136 bash[24812]: audit 2024-09-17T08:47:37.435076+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:38.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:38 smithi136 bash[24812]: cluster 2024-09-17T08:47:37.967774+0000 mon.a (mon.0) 439 : cluster [INF] osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] boot 2024-09-17T08:47:38.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:38 smithi136 bash[24812]: cluster 2024-09-17T08:47:37.967843+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-17T08:47:38.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:38 smithi136 bash[24812]: audit 2024-09-17T08:47:37.968086+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:38.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[22670]: cluster 2024-09-17T08:47:35.822658+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:47:38.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[22670]: cluster 2024-09-17T08:47:35.822749+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:47:38.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[22670]: audit 2024-09-17T08:47:37.435076+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:38.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[22670]: cluster 2024-09-17T08:47:37.967774+0000 mon.a (mon.0) 439 : cluster [INF] osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] boot 2024-09-17T08:47:38.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[22670]: cluster 2024-09-17T08:47:37.967843+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-17T08:47:38.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[22670]: audit 2024-09-17T08:47:37.968086+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[32124]: cluster 2024-09-17T08:47:35.822658+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:47:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[32124]: cluster 2024-09-17T08:47:35.822749+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:47:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[32124]: audit 2024-09-17T08:47:37.435076+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:38.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[32124]: cluster 2024-09-17T08:47:37.967774+0000 mon.a (mon.0) 439 : cluster [INF] osd.3 [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] boot 2024-09-17T08:47:38.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[32124]: cluster 2024-09-17T08:47:37.967843+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-17T08:47:38.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:38 smithi078 bash[32124]: audit 2024-09-17T08:47:37.968086+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:47:39.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:39 smithi136 bash[24812]: cluster 2024-09-17T08:47:38.142472+0000 mgr.y (mgr.14150) 201 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:39.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:39 smithi078 bash[22670]: cluster 2024-09-17T08:47:38.142472+0000 mgr.y (mgr.14150) 201 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:39.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:39 smithi078 bash[32124]: cluster 2024-09-17T08:47:38.142472+0000 mgr.y (mgr.14150) 201 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T08:47:40.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:40 smithi136 bash[24812]: cluster 2024-09-17T08:47:39.448061+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-17T08:47:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:40 smithi078 bash[22670]: cluster 2024-09-17T08:47:39.448061+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-17T08:47:40.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:40 smithi078 bash[32124]: cluster 2024-09-17T08:47:39.448061+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-17T08:47:41.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:41 smithi136 bash[24812]: cluster 2024-09-17T08:47:40.143041+0000 mgr.y (mgr.14150) 202 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:41.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:41 smithi078 bash[32124]: cluster 2024-09-17T08:47:40.143041+0000 mgr.y (mgr.14150) 202 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:41 smithi078 bash[22670]: cluster 2024-09-17T08:47:40.143041+0000 mgr.y (mgr.14150) 202 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:42.227 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:47:42.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:42 smithi136 bash[24812]: cluster 2024-09-17T08:47:42.143554+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:42.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:42 smithi078 bash[22670]: cluster 2024-09-17T08:47:42.143554+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:42.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:42 smithi078 bash[32124]: cluster 2024-09-17T08:47:42.143554+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:45.126 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-17T08:47:45.325 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-17T08:47:45.339 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-09-17T08:47:45.340 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-09-17T08:47:45.340 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118653 s, 884 MB/s 2024-09-17T08:47:45.340 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-09-17T08:47:45.517 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:45 smithi078 bash[22670]: cluster 2024-09-17T08:47:44.144098+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:45.517 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:45 smithi078 bash[32124]: cluster 2024-09-17T08:47:44.144098+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:45.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:45 smithi136 bash[24812]: cluster 2024-09-17T08:47:44.144098+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:45.984 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2024-09-17T08:47:47.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: cluster 2024-09-17T08:47:46.144685+0000 mgr.y (mgr.14150) 205 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:47.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: cephadm 2024-09-17T08:47:46.194065+0000 mgr.y (mgr.14150) 206 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:47:47.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.202427+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.216539+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.218700+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.220136+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.221545+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.222993+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: cephadm 2024-09-17T08:47:46.224127+0000 mgr.y (mgr.14150) 207 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 4060M 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.232574+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.234796+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.236496+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:47:47.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:47 smithi136 bash[24812]: audit 2024-09-17T08:47:46.245875+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: cluster 2024-09-17T08:47:46.144685+0000 mgr.y (mgr.14150) 205 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: cephadm 2024-09-17T08:47:46.194065+0000 mgr.y (mgr.14150) 206 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.202427+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.216539+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.218700+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.220136+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.221545+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.222993+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: cephadm 2024-09-17T08:47:46.224127+0000 mgr.y (mgr.14150) 207 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 4060M 2024-09-17T08:47:47.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.232574+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.234796+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.236496+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[22670]: audit 2024-09-17T08:47:46.245875+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: cluster 2024-09-17T08:47:46.144685+0000 mgr.y (mgr.14150) 205 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: cephadm 2024-09-17T08:47:46.194065+0000 mgr.y (mgr.14150) 206 : cephadm [INF] Detected new or changed devices on smithi078 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.202427+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.216539+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.218700+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.220136+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.221545+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.222993+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:47:47.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: cephadm 2024-09-17T08:47:46.224127+0000 mgr.y (mgr.14150) 207 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 4060M 2024-09-17T08:47:47.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.232574+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:47.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.234796+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:47.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.236496+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:47:47.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:47 smithi078 bash[32124]: audit 2024-09-17T08:47:46.245875+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:47:49.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:49 smithi136 bash[24812]: cluster 2024-09-17T08:47:48.145232+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:49.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:49 smithi078 bash[22670]: cluster 2024-09-17T08:47:48.145232+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:49.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:49 smithi078 bash[32124]: cluster 2024-09-17T08:47:48.145232+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:50.645 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:47:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:51 smithi136 bash[24812]: cluster 2024-09-17T08:47:50.145770+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:51 smithi078 bash[22670]: cluster 2024-09-17T08:47:50.145770+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:51 smithi078 bash[32124]: cluster 2024-09-17T08:47:50.145770+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- 172.21.15.136:0/3727302312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab800fe150 msgr2=0x7fab800fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3727302312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab800fe150 0x7fab800fe550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab70009900 tx=0x7fab7002a410 comp rx=0 tx=0).stop 2024-09-17T08:47:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- 172.21.15.136:0/3727302312 shutdown_connections 2024-09-17T08:47:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3727302312 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab80101b90 0x7fab80108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3727302312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab801011d0 0x7fab80101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3727302312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab800fe150 0x7fab800fe550 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- 172.21.15.136:0/3727302312 >> 172.21.15.136:0/3727302312 conn(0x7fab800f9ca0 msgr2=0x7fab800fc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:47:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- 172.21.15.136:0/3727302312 shutdown_connections 2024-09-17T08:47:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- 172.21.15.136:0/3727302312 wait complete. 2024-09-17T08:47:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 Processor -- start 2024-09-17T08:47:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- start start 2024-09-17T08:47:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab800fe150 0x7fab80195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab801011d0 0x7fab80195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab80101b90 0x7fab8019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8019ce50 con 0x7fab801011d0 2024-09-17T08:47:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8019cfc0 con 0x7fab80101b90 2024-09-17T08:47:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8019d180 con 0x7fab800fe150 2024-09-17T08:47:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab80101b90 0x7fab8019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab80101b90 0x7fab8019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39840/0 (socket says 172.21.15.136:39840) 2024-09-17T08:47:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 -- 172.21.15.136:0/3806892959 learned_addr learned my addr 172.21.15.136:0/3806892959 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:47:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab85871640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab800fe150 0x7fab80195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab85070640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab801011d0 0x7fab80195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 -- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab800fe150 msgr2=0x7fab80195350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:53.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab800fe150 0x7fab80195350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:53.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 -- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab801011d0 msgr2=0x7fab80195890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:47:53.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab801011d0 0x7fab80195890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:47:53.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 -- 172.21.15.136:0/3806892959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009560 con 0x7fab80101b90 2024-09-17T08:47:53.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab85871640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab800fe150 0x7fab80195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:47:53.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab86072640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab80101b90 0x7fab8019c910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab7800b970 tx=0x7fab7800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:47:53.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab76ffd640 1 -- 172.21.15.136:0/3806892959 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7800cb40 con 0x7fab80101b90 2024-09-17T08:47:53.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab76ffd640 1 -- 172.21.15.136:0/3806892959 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fab7800cca0 con 0x7fab80101b90 2024-09-17T08:47:53.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8019d460 con 0x7fab80101b90 2024-09-17T08:47:53.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab76ffd640 1 -- 172.21.15.136:0/3806892959 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab780075d0 con 0x7fab80101b90 2024-09-17T08:47:53.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.353+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8019d9e0 con 0x7fab80101b90 2024-09-17T08:47:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.357+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab800fe550 con 0x7fab80101b90 2024-09-17T08:47:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.357+0000 7fab76ffd640 1 -- 172.21.15.136:0/3806892959 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7fab78014440 con 0x7fab80101b90 2024-09-17T08:47:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.357+0000 7fab76ffd640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fab6c06ce00 0x7fab6c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:47:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.357+0000 7fab76ffd640 1 -- 172.21.15.136:0/3806892959 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3449+0+0 (secure 0 0 0) 0x7fab7808b420 con 0x7fab80101b90 2024-09-17T08:47:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.357+0000 7fab85871640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fab6c06ce00 0x7fab6c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:47:53.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.357+0000 7fab85871640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fab6c06ce00 0x7fab6c06f2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab70005940 tx=0x7fab700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:47:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.361+0000 7fab76ffd640 1 -- 172.21.15.136:0/3806892959 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fab78056050 con 0x7fab80101b90 2024-09-17T08:47:53.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:47:53.533+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fab8010adc0 con 0x7fab6c06ce00 2024-09-17T08:47:53.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:53 smithi136 bash[24812]: cluster 2024-09-17T08:47:52.146307+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:53 smithi078 bash[22670]: cluster 2024-09-17T08:47:52.146307+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:53.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:53 smithi078 bash[32124]: cluster 2024-09-17T08:47:52.146307+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:54.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:54 smithi136 bash[24812]: audit 2024-09-17T08:47:53.548288+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:47:54.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:54 smithi136 bash[24812]: audit 2024-09-17T08:47:53.554216+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:47:54.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:54 smithi136 bash[24812]: audit 2024-09-17T08:47:53.556037+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:54 smithi078 bash[22670]: audit 2024-09-17T08:47:53.548288+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:47:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:54 smithi078 bash[22670]: audit 2024-09-17T08:47:53.554216+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:47:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:54 smithi078 bash[22670]: audit 2024-09-17T08:47:53.556037+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:54 smithi078 bash[32124]: audit 2024-09-17T08:47:53.548288+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:47:54.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:54 smithi078 bash[32124]: audit 2024-09-17T08:47:53.554216+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:47:54.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:54 smithi078 bash[32124]: audit 2024-09-17T08:47:53.556037+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:47:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:55 smithi136 bash[24812]: audit 2024-09-17T08:47:53.541607+0000 mgr.y (mgr.14150) 211 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:47:55.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:55 smithi136 bash[24812]: cluster 2024-09-17T08:47:54.146861+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:55 smithi078 bash[22670]: audit 2024-09-17T08:47:53.541607+0000 mgr.y (mgr.14150) 211 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:47:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:55 smithi078 bash[22670]: cluster 2024-09-17T08:47:54.146861+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:55 smithi078 bash[32124]: audit 2024-09-17T08:47:53.541607+0000 mgr.y (mgr.14150) 211 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:47:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:55 smithi078 bash[32124]: cluster 2024-09-17T08:47:54.146861+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:57.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:57 smithi136 bash[24812]: cluster 2024-09-17T08:47:56.147400+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:57 smithi078 bash[22670]: cluster 2024-09-17T08:47:56.147400+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:57 smithi078 bash[32124]: cluster 2024-09-17T08:47:56.147400+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:59.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:47:59 smithi136 bash[24812]: cluster 2024-09-17T08:47:58.148003+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:47:59 smithi078 bash[22670]: cluster 2024-09-17T08:47:58.148003+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:47:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:47:59 smithi078 bash[32124]: cluster 2024-09-17T08:47:58.148003+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:01.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:01 smithi136 bash[24812]: cluster 2024-09-17T08:48:00.148523+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:01 smithi078 bash[22670]: cluster 2024-09-17T08:48:00.148523+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:01 smithi078 bash[32124]: cluster 2024-09-17T08:48:00.148523+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:02.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:02 smithi136 bash[24812]: audit 2024-09-17T08:48:01.560698+0000 mon.b (mon.1) 10 : audit [INF] from='client.? 172.21.15.136:0/734395496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]: dispatch 2024-09-17T08:48:02.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:02 smithi136 bash[24812]: audit 2024-09-17T08:48:01.560889+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]: dispatch 2024-09-17T08:48:02.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:02 smithi136 bash[24812]: audit 2024-09-17T08:48:01.569819+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]': finished 2024-09-17T08:48:02.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:02 smithi136 bash[24812]: cluster 2024-09-17T08:48:01.570011+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-17T08:48:02.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:02 smithi136 bash[24812]: audit 2024-09-17T08:48:01.570268+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:02.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:02 smithi136 bash[24812]: audit 2024-09-17T08:48:02.165179+0000 mon.b (mon.1) 11 : audit [DBG] from='client.? 172.21.15.136:0/4263665520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:48:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[22670]: audit 2024-09-17T08:48:01.560698+0000 mon.b (mon.1) 10 : audit [INF] from='client.? 172.21.15.136:0/734395496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]: dispatch 2024-09-17T08:48:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[22670]: audit 2024-09-17T08:48:01.560889+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]: dispatch 2024-09-17T08:48:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[22670]: audit 2024-09-17T08:48:01.569819+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]': finished 2024-09-17T08:48:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[22670]: cluster 2024-09-17T08:48:01.570011+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-17T08:48:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[22670]: audit 2024-09-17T08:48:01.570268+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:02.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[22670]: audit 2024-09-17T08:48:02.165179+0000 mon.b (mon.1) 11 : audit [DBG] from='client.? 172.21.15.136:0/4263665520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:48:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[32124]: audit 2024-09-17T08:48:01.560698+0000 mon.b (mon.1) 10 : audit [INF] from='client.? 172.21.15.136:0/734395496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]: dispatch 2024-09-17T08:48:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[32124]: audit 2024-09-17T08:48:01.560889+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]: dispatch 2024-09-17T08:48:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[32124]: audit 2024-09-17T08:48:01.569819+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baf3a9a4-6777-4698-9a2d-92e24e144473"}]': finished 2024-09-17T08:48:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[32124]: cluster 2024-09-17T08:48:01.570011+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-17T08:48:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[32124]: audit 2024-09-17T08:48:01.570268+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:02 smithi078 bash[32124]: audit 2024-09-17T08:48:02.165179+0000 mon.b (mon.1) 11 : audit [DBG] from='client.? 172.21.15.136:0/4263665520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:48:03.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:03 smithi136 bash[24812]: cluster 2024-09-17T08:48:02.149025+0000 mgr.y (mgr.14150) 216 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:03 smithi078 bash[22670]: cluster 2024-09-17T08:48:02.149025+0000 mgr.y (mgr.14150) 216 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:03 smithi078 bash[32124]: cluster 2024-09-17T08:48:02.149025+0000 mgr.y (mgr.14150) 216 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:05.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:05 smithi136 bash[24812]: cluster 2024-09-17T08:48:04.149592+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:05 smithi078 bash[22670]: cluster 2024-09-17T08:48:04.149592+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:05 smithi078 bash[32124]: cluster 2024-09-17T08:48:04.149592+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:07.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:07 smithi136 bash[24812]: cluster 2024-09-17T08:48:06.150142+0000 mgr.y (mgr.14150) 218 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:07 smithi078 bash[22670]: cluster 2024-09-17T08:48:06.150142+0000 mgr.y (mgr.14150) 218 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:07 smithi078 bash[32124]: cluster 2024-09-17T08:48:06.150142+0000 mgr.y (mgr.14150) 218 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:09.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:09 smithi136 bash[24812]: cluster 2024-09-17T08:48:08.150696+0000 mgr.y (mgr.14150) 219 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:09 smithi078 bash[22670]: cluster 2024-09-17T08:48:08.150696+0000 mgr.y (mgr.14150) 219 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:09 smithi078 bash[32124]: cluster 2024-09-17T08:48:08.150696+0000 mgr.y (mgr.14150) 219 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:11.391 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:11 smithi136 bash[24812]: cluster 2024-09-17T08:48:10.151232+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:11 smithi078 bash[22670]: cluster 2024-09-17T08:48:10.151232+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:11 smithi078 bash[32124]: cluster 2024-09-17T08:48:10.151232+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:13.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:13 smithi136 bash[24812]: cluster 2024-09-17T08:48:12.151763+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:13 smithi078 bash[22670]: cluster 2024-09-17T08:48:12.151763+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:13 smithi078 bash[32124]: cluster 2024-09-17T08:48:12.151763+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:14.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:14 smithi136 bash[24812]: audit 2024-09-17T08:48:13.581592+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T08:48:14.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:14 smithi136 bash[24812]: audit 2024-09-17T08:48:13.583343+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:14.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:14 smithi078 bash[32124]: audit 2024-09-17T08:48:13.581592+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T08:48:14.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:14 smithi078 bash[32124]: audit 2024-09-17T08:48:13.583343+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:14.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:14 smithi078 bash[22670]: audit 2024-09-17T08:48:13.581592+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T08:48:14.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:14 smithi078 bash[22670]: audit 2024-09-17T08:48:13.583343+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:15 smithi136 bash[24812]: cephadm 2024-09-17T08:48:13.584864+0000 mgr.y (mgr.14150) 222 : cephadm [INF] Deploying daemon osd.4 on smithi136 2024-09-17T08:48:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:15 smithi136 bash[24812]: cluster 2024-09-17T08:48:14.152281+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:15 smithi078 bash[32124]: cephadm 2024-09-17T08:48:13.584864+0000 mgr.y (mgr.14150) 222 : cephadm [INF] Deploying daemon osd.4 on smithi136 2024-09-17T08:48:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:15 smithi078 bash[32124]: cluster 2024-09-17T08:48:14.152281+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:15 smithi078 bash[22670]: cephadm 2024-09-17T08:48:13.584864+0000 mgr.y (mgr.14150) 222 : cephadm [INF] Deploying daemon osd.4 on smithi136 2024-09-17T08:48:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:15 smithi078 bash[22670]: cluster 2024-09-17T08:48:14.152281+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:17.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:17 smithi136 bash[24812]: cluster 2024-09-17T08:48:16.152819+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:17 smithi078 bash[32124]: cluster 2024-09-17T08:48:16.152819+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:17 smithi078 bash[22670]: cluster 2024-09-17T08:48:16.152819+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:17.902 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:17 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:48:17.902 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:17 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:48:17.902 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:48:17 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:48:17.902 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:48:17 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:48:18.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:18 smithi136 bash[24812]: audit 2024-09-17T08:48:18.037177+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:48:18.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:18 smithi136 bash[24812]: audit 2024-09-17T08:48:18.044803+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:18.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:18 smithi136 bash[24812]: audit 2024-09-17T08:48:18.052663+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:18 smithi078 bash[32124]: audit 2024-09-17T08:48:18.037177+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:48:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:18 smithi078 bash[32124]: audit 2024-09-17T08:48:18.044803+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:18 smithi078 bash[32124]: audit 2024-09-17T08:48:18.052663+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:18 smithi078 bash[22670]: audit 2024-09-17T08:48:18.037177+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:48:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:18 smithi078 bash[22670]: audit 2024-09-17T08:48:18.044803+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:18 smithi078 bash[22670]: audit 2024-09-17T08:48:18.052663+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:19 smithi136 bash[24812]: cluster 2024-09-17T08:48:18.153353+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:19 smithi078 bash[32124]: cluster 2024-09-17T08:48:18.153353+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:19 smithi078 bash[22670]: cluster 2024-09-17T08:48:18.153353+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:21 smithi136 bash[24812]: cluster 2024-09-17T08:48:20.153881+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:21 smithi078 bash[22670]: cluster 2024-09-17T08:48:20.153881+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:21 smithi078 bash[32124]: cluster 2024-09-17T08:48:20.153881+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:23 smithi078 bash[22670]: cluster 2024-09-17T08:48:22.154464+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:23 smithi078 bash[22670]: audit 2024-09-17T08:48:23.150013+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:23 smithi078 bash[22670]: audit 2024-09-17T08:48:23.158743+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:23.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:23 smithi078 bash[32124]: cluster 2024-09-17T08:48:22.154464+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:23.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:23 smithi078 bash[32124]: audit 2024-09-17T08:48:23.150013+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:23.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:23 smithi078 bash[32124]: audit 2024-09-17T08:48:23.158743+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:23.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:23 smithi136 bash[24812]: cluster 2024-09-17T08:48:22.154464+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:23.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:23 smithi136 bash[24812]: audit 2024-09-17T08:48:23.150013+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:23.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:23 smithi136 bash[24812]: audit 2024-09-17T08:48:23.158743+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:24.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:24 smithi136 bash[24812]: audit 2024-09-17T08:48:23.660617+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:24.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:24 smithi136 bash[24812]: audit 2024-09-17T08:48:23.662522+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:48:24.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:24 smithi136 bash[24812]: audit 2024-09-17T08:48:23.672311+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:24 smithi078 bash[22670]: audit 2024-09-17T08:48:23.660617+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:24 smithi078 bash[22670]: audit 2024-09-17T08:48:23.662522+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:48:24.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:24 smithi078 bash[22670]: audit 2024-09-17T08:48:23.672311+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:24 smithi078 bash[32124]: audit 2024-09-17T08:48:23.660617+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:24 smithi078 bash[32124]: audit 2024-09-17T08:48:23.662522+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:48:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:24 smithi078 bash[32124]: audit 2024-09-17T08:48:23.672311+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:25 smithi078 bash[22670]: cluster 2024-09-17T08:48:24.155003+0000 mgr.y (mgr.14150) 228 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:25 smithi078 bash[22670]: audit 2024-09-17T08:48:24.566681+0000 mon.a (mon.0) 470 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T08:48:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:25 smithi078 bash[22670]: audit 2024-09-17T08:48:24.566807+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T08:48:25.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:25 smithi078 bash[32124]: cluster 2024-09-17T08:48:24.155003+0000 mgr.y (mgr.14150) 228 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:25.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:25 smithi078 bash[32124]: audit 2024-09-17T08:48:24.566681+0000 mon.a (mon.0) 470 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T08:48:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:25 smithi078 bash[32124]: audit 2024-09-17T08:48:24.566807+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T08:48:25.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:25 smithi136 bash[24812]: cluster 2024-09-17T08:48:24.155003+0000 mgr.y (mgr.14150) 228 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:25.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:25 smithi136 bash[24812]: audit 2024-09-17T08:48:24.566681+0000 mon.a (mon.0) 470 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T08:48:25.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:25 smithi136 bash[24812]: audit 2024-09-17T08:48:24.566807+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T08:48:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[22670]: audit 2024-09-17T08:48:25.316505+0000 mon.a (mon.0) 471 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T08:48:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[22670]: cluster 2024-09-17T08:48:25.316700+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-17T08:48:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[22670]: audit 2024-09-17T08:48:25.316954+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[22670]: audit 2024-09-17T08:48:25.318645+0000 mon.a (mon.0) 474 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:48:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[22670]: audit 2024-09-17T08:48:25.318654+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:48:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[32124]: audit 2024-09-17T08:48:25.316505+0000 mon.a (mon.0) 471 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T08:48:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[32124]: cluster 2024-09-17T08:48:25.316700+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-17T08:48:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[32124]: audit 2024-09-17T08:48:25.316954+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[32124]: audit 2024-09-17T08:48:25.318645+0000 mon.a (mon.0) 474 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:48:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:26 smithi078 bash[32124]: audit 2024-09-17T08:48:25.318654+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:48:26.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.649+0000 7fab76ffd640 1 -- 172.21.15.136:0/3806892959 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fab8010adc0 con 0x7fab6c06ce00 2024-09-17T08:48:26.652 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 4 on host 'smithi136' 2024-09-17T08:48:26.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fab6c06ce00 msgr2=0x7fab6c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fab6c06ce00 0x7fab6c06f2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab70005940 tx=0x7fab700058d0 comp rx=0 tx=0).stop 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab80101b90 msgr2=0x7fab8019c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab80101b90 0x7fab8019c910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab7800b970 tx=0x7fab7800be30 comp rx=0 tx=0).stop 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 shutdown_connections 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fab6c06ce00 0x7fab6c06f2c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab80101b90 0x7fab8019c910 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab801011d0 0x7fab80195890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 --2- 172.21.15.136:0/3806892959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab800fe150 0x7fab80195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 >> 172.21.15.136:0/3806892959 conn(0x7fab800f9ca0 msgr2=0x7fab800fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 shutdown_connections 2024-09-17T08:48:26.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:26.653+0000 7fab87ad5640 1 -- 172.21.15.136:0/3806892959 wait complete. 2024-09-17T08:48:26.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:26 smithi136 bash[24812]: audit 2024-09-17T08:48:25.316505+0000 mon.a (mon.0) 471 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T08:48:26.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:26 smithi136 bash[24812]: cluster 2024-09-17T08:48:25.316700+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-17T08:48:26.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:26 smithi136 bash[24812]: audit 2024-09-17T08:48:25.316954+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:26.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:26 smithi136 bash[24812]: audit 2024-09-17T08:48:25.318645+0000 mon.a (mon.0) 474 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:48:26.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:26 smithi136 bash[24812]: audit 2024-09-17T08:48:25.318654+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:48:27.239 DEBUG:teuthology.orchestra.run.smithi136:osd.4> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T08:48:27.241 INFO:tasks.cephadm:Deploying osd.5 on smithi136 with /dev/vg_nvme/lv_3... 2024-09-17T08:48:27.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-17T08:48:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: cluster 2024-09-17T08:48:26.155519+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: audit 2024-09-17T08:48:26.320041+0000 mon.a (mon.0) 475 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: cluster 2024-09-17T08:48:26.320207+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: audit 2024-09-17T08:48:26.320889+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: audit 2024-09-17T08:48:26.333882+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: audit 2024-09-17T08:48:26.632955+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: audit 2024-09-17T08:48:26.640636+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: audit 2024-09-17T08:48:26.649030+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: cluster 2024-09-17T08:48:27.322995+0000 mon.a (mon.0) 482 : cluster [INF] osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] boot 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: cluster 2024-09-17T08:48:27.323097+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-17T08:48:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:27 smithi136 bash[24812]: audit 2024-09-17T08:48:27.323540+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: cluster 2024-09-17T08:48:26.155519+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:27.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: audit 2024-09-17T08:48:26.320041+0000 mon.a (mon.0) 475 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: cluster 2024-09-17T08:48:26.320207+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: audit 2024-09-17T08:48:26.320889+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: audit 2024-09-17T08:48:26.333882+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: audit 2024-09-17T08:48:26.632955+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: audit 2024-09-17T08:48:26.640636+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: audit 2024-09-17T08:48:26.649030+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: cluster 2024-09-17T08:48:27.322995+0000 mon.a (mon.0) 482 : cluster [INF] osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] boot 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: cluster 2024-09-17T08:48:27.323097+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[22670]: audit 2024-09-17T08:48:27.323540+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: cluster 2024-09-17T08:48:26.155519+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: audit 2024-09-17T08:48:26.320041+0000 mon.a (mon.0) 475 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: cluster 2024-09-17T08:48:26.320207+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: audit 2024-09-17T08:48:26.320889+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: audit 2024-09-17T08:48:26.333882+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: audit 2024-09-17T08:48:26.632955+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: audit 2024-09-17T08:48:26.640636+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: audit 2024-09-17T08:48:26.649030+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: cluster 2024-09-17T08:48:27.322995+0000 mon.a (mon.0) 482 : cluster [INF] osd.4 [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] boot 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: cluster 2024-09-17T08:48:27.323097+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-17T08:48:27.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:27 smithi078 bash[32124]: audit 2024-09-17T08:48:27.323540+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:48:28.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:28 smithi078 bash[22670]: cluster 2024-09-17T08:48:25.595810+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:48:28.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:28 smithi078 bash[22670]: cluster 2024-09-17T08:48:25.595964+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:48:28.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:28 smithi078 bash[22670]: cluster 2024-09-17T08:48:28.325728+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-17T08:48:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:28 smithi078 bash[32124]: cluster 2024-09-17T08:48:25.595810+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:48:28.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:28 smithi078 bash[32124]: cluster 2024-09-17T08:48:25.595964+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:48:28.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:28 smithi078 bash[32124]: cluster 2024-09-17T08:48:28.325728+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-17T08:48:28.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:28 smithi136 bash[24812]: cluster 2024-09-17T08:48:25.595810+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:48:28.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:28 smithi136 bash[24812]: cluster 2024-09-17T08:48:25.595964+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:48:28.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:28 smithi136 bash[24812]: cluster 2024-09-17T08:48:28.325728+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-17T08:48:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:29 smithi078 bash[22670]: cluster 2024-09-17T08:48:28.156075+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:29 smithi078 bash[22670]: cluster 2024-09-17T08:48:29.326737+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-17T08:48:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:29 smithi078 bash[32124]: cluster 2024-09-17T08:48:28.156075+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:29 smithi078 bash[32124]: cluster 2024-09-17T08:48:29.326737+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-17T08:48:29.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:29 smithi136 bash[24812]: cluster 2024-09-17T08:48:28.156075+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:29.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:29 smithi136 bash[24812]: cluster 2024-09-17T08:48:29.326737+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-17T08:48:31.468 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:48:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:31 smithi078 bash[32124]: cluster 2024-09-17T08:48:30.156637+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:31 smithi078 bash[32124]: cluster 2024-09-17T08:48:30.352617+0000 mon.a (mon.0) 487 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-17T08:48:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:31 smithi078 bash[22670]: cluster 2024-09-17T08:48:30.156637+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:31 smithi078 bash[22670]: cluster 2024-09-17T08:48:30.352617+0000 mon.a (mon.0) 487 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-17T08:48:31.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:31 smithi136 bash[24812]: cluster 2024-09-17T08:48:30.156637+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:31.645 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:31 smithi136 bash[24812]: cluster 2024-09-17T08:48:30.352617+0000 mon.a (mon.0) 487 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-17T08:48:32.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:32 smithi136 bash[24812]: cluster 2024-09-17T08:48:31.362270+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2024-09-17T08:48:32.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:32 smithi078 bash[32124]: cluster 2024-09-17T08:48:31.362270+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2024-09-17T08:48:32.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:32 smithi078 bash[22670]: cluster 2024-09-17T08:48:31.362270+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2024-09-17T08:48:33.642 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:33 smithi136 bash[24812]: cluster 2024-09-17T08:48:32.157165+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:33 smithi078 bash[32124]: cluster 2024-09-17T08:48:32.157165+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:33 smithi078 bash[22670]: cluster 2024-09-17T08:48:32.157165+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:35.785 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-17T08:48:35.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:35 smithi136 bash[24812]: cluster 2024-09-17T08:48:34.157775+0000 mgr.y (mgr.14150) 233 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-17T08:48:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:35 smithi078 bash[32124]: cluster 2024-09-17T08:48:34.157775+0000 mgr.y (mgr.14150) 233 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-17T08:48:35.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:35 smithi078 bash[22670]: cluster 2024-09-17T08:48:34.157775+0000 mgr.y (mgr.14150) 233 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-17T08:48:35.979 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-17T08:48:35.992 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-09-17T08:48:35.992 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-09-17T08:48:35.993 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111906 s, 937 MB/s 2024-09-17T08:48:35.993 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-09-17T08:48:36.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2024-09-17T08:48:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: cluster 2024-09-17T08:48:36.158339+0000 mgr.y (mgr.14150) 234 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-17T08:48:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: audit 2024-09-17T08:48:37.058396+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: audit 2024-09-17T08:48:37.068460+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: audit 2024-09-17T08:48:37.070375+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:48:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: audit 2024-09-17T08:48:37.083138+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: audit 2024-09-17T08:48:37.085589+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: audit 2024-09-17T08:48:37.087456+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:48:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:37 smithi136 bash[24812]: audit 2024-09-17T08:48:37.097272+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: cluster 2024-09-17T08:48:36.158339+0000 mgr.y (mgr.14150) 234 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-17T08:48:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: audit 2024-09-17T08:48:37.058396+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: audit 2024-09-17T08:48:37.068460+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: audit 2024-09-17T08:48:37.070375+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: audit 2024-09-17T08:48:37.083138+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: audit 2024-09-17T08:48:37.085589+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: audit 2024-09-17T08:48:37.087456+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[22670]: audit 2024-09-17T08:48:37.097272+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: cluster 2024-09-17T08:48:36.158339+0000 mgr.y (mgr.14150) 234 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: audit 2024-09-17T08:48:37.058396+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: audit 2024-09-17T08:48:37.068460+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: audit 2024-09-17T08:48:37.070375+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: audit 2024-09-17T08:48:37.083138+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: audit 2024-09-17T08:48:37.085589+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: audit 2024-09-17T08:48:37.087456+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:48:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:37 smithi078 bash[32124]: audit 2024-09-17T08:48:37.097272+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:48:38.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:38 smithi136 bash[24812]: cephadm 2024-09-17T08:48:37.049497+0000 mgr.y (mgr.14150) 235 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:48:38.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:38 smithi136 bash[24812]: cephadm 2024-09-17T08:48:37.071733+0000 mgr.y (mgr.14150) 236 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 17265M 2024-09-17T08:48:38.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:38 smithi078 bash[22670]: cephadm 2024-09-17T08:48:37.049497+0000 mgr.y (mgr.14150) 235 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:48:38.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:38 smithi078 bash[22670]: cephadm 2024-09-17T08:48:37.071733+0000 mgr.y (mgr.14150) 236 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 17265M 2024-09-17T08:48:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:38 smithi078 bash[32124]: cephadm 2024-09-17T08:48:37.049497+0000 mgr.y (mgr.14150) 235 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:48:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:38 smithi078 bash[32124]: cephadm 2024-09-17T08:48:37.071733+0000 mgr.y (mgr.14150) 236 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 17265M 2024-09-17T08:48:39.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:39 smithi136 bash[24812]: cluster 2024-09-17T08:48:38.158916+0000 mgr.y (mgr.14150) 237 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:48:39.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:39 smithi078 bash[32124]: cluster 2024-09-17T08:48:38.158916+0000 mgr.y (mgr.14150) 237 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:48:39.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:39 smithi078 bash[22670]: cluster 2024-09-17T08:48:38.158916+0000 mgr.y (mgr.14150) 237 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:48:41.616 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:48:41.719 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:41 smithi136 bash[24812]: cluster 2024-09-17T08:48:40.159477+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-17T08:48:41.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:41 smithi078 bash[32124]: cluster 2024-09-17T08:48:40.159477+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-17T08:48:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:41 smithi078 bash[22670]: cluster 2024-09-17T08:48:40.159477+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-17T08:48:43.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:43 smithi136 bash[24812]: cluster 2024-09-17T08:48:42.160019+0000 mgr.y (mgr.14150) 239 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-17T08:48:43.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:43 smithi078 bash[32124]: cluster 2024-09-17T08:48:42.160019+0000 mgr.y (mgr.14150) 239 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-17T08:48:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:43 smithi078 bash[22670]: cluster 2024-09-17T08:48:42.160019+0000 mgr.y (mgr.14150) 239 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 -- 172.21.15.136:0/1102379203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc107cc0 msgr2=0x7f9cbc10a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 --2- 172.21.15.136:0/1102379203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc107cc0 0x7f9cbc10a180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ca0 tx=0x7f9cb402a8c0 comp rx=0 tx=0).stop 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 -- 172.21.15.136:0/1102379203 shutdown_connections 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 --2- 172.21.15.136:0/1102379203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc107cc0 0x7f9cbc10a180 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 --2- 172.21.15.136:0/1102379203 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9cbc072f10 0x7f9cbc073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 --2- 172.21.15.136:0/1102379203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cbc0744e0 0x7f9cbc072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 -- 172.21.15.136:0/1102379203 >> 172.21.15.136:0/1102379203 conn(0x7f9cbc0fb5d0 msgr2=0x7f9cbc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 -- 172.21.15.136:0/1102379203 shutdown_connections 2024-09-17T08:48:44.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.380+0000 7f9cc1579640 1 -- 172.21.15.136:0/1102379203 wait complete. 2024-09-17T08:48:44.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 Processor -- start 2024-09-17T08:48:44.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 -- start start 2024-09-17T08:48:44.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9cbc072f10 0x7f9cbc1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:48:44.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc0744e0 0x7f9cbc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:48:44.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cbc107cc0 0x7f9cbc19ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:48:44.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc19efc0 con 0x7f9cbc107cc0 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc19f130 con 0x7f9cbc0744e0 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc19f2f0 con 0x7f9cbc072f10 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc0744e0 0x7f9cbc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc0744e0 0x7f9cbc197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40302/0 (socket says 172.21.15.136:40302) 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 -- 172.21.15.136:0/505230996 learned_addr learned my addr 172.21.15.136:0/505230996 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cbb7fe640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cbc107cc0 0x7f9cbc19ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cbaffd640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9cbc072f10 0x7f9cbc1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 -- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9cbc072f10 msgr2=0x7f9cbc1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9cbc072f10 0x7f9cbc1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 -- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cbc107cc0 msgr2=0x7f9cbc19ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:48:44.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cbc107cc0 0x7f9cbc19ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:48:44.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 -- 172.21.15.136:0/505230996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009900 con 0x7f9cbc0744e0 2024-09-17T08:48:44.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb3fff640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc0744e0 0x7f9cbc197a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c970 tx=0x7f9ca400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:48:44.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb8ff9640 1 -- 172.21.15.136:0/505230996 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4007bb0 con 0x7f9cbc0744e0 2024-09-17T08:48:44.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc19f5d0 con 0x7f9cbc0744e0 2024-09-17T08:48:44.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb8ff9640 1 -- 172.21.15.136:0/505230996 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f9ca4007d10 con 0x7f9cbc0744e0 2024-09-17T08:48:44.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb8ff9640 1 -- 172.21.15.136:0/505230996 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4004c40 con 0x7f9cbc0744e0 2024-09-17T08:48:44.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc19fa80 con 0x7f9cbc0744e0 2024-09-17T08:48:44.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc073370 con 0x7f9cbc0744e0 2024-09-17T08:48:44.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb8ff9640 1 -- 172.21.15.136:0/505230996 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7f9ca4004de0 con 0x7f9cbc0744e0 2024-09-17T08:48:44.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb8ff9640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f9ca806ce00 0x7f9ca806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:48:44.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.384+0000 7f9cb8ff9640 1 -- 172.21.15.136:0/505230996 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3991+0+0 (secure 0 0 0) 0x7f9ca408b990 con 0x7f9cbc0744e0 2024-09-17T08:48:44.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.388+0000 7f9cbaffd640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f9ca806ce00 0x7f9ca806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:48:44.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.388+0000 7f9cbaffd640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f9ca806ce00 0x7f9ca806f2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0058c0 tx=0x7f9cac00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:48:44.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.392+0000 7f9cb8ff9640 1 -- 172.21.15.136:0/505230996 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9ca4056320 con 0x7f9cbc0744e0 2024-09-17T08:48:44.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:48:44.576+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cbc10d030 con 0x7f9ca806ce00 2024-09-17T08:48:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:45 smithi136 bash[24812]: cluster 2024-09-17T08:48:44.160612+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:48:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:45 smithi136 bash[24812]: audit 2024-09-17T08:48:44.588319+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:48:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:45 smithi136 bash[24812]: audit 2024-09-17T08:48:44.594778+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:48:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:45 smithi136 bash[24812]: audit 2024-09-17T08:48:44.596749+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[32124]: cluster 2024-09-17T08:48:44.160612+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:48:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[32124]: audit 2024-09-17T08:48:44.588319+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:48:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[32124]: audit 2024-09-17T08:48:44.594778+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:48:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[32124]: audit 2024-09-17T08:48:44.596749+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[22670]: cluster 2024-09-17T08:48:44.160612+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:48:45.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[22670]: audit 2024-09-17T08:48:44.588319+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:48:45.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[22670]: audit 2024-09-17T08:48:44.594778+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:48:45.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:45 smithi078 bash[22670]: audit 2024-09-17T08:48:44.596749+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:48:46.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:46 smithi136 bash[24812]: audit 2024-09-17T08:48:44.581907+0000 mgr.y (mgr.14150) 241 : audit [DBG] from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:48:46.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:46 smithi078 bash[32124]: audit 2024-09-17T08:48:44.581907+0000 mgr.y (mgr.14150) 241 : audit [DBG] from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:48:46.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:46 smithi078 bash[22670]: audit 2024-09-17T08:48:44.581907+0000 mgr.y (mgr.14150) 241 : audit [DBG] from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:48:47.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:47 smithi136 bash[24812]: cluster 2024-09-17T08:48:46.161138+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:47.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:47 smithi078 bash[32124]: cluster 2024-09-17T08:48:46.161138+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:47.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:47 smithi078 bash[22670]: cluster 2024-09-17T08:48:46.161138+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:49.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:49 smithi136 bash[24812]: cluster 2024-09-17T08:48:48.161682+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:49.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:49 smithi078 bash[22670]: cluster 2024-09-17T08:48:48.161682+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:49.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:49 smithi078 bash[32124]: cluster 2024-09-17T08:48:48.161682+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:51 smithi136 bash[24812]: cluster 2024-09-17T08:48:50.162235+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:51 smithi078 bash[22670]: cluster 2024-09-17T08:48:50.162235+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:51.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:51 smithi078 bash[32124]: cluster 2024-09-17T08:48:50.162235+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:53.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:53 smithi136 bash[24812]: cluster 2024-09-17T08:48:52.162826+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:53.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:53 smithi136 bash[24812]: audit 2024-09-17T08:48:52.815013+0000 mon.a (mon.0) 499 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]: dispatch 2024-09-17T08:48:53.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:53 smithi136 bash[24812]: audit 2024-09-17T08:48:52.815346+0000 mon.b (mon.1) 14 : audit [INF] from='client.? 172.21.15.136:0/4021301090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]: dispatch 2024-09-17T08:48:53.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:53 smithi136 bash[24812]: audit 2024-09-17T08:48:52.828401+0000 mon.a (mon.0) 500 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]': finished 2024-09-17T08:48:53.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:53 smithi136 bash[24812]: cluster 2024-09-17T08:48:52.828510+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-17T08:48:53.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:53 smithi136 bash[24812]: audit 2024-09-17T08:48:52.828747+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:48:53.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[32124]: cluster 2024-09-17T08:48:52.162826+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:53.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[32124]: audit 2024-09-17T08:48:52.815013+0000 mon.a (mon.0) 499 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]: dispatch 2024-09-17T08:48:53.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[32124]: audit 2024-09-17T08:48:52.815346+0000 mon.b (mon.1) 14 : audit [INF] from='client.? 172.21.15.136:0/4021301090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]: dispatch 2024-09-17T08:48:53.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[32124]: audit 2024-09-17T08:48:52.828401+0000 mon.a (mon.0) 500 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]': finished 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[32124]: cluster 2024-09-17T08:48:52.828510+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[32124]: audit 2024-09-17T08:48:52.828747+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[22670]: cluster 2024-09-17T08:48:52.162826+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[22670]: audit 2024-09-17T08:48:52.815013+0000 mon.a (mon.0) 499 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]: dispatch 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[22670]: audit 2024-09-17T08:48:52.815346+0000 mon.b (mon.1) 14 : audit [INF] from='client.? 172.21.15.136:0/4021301090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]: dispatch 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[22670]: audit 2024-09-17T08:48:52.828401+0000 mon.a (mon.0) 500 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d3392e2-86a8-480b-9bdd-b4fe43046626"}]': finished 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[22670]: cluster 2024-09-17T08:48:52.828510+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-17T08:48:53.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:53 smithi078 bash[22670]: audit 2024-09-17T08:48:52.828747+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:48:54.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:54 smithi136 bash[24812]: audit 2024-09-17T08:48:53.499445+0000 mon.b (mon.1) 15 : audit [DBG] from='client.? 172.21.15.136:0/3627859709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:48:54.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:54 smithi078 bash[32124]: audit 2024-09-17T08:48:53.499445+0000 mon.b (mon.1) 15 : audit [DBG] from='client.? 172.21.15.136:0/3627859709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:48:54.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:54 smithi078 bash[22670]: audit 2024-09-17T08:48:53.499445+0000 mon.b (mon.1) 15 : audit [DBG] from='client.? 172.21.15.136:0/3627859709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:48:55.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:55 smithi136 bash[24812]: cluster 2024-09-17T08:48:54.163377+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:55 smithi078 bash[22670]: cluster 2024-09-17T08:48:54.163377+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:55.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:55 smithi078 bash[32124]: cluster 2024-09-17T08:48:54.163377+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:57.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:57 smithi136 bash[24812]: cluster 2024-09-17T08:48:56.163928+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:57 smithi078 bash[22670]: cluster 2024-09-17T08:48:56.163928+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:57.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:57 smithi078 bash[32124]: cluster 2024-09-17T08:48:56.163928+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:59.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:48:59 smithi136 bash[24812]: cluster 2024-09-17T08:48:58.164487+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:59.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:48:59 smithi078 bash[22670]: cluster 2024-09-17T08:48:58.164487+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:48:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:48:59 smithi078 bash[32124]: cluster 2024-09-17T08:48:58.164487+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:01.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:01 smithi136 bash[24812]: cluster 2024-09-17T08:49:00.165031+0000 mgr.y (mgr.14150) 249 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:01 smithi078 bash[22670]: cluster 2024-09-17T08:49:00.165031+0000 mgr.y (mgr.14150) 249 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:01.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:01 smithi078 bash[32124]: cluster 2024-09-17T08:49:00.165031+0000 mgr.y (mgr.14150) 249 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:03.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:03 smithi136 bash[24812]: cluster 2024-09-17T08:49:02.165581+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:03 smithi078 bash[22670]: cluster 2024-09-17T08:49:02.165581+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:03 smithi078 bash[32124]: cluster 2024-09-17T08:49:02.165581+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:05.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:05 smithi136 bash[24812]: cluster 2024-09-17T08:49:04.166115+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:05.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:05 smithi136 bash[24812]: audit 2024-09-17T08:49:05.227378+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T08:49:05.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:05 smithi136 bash[24812]: audit 2024-09-17T08:49:05.229005+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:05.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:05 smithi078 bash[22670]: cluster 2024-09-17T08:49:04.166115+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:05.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:05 smithi078 bash[22670]: audit 2024-09-17T08:49:05.227378+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T08:49:05.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:05 smithi078 bash[22670]: audit 2024-09-17T08:49:05.229005+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:05.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:05 smithi078 bash[32124]: cluster 2024-09-17T08:49:04.166115+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:05.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:05 smithi078 bash[32124]: audit 2024-09-17T08:49:05.227378+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T08:49:05.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:05 smithi078 bash[32124]: audit 2024-09-17T08:49:05.229005+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:06 smithi136 bash[24812]: cephadm 2024-09-17T08:49:05.230311+0000 mgr.y (mgr.14150) 252 : cephadm [INF] Deploying daemon osd.5 on smithi136 2024-09-17T08:49:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:06 smithi078 bash[22670]: cephadm 2024-09-17T08:49:05.230311+0000 mgr.y (mgr.14150) 252 : cephadm [INF] Deploying daemon osd.5 on smithi136 2024-09-17T08:49:06.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:06 smithi078 bash[32124]: cephadm 2024-09-17T08:49:05.230311+0000 mgr.y (mgr.14150) 252 : cephadm [INF] Deploying daemon osd.5 on smithi136 2024-09-17T08:49:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:07 smithi136 bash[24812]: cluster 2024-09-17T08:49:06.166667+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:07 smithi078 bash[22670]: cluster 2024-09-17T08:49:06.166667+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:07 smithi078 bash[32124]: cluster 2024-09-17T08:49:06.166667+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:08.517 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:08 smithi136 bash[24812]: cluster 2024-09-17T08:49:08.167199+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:08.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:08 smithi078 bash[22670]: cluster 2024-09-17T08:49:08.167199+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:08.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:08 smithi078 bash[32124]: cluster 2024-09-17T08:49:08.167199+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:09.453 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:49:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:49:09.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:49:09.454 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:49:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:49:09.781 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:49:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:49:09.782 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:49:09.782 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:49:09 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:49:10.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:09 smithi136 bash[24812]: audit 2024-09-17T08:49:09.730844+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:49:10.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:09 smithi136 bash[24812]: audit 2024-09-17T08:49:09.738280+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:10.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:09 smithi136 bash[24812]: audit 2024-09-17T08:49:09.748761+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:09 smithi078 bash[22670]: audit 2024-09-17T08:49:09.730844+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:49:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:09 smithi078 bash[22670]: audit 2024-09-17T08:49:09.738280+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:09 smithi078 bash[22670]: audit 2024-09-17T08:49:09.748761+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:10.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:09 smithi078 bash[32124]: audit 2024-09-17T08:49:09.730844+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:49:10.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:09 smithi078 bash[32124]: audit 2024-09-17T08:49:09.738280+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:10.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:09 smithi078 bash[32124]: audit 2024-09-17T08:49:09.748761+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:11.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:10 smithi136 bash[24812]: cluster 2024-09-17T08:49:10.167749+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:10 smithi078 bash[22670]: cluster 2024-09-17T08:49:10.167749+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:11.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:10 smithi078 bash[32124]: cluster 2024-09-17T08:49:10.167749+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:13.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:13 smithi136 bash[24812]: cluster 2024-09-17T08:49:12.168337+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:13 smithi078 bash[22670]: cluster 2024-09-17T08:49:12.168337+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:13 smithi078 bash[32124]: cluster 2024-09-17T08:49:12.168337+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:15.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:15 smithi136 bash[24812]: cluster 2024-09-17T08:49:14.168887+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:15 smithi136 bash[24812]: audit 2024-09-17T08:49:14.858600+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:15 smithi136 bash[24812]: audit 2024-09-17T08:49:14.867605+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:15 smithi136 bash[24812]: audit 2024-09-17T08:49:14.869382+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:15 smithi136 bash[24812]: audit 2024-09-17T08:49:14.871567+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:49:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:15 smithi136 bash[24812]: audit 2024-09-17T08:49:14.881603+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[32124]: cluster 2024-09-17T08:49:14.168887+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[32124]: audit 2024-09-17T08:49:14.858600+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[32124]: audit 2024-09-17T08:49:14.867605+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[32124]: audit 2024-09-17T08:49:14.869382+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[32124]: audit 2024-09-17T08:49:14.871567+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:49:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[32124]: audit 2024-09-17T08:49:14.881603+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[22670]: cluster 2024-09-17T08:49:14.168887+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:15.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[22670]: audit 2024-09-17T08:49:14.858600+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[22670]: audit 2024-09-17T08:49:14.867605+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:15.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[22670]: audit 2024-09-17T08:49:14.869382+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:15.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[22670]: audit 2024-09-17T08:49:14.871567+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:49:15.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:15 smithi078 bash[22670]: audit 2024-09-17T08:49:14.881603+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:16.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:16 smithi136 bash[24812]: audit 2024-09-17T08:49:16.220418+0000 mon.a (mon.0) 513 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T08:49:16.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:16 smithi136 bash[24812]: audit 2024-09-17T08:49:16.221016+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T08:49:16.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:16 smithi078 bash[22670]: audit 2024-09-17T08:49:16.220418+0000 mon.a (mon.0) 513 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T08:49:16.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:16 smithi078 bash[22670]: audit 2024-09-17T08:49:16.221016+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T08:49:16.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:16 smithi078 bash[32124]: audit 2024-09-17T08:49:16.220418+0000 mon.a (mon.0) 513 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T08:49:16.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:16 smithi078 bash[32124]: audit 2024-09-17T08:49:16.221016+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T08:49:17.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:17 smithi136 bash[24812]: cluster 2024-09-17T08:49:16.169489+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:17.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:17 smithi136 bash[24812]: audit 2024-09-17T08:49:16.242743+0000 mon.a (mon.0) 514 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T08:49:17.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:17 smithi136 bash[24812]: cluster 2024-09-17T08:49:16.243003+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-17T08:49:17.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:17 smithi136 bash[24812]: audit 2024-09-17T08:49:16.243313+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:17.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:17 smithi136 bash[24812]: audit 2024-09-17T08:49:16.244265+0000 mon.a (mon.0) 517 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:49:17.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:17 smithi136 bash[24812]: audit 2024-09-17T08:49:16.244849+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:49:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[22670]: cluster 2024-09-17T08:49:16.169489+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[22670]: audit 2024-09-17T08:49:16.242743+0000 mon.a (mon.0) 514 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T08:49:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[22670]: cluster 2024-09-17T08:49:16.243003+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-17T08:49:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[22670]: audit 2024-09-17T08:49:16.243313+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[22670]: audit 2024-09-17T08:49:16.244265+0000 mon.a (mon.0) 517 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:49:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[22670]: audit 2024-09-17T08:49:16.244849+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:49:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[32124]: cluster 2024-09-17T08:49:16.169489+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[32124]: audit 2024-09-17T08:49:16.242743+0000 mon.a (mon.0) 514 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T08:49:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[32124]: cluster 2024-09-17T08:49:16.243003+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-17T08:49:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[32124]: audit 2024-09-17T08:49:16.243313+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[32124]: audit 2024-09-17T08:49:16.244265+0000 mon.a (mon.0) 517 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:49:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:17 smithi078 bash[32124]: audit 2024-09-17T08:49:16.244849+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:49:18.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cb8ff9640 1 -- 172.21.15.136:0/505230996 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9cbc10d030 con 0x7f9ca806ce00 2024-09-17T08:49:18.298 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 5 on host 'smithi136' 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f9ca806ce00 msgr2=0x7f9ca806f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f9ca806ce00 0x7f9ca806f2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0058c0 tx=0x7f9cac00a4c0 comp rx=0 tx=0).stop 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc0744e0 msgr2=0x7f9cbc197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc0744e0 0x7f9cbc197a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c970 tx=0x7f9ca400ce30 comp rx=0 tx=0).stop 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 shutdown_connections 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f9ca806ce00 0x7f9ca806f2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cbc107cc0 0x7f9cbc19ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cbc0744e0 0x7f9cbc197a00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 --2- 172.21.15.136:0/505230996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9cbc072f10 0x7f9cbc1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 >> 172.21.15.136:0/505230996 conn(0x7f9cbc0fb5d0 msgr2=0x7f9cbc1099f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.296+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 shutdown_connections 2024-09-17T08:49:18.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:18.300+0000 7f9cc1579640 1 -- 172.21.15.136:0/505230996 wait complete. 2024-09-17T08:49:18.526 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:18 smithi136 bash[24812]: audit 2024-09-17T08:49:17.244484+0000 mon.a (mon.0) 518 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:49:18.526 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:18 smithi136 bash[24812]: cluster 2024-09-17T08:49:17.244791+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e38: 6 total, 5 up, 6 in 2024-09-17T08:49:18.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:18 smithi136 bash[24812]: audit 2024-09-17T08:49:17.245628+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:18.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:18 smithi136 bash[24812]: audit 2024-09-17T08:49:17.255415+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[22670]: audit 2024-09-17T08:49:17.244484+0000 mon.a (mon.0) 518 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[22670]: cluster 2024-09-17T08:49:17.244791+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e38: 6 total, 5 up, 6 in 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[22670]: audit 2024-09-17T08:49:17.245628+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[22670]: audit 2024-09-17T08:49:17.255415+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[32124]: audit 2024-09-17T08:49:17.244484+0000 mon.a (mon.0) 518 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[32124]: cluster 2024-09-17T08:49:17.244791+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e38: 6 total, 5 up, 6 in 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[32124]: audit 2024-09-17T08:49:17.245628+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:18 smithi078 bash[32124]: audit 2024-09-17T08:49:17.255415+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:18.938 DEBUG:teuthology.orchestra.run.smithi136:osd.5> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T08:49:18.941 INFO:tasks.cephadm:Deploying osd.6 on smithi136 with /dev/vg_nvme/lv_2... 2024-09-17T08:49:18.941 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: cluster 2024-09-17T08:49:17.170637+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: cluster 2024-09-17T08:49:17.170745+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: cluster 2024-09-17T08:49:18.170042+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: audit 2024-09-17T08:49:18.254956+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: cluster 2024-09-17T08:49:18.266351+0000 mon.a (mon.0) 523 : cluster [INF] osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] boot 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: cluster 2024-09-17T08:49:18.266459+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: audit 2024-09-17T08:49:18.266834+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: audit 2024-09-17T08:49:18.279157+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: audit 2024-09-17T08:49:18.286257+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:19 smithi136 bash[24812]: audit 2024-09-17T08:49:18.295020+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: cluster 2024-09-17T08:49:17.170637+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: cluster 2024-09-17T08:49:17.170745+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: cluster 2024-09-17T08:49:18.170042+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: audit 2024-09-17T08:49:18.254956+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: cluster 2024-09-17T08:49:18.266351+0000 mon.a (mon.0) 523 : cluster [INF] osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] boot 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: cluster 2024-09-17T08:49:18.266459+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: audit 2024-09-17T08:49:18.266834+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: audit 2024-09-17T08:49:18.279157+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: audit 2024-09-17T08:49:18.286257+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[22670]: audit 2024-09-17T08:49:18.295020+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: cluster 2024-09-17T08:49:17.170637+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: cluster 2024-09-17T08:49:17.170745+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: cluster 2024-09-17T08:49:18.170042+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: audit 2024-09-17T08:49:18.254956+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: cluster 2024-09-17T08:49:18.266351+0000 mon.a (mon.0) 523 : cluster [INF] osd.5 [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] boot 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: cluster 2024-09-17T08:49:18.266459+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: audit 2024-09-17T08:49:18.266834+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: audit 2024-09-17T08:49:18.279157+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:49:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: audit 2024-09-17T08:49:18.286257+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:19.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:19 smithi078 bash[32124]: audit 2024-09-17T08:49:18.295020+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:20 smithi136 bash[24812]: cluster 2024-09-17T08:49:19.265562+0000 mon.a (mon.0) 529 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-17T08:49:20.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:20 smithi136 bash[24812]: cluster 2024-09-17T08:49:20.267089+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-17T08:49:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:20 smithi078 bash[22670]: cluster 2024-09-17T08:49:19.265562+0000 mon.a (mon.0) 529 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-17T08:49:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:20 smithi078 bash[22670]: cluster 2024-09-17T08:49:20.267089+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-17T08:49:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:20 smithi078 bash[32124]: cluster 2024-09-17T08:49:19.265562+0000 mon.a (mon.0) 529 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-17T08:49:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:20 smithi078 bash[32124]: cluster 2024-09-17T08:49:20.267089+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-17T08:49:21.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:21 smithi136 bash[24812]: cluster 2024-09-17T08:49:20.170723+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:21.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:21 smithi136 bash[24812]: cluster 2024-09-17T08:49:20.267821+0000 mon.a (mon.0) 531 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T08:49:21.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:21 smithi136 bash[24812]: cluster 2024-09-17T08:49:20.501505+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-17T08:49:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:21 smithi078 bash[22670]: cluster 2024-09-17T08:49:20.170723+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:21 smithi078 bash[22670]: cluster 2024-09-17T08:49:20.267821+0000 mon.a (mon.0) 531 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T08:49:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:21 smithi078 bash[22670]: cluster 2024-09-17T08:49:20.501505+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-17T08:49:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:21 smithi078 bash[32124]: cluster 2024-09-17T08:49:20.170723+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:21 smithi078 bash[32124]: cluster 2024-09-17T08:49:20.267821+0000 mon.a (mon.0) 531 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T08:49:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:21 smithi078 bash[32124]: cluster 2024-09-17T08:49:20.501505+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-17T08:49:22.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:22 smithi136 bash[24812]: cluster 2024-09-17T08:49:21.505574+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-09-17T08:49:22.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:22 smithi136 bash[24812]: cluster 2024-09-17T08:49:22.171300+0000 mgr.y (mgr.14150) 261 : cluster [DBG] pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:22.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:22 smithi078 bash[22670]: cluster 2024-09-17T08:49:21.505574+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-09-17T08:49:22.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:22 smithi078 bash[22670]: cluster 2024-09-17T08:49:22.171300+0000 mgr.y (mgr.14150) 261 : cluster [DBG] pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:22.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:22 smithi078 bash[32124]: cluster 2024-09-17T08:49:21.505574+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-09-17T08:49:22.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:22 smithi078 bash[32124]: cluster 2024-09-17T08:49:22.171300+0000 mgr.y (mgr.14150) 261 : cluster [DBG] pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:23.126 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:49:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:25 smithi136 bash[24812]: cluster 2024-09-17T08:49:24.171887+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:25.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:25 smithi078 bash[32124]: cluster 2024-09-17T08:49:24.171887+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:25 smithi078 bash[22670]: cluster 2024-09-17T08:49:24.171887+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:26.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:26 smithi136 bash[24812]: cluster 2024-09-17T08:49:26.227084+0000 mon.a (mon.0) 534 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T08:49:26.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:26 smithi136 bash[24812]: cluster 2024-09-17T08:49:26.227157+0000 mon.a (mon.0) 535 : cluster [INF] Cluster is now healthy 2024-09-17T08:49:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:26 smithi078 bash[22670]: cluster 2024-09-17T08:49:26.227084+0000 mon.a (mon.0) 534 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T08:49:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:26 smithi078 bash[22670]: cluster 2024-09-17T08:49:26.227157+0000 mon.a (mon.0) 535 : cluster [INF] Cluster is now healthy 2024-09-17T08:49:26.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:26 smithi078 bash[32124]: cluster 2024-09-17T08:49:26.227084+0000 mon.a (mon.0) 534 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T08:49:26.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:26 smithi078 bash[32124]: cluster 2024-09-17T08:49:26.227157+0000 mon.a (mon.0) 535 : cluster [INF] Cluster is now healthy 2024-09-17T08:49:27.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:27 smithi136 bash[24812]: cluster 2024-09-17T08:49:26.172446+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T08:49:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:27 smithi078 bash[22670]: cluster 2024-09-17T08:49:26.172446+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T08:49:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:27 smithi078 bash[32124]: cluster 2024-09-17T08:49:26.172446+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T08:49:27.689 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-17T08:49:27.878 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-17T08:49:27.891 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-09-17T08:49:27.892 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-09-17T08:49:27.892 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115945 s, 904 MB/s 2024-09-17T08:49:27.892 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-09-17T08:49:28.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2024-09-17T08:49:29.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: cluster 2024-09-17T08:49:28.172940+0000 mgr.y (mgr.14150) 264 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-17T08:49:29.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.081844+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.090590+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.092650+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:49:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.094326+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:49:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.104037+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.106395+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.108042+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:49:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:29 smithi136 bash[24812]: audit 2024-09-17T08:49:29.117713+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: cluster 2024-09-17T08:49:28.172940+0000 mgr.y (mgr.14150) 264 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-17T08:49:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.081844+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.090590+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.092650+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:49:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.094326+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:49:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.104037+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.106395+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.108042+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[22670]: audit 2024-09-17T08:49:29.117713+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: cluster 2024-09-17T08:49:28.172940+0000 mgr.y (mgr.14150) 264 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.081844+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.090590+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.092650+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.094326+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.104037+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.106395+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.108042+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:49:29.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:29 smithi078 bash[32124]: audit 2024-09-17T08:49:29.117713+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:49:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:30 smithi078 bash[22670]: cephadm 2024-09-17T08:49:29.072739+0000 mgr.y (mgr.14150) 265 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:49:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:30 smithi078 bash[22670]: cephadm 2024-09-17T08:49:29.095561+0000 mgr.y (mgr.14150) 266 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 8632M 2024-09-17T08:49:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:30 smithi078 bash[32124]: cephadm 2024-09-17T08:49:29.072739+0000 mgr.y (mgr.14150) 265 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:49:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:30 smithi078 bash[32124]: cephadm 2024-09-17T08:49:29.095561+0000 mgr.y (mgr.14150) 266 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 8632M 2024-09-17T08:49:30.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:30 smithi136 bash[24812]: cephadm 2024-09-17T08:49:29.072739+0000 mgr.y (mgr.14150) 265 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:49:30.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:30 smithi136 bash[24812]: cephadm 2024-09-17T08:49:29.095561+0000 mgr.y (mgr.14150) 266 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 8632M 2024-09-17T08:49:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:31 smithi078 bash[22670]: cluster 2024-09-17T08:49:30.173499+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T08:49:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:31 smithi078 bash[32124]: cluster 2024-09-17T08:49:30.173499+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T08:49:31.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:31 smithi136 bash[24812]: cluster 2024-09-17T08:49:30.173499+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T08:49:33.356 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:49:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:33 smithi078 bash[22670]: cluster 2024-09-17T08:49:32.174058+0000 mgr.y (mgr.14150) 268 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T08:49:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:33 smithi078 bash[32124]: cluster 2024-09-17T08:49:32.174058+0000 mgr.y (mgr.14150) 268 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T08:49:33.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:33 smithi136 bash[24812]: cluster 2024-09-17T08:49:32.174058+0000 mgr.y (mgr.14150) 268 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T08:49:35.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:35 smithi136 bash[24812]: cluster 2024-09-17T08:49:34.174691+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:49:35.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:35 smithi078 bash[22670]: cluster 2024-09-17T08:49:34.174691+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:49:35.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:35 smithi078 bash[32124]: cluster 2024-09-17T08:49:34.174691+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:49:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- 172.21.15.136:0/245342829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c0744e0 msgr2=0x7feb7c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:49:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 --2- 172.21.15.136:0/245342829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c0744e0 0x7feb7c072940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb68009900 tx=0x7feb6802a410 comp rx=0 tx=0).stop 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- 172.21.15.136:0/245342829 shutdown_connections 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 --2- 172.21.15.136:0/245342829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb7c10c430 0x7feb7c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 --2- 172.21.15.136:0/245342829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb7c072f10 0x7feb7c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 --2- 172.21.15.136:0/245342829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c0744e0 0x7feb7c072940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- 172.21.15.136:0/245342829 >> 172.21.15.136:0/245342829 conn(0x7feb7c0fb620 msgr2=0x7feb7c0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- 172.21.15.136:0/245342829 shutdown_connections 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- 172.21.15.136:0/245342829 wait complete. 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 Processor -- start 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- start start 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c072f10 0x7feb7c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb7c0744e0 0x7feb7c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:49:36.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb7c10c430 0x7feb7c1a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1a3410 con 0x7feb7c10c430 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1a3580 con 0x7feb7c072f10 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb83170640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1a3740 con 0x7feb7c0744e0 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb80f0c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c072f10 0x7feb7c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb80f0c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c072f10 0x7feb7c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39682/0 (socket says 172.21.15.136:39682) 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.164+0000 7feb80f0c640 1 -- 172.21.15.136:0/2790101273 learned_addr learned my addr 172.21.15.136:0/2790101273 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb7bfff640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb7c0744e0 0x7feb7c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb8170d640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb7c10c430 0x7feb7c1a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb80f0c640 1 -- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb7c0744e0 msgr2=0x7feb7c19be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb80f0c640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb7c0744e0 0x7feb7c19be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb80f0c640 1 -- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb7c10c430 msgr2=0x7feb7c1a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:49:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb80f0c640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb7c10c430 0x7feb7c1a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:49:36.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb80f0c640 1 -- 172.21.15.136:0/2790101273 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68009560 con 0x7feb7c072f10 2024-09-17T08:49:36.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb80f0c640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c072f10 0x7feb7c19b910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb68009230 tx=0x7feb68005120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb79ffb640 1 -- 172.21.15.136:0/2790101273 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680044f0 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb79ffb640 1 -- 172.21.15.136:0/2790101273 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7feb68003a40 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c1a39c0 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb79ffb640 1 -- 172.21.15.136:0/2790101273 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6803c920 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c1a3e60 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c073370 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb79ffb640 1 -- 172.21.15.136:0/2790101273 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7feb680035f0 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb79ffb640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feb6c06ce00 0x7feb6c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb79ffb640 1 -- 172.21.15.136:0/2790101273 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4423+0+0 (secure 0 0 0) 0x7feb680acdc0 con 0x7feb7c072f10 2024-09-17T08:49:36.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.168+0000 7feb7bfff640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feb6c06ce00 0x7feb6c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:49:36.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.172+0000 7feb7bfff640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feb6c06ce00 0x7feb6c06f2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb70005fd0 tx=0x7feb70005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:49:36.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.172+0000 7feb79ffb640 1 -- 172.21.15.136:0/2790101273 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb680775a0 con 0x7feb7c072f10 2024-09-17T08:49:36.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:49:36.348+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7feb7c111540 con 0x7feb6c06ce00 2024-09-17T08:49:37.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[22670]: cluster 2024-09-17T08:49:36.175377+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:49:37.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[22670]: audit 2024-09-17T08:49:36.350414+0000 mgr.y (mgr.14150) 271 : audit [DBG] from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:49:37.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[22670]: audit 2024-09-17T08:49:36.356762+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:49:37.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[22670]: audit 2024-09-17T08:49:36.363498+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:49:37.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[22670]: audit 2024-09-17T08:49:36.365471+0000 mon.a (mon.0) 546 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:37.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[32124]: cluster 2024-09-17T08:49:36.175377+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:49:37.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[32124]: audit 2024-09-17T08:49:36.350414+0000 mgr.y (mgr.14150) 271 : audit [DBG] from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:49:37.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[32124]: audit 2024-09-17T08:49:36.356762+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:49:37.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[32124]: audit 2024-09-17T08:49:36.363498+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:49:37.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:37 smithi078 bash[32124]: audit 2024-09-17T08:49:36.365471+0000 mon.a (mon.0) 546 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:37.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:37 smithi136 bash[24812]: cluster 2024-09-17T08:49:36.175377+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:49:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:37 smithi136 bash[24812]: audit 2024-09-17T08:49:36.350414+0000 mgr.y (mgr.14150) 271 : audit [DBG] from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:49:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:37 smithi136 bash[24812]: audit 2024-09-17T08:49:36.356762+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:49:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:37 smithi136 bash[24812]: audit 2024-09-17T08:49:36.363498+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:49:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:37 smithi136 bash[24812]: audit 2024-09-17T08:49:36.365471+0000 mon.a (mon.0) 546 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:39.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:39 smithi078 bash[22670]: cluster 2024-09-17T08:49:38.175966+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:39 smithi078 bash[32124]: cluster 2024-09-17T08:49:38.175966+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:39 smithi136 bash[24812]: cluster 2024-09-17T08:49:38.175966+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:41 smithi078 bash[22670]: cluster 2024-09-17T08:49:40.176519+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:41 smithi078 bash[32124]: cluster 2024-09-17T08:49:40.176519+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:41.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:41 smithi136 bash[24812]: cluster 2024-09-17T08:49:40.176519+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:43 smithi078 bash[22670]: cluster 2024-09-17T08:49:42.177039+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:43.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:43 smithi078 bash[32124]: cluster 2024-09-17T08:49:42.177039+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:43.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:43 smithi136 bash[24812]: cluster 2024-09-17T08:49:42.177039+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[22670]: cluster 2024-09-17T08:49:44.177565+0000 mgr.y (mgr.14150) 275 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[22670]: audit 2024-09-17T08:49:44.482450+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]: dispatch 2024-09-17T08:49:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[22670]: audit 2024-09-17T08:49:44.483120+0000 mon.b (mon.1) 18 : audit [INF] from='client.? 172.21.15.136:0/3605592587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]: dispatch 2024-09-17T08:49:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[22670]: audit 2024-09-17T08:49:44.491150+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]': finished 2024-09-17T08:49:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[22670]: cluster 2024-09-17T08:49:44.491333+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-17T08:49:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[22670]: audit 2024-09-17T08:49:44.491611+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:49:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[22670]: audit 2024-09-17T08:49:45.130748+0000 mon.b (mon.1) 19 : audit [DBG] from='client.? 172.21.15.136:0/3029143987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:49:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[32124]: cluster 2024-09-17T08:49:44.177565+0000 mgr.y (mgr.14150) 275 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[32124]: audit 2024-09-17T08:49:44.482450+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]: dispatch 2024-09-17T08:49:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[32124]: audit 2024-09-17T08:49:44.483120+0000 mon.b (mon.1) 18 : audit [INF] from='client.? 172.21.15.136:0/3605592587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]: dispatch 2024-09-17T08:49:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[32124]: audit 2024-09-17T08:49:44.491150+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]': finished 2024-09-17T08:49:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[32124]: cluster 2024-09-17T08:49:44.491333+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-17T08:49:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[32124]: audit 2024-09-17T08:49:44.491611+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:49:45.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:45 smithi078 bash[32124]: audit 2024-09-17T08:49:45.130748+0000 mon.b (mon.1) 19 : audit [DBG] from='client.? 172.21.15.136:0/3029143987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:49:45.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:45 smithi136 bash[24812]: cluster 2024-09-17T08:49:44.177565+0000 mgr.y (mgr.14150) 275 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:45.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:45 smithi136 bash[24812]: audit 2024-09-17T08:49:44.482450+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]: dispatch 2024-09-17T08:49:45.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:45 smithi136 bash[24812]: audit 2024-09-17T08:49:44.483120+0000 mon.b (mon.1) 18 : audit [INF] from='client.? 172.21.15.136:0/3605592587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]: dispatch 2024-09-17T08:49:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:45 smithi136 bash[24812]: audit 2024-09-17T08:49:44.491150+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c90e5d-be39-43a6-bfc9-63078abe1459"}]': finished 2024-09-17T08:49:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:45 smithi136 bash[24812]: cluster 2024-09-17T08:49:44.491333+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-17T08:49:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:45 smithi136 bash[24812]: audit 2024-09-17T08:49:44.491611+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:49:45.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:45 smithi136 bash[24812]: audit 2024-09-17T08:49:45.130748+0000 mon.b (mon.1) 19 : audit [DBG] from='client.? 172.21.15.136:0/3029143987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:49:47.579 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:47 smithi136 bash[24812]: cluster 2024-09-17T08:49:46.178093+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:47 smithi078 bash[22670]: cluster 2024-09-17T08:49:46.178093+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:47 smithi078 bash[32124]: cluster 2024-09-17T08:49:46.178093+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:49.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:49 smithi078 bash[22670]: cluster 2024-09-17T08:49:48.178636+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:49 smithi078 bash[32124]: cluster 2024-09-17T08:49:48.178636+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:49.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:49 smithi136 bash[24812]: cluster 2024-09-17T08:49:48.178636+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:51 smithi078 bash[22670]: cluster 2024-09-17T08:49:50.179179+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:51 smithi078 bash[32124]: cluster 2024-09-17T08:49:50.179179+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:51 smithi136 bash[24812]: cluster 2024-09-17T08:49:50.179179+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:53.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:53 smithi136 bash[24812]: cluster 2024-09-17T08:49:52.179713+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:53 smithi078 bash[22670]: cluster 2024-09-17T08:49:52.179713+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:53 smithi078 bash[32124]: cluster 2024-09-17T08:49:52.179713+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:55 smithi078 bash[22670]: cluster 2024-09-17T08:49:54.180258+0000 mgr.y (mgr.14150) 280 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:55 smithi078 bash[32124]: cluster 2024-09-17T08:49:54.180258+0000 mgr.y (mgr.14150) 280 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:55.619 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:55 smithi136 bash[24812]: cluster 2024-09-17T08:49:54.180258+0000 mgr.y (mgr.14150) 280 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:57.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:57 smithi078 bash[22670]: cluster 2024-09-17T08:49:56.180819+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:57 smithi078 bash[22670]: audit 2024-09-17T08:49:56.621528+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T08:49:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:57 smithi078 bash[22670]: audit 2024-09-17T08:49:56.623434+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:57 smithi078 bash[32124]: cluster 2024-09-17T08:49:56.180819+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:57 smithi078 bash[32124]: audit 2024-09-17T08:49:56.621528+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T08:49:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:57 smithi078 bash[32124]: audit 2024-09-17T08:49:56.623434+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:57.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:57 smithi136 bash[24812]: cluster 2024-09-17T08:49:56.180819+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:57.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:57 smithi136 bash[24812]: audit 2024-09-17T08:49:56.621528+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T08:49:57.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:57 smithi136 bash[24812]: audit 2024-09-17T08:49:56.623434+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:49:58.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:58 smithi136 bash[24812]: cephadm 2024-09-17T08:49:56.625022+0000 mgr.y (mgr.14150) 282 : cephadm [INF] Deploying daemon osd.6 on smithi136 2024-09-17T08:49:58.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:58 smithi078 bash[22670]: cephadm 2024-09-17T08:49:56.625022+0000 mgr.y (mgr.14150) 282 : cephadm [INF] Deploying daemon osd.6 on smithi136 2024-09-17T08:49:58.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:58 smithi078 bash[32124]: cephadm 2024-09-17T08:49:56.625022+0000 mgr.y (mgr.14150) 282 : cephadm [INF] Deploying daemon osd.6 on smithi136 2024-09-17T08:49:59.610 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:49:59 smithi136 bash[24812]: cluster 2024-09-17T08:49:58.181338+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:49:59 smithi078 bash[22670]: cluster 2024-09-17T08:49:58.181338+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:49:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:49:59 smithi078 bash[32124]: cluster 2024-09-17T08:49:58.181338+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:00.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:00 smithi136 bash[24812]: cluster 2024-09-17T08:50:00.000157+0000 mon.a (mon.0) 553 : cluster [INF] overall HEALTH_OK 2024-09-17T08:50:00.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:00 smithi078 bash[22670]: cluster 2024-09-17T08:50:00.000157+0000 mon.a (mon.0) 553 : cluster [INF] overall HEALTH_OK 2024-09-17T08:50:00.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:00 smithi078 bash[32124]: cluster 2024-09-17T08:50:00.000157+0000 mon.a (mon.0) 553 : cluster [INF] overall HEALTH_OK 2024-09-17T08:50:01.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:00 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:01 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.042 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:50:00 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.043 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:50:01 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.043 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:50:00 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.043 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:50:01 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.043 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:50:00 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.043 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:50:01 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:01.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:01 smithi136 bash[24812]: cluster 2024-09-17T08:50:00.181910+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:01.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:01 smithi136 bash[24812]: audit 2024-09-17T08:50:01.157584+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:01.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:01 smithi136 bash[24812]: audit 2024-09-17T08:50:01.165394+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:01.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:01 smithi136 bash[24812]: audit 2024-09-17T08:50:01.173859+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[22670]: cluster 2024-09-17T08:50:00.181910+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[22670]: audit 2024-09-17T08:50:01.157584+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[22670]: audit 2024-09-17T08:50:01.165394+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[22670]: audit 2024-09-17T08:50:01.173859+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[32124]: cluster 2024-09-17T08:50:00.181910+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[32124]: audit 2024-09-17T08:50:01.157584+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[32124]: audit 2024-09-17T08:50:01.165394+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:01.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:01 smithi078 bash[32124]: audit 2024-09-17T08:50:01.173859+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:03.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:03 smithi136 bash[24812]: cluster 2024-09-17T08:50:02.182452+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:03.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:03 smithi078 bash[22670]: cluster 2024-09-17T08:50:02.182452+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:03.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:03 smithi078 bash[32124]: cluster 2024-09-17T08:50:02.182452+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:05.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:05 smithi136 bash[24812]: cluster 2024-09-17T08:50:04.182929+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:05.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:05 smithi078 bash[32124]: cluster 2024-09-17T08:50:04.182929+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:05.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:05 smithi078 bash[22670]: cluster 2024-09-17T08:50:04.182929+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[22670]: cluster 2024-09-17T08:50:06.183487+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[22670]: audit 2024-09-17T08:50:06.350177+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[22670]: audit 2024-09-17T08:50:06.359477+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[22670]: audit 2024-09-17T08:50:06.845340+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[22670]: audit 2024-09-17T08:50:06.847281+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[22670]: audit 2024-09-17T08:50:06.857258+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[32124]: cluster 2024-09-17T08:50:06.183487+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[32124]: audit 2024-09-17T08:50:06.350177+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[32124]: audit 2024-09-17T08:50:06.359477+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[32124]: audit 2024-09-17T08:50:06.845340+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[32124]: audit 2024-09-17T08:50:06.847281+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:07 smithi078 bash[32124]: audit 2024-09-17T08:50:06.857258+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:07 smithi136 bash[24812]: cluster 2024-09-17T08:50:06.183487+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:07 smithi136 bash[24812]: audit 2024-09-17T08:50:06.350177+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:07 smithi136 bash[24812]: audit 2024-09-17T08:50:06.359477+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:07 smithi136 bash[24812]: audit 2024-09-17T08:50:06.845340+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:07 smithi136 bash[24812]: audit 2024-09-17T08:50:06.847281+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:07 smithi136 bash[24812]: audit 2024-09-17T08:50:06.857258+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:08 smithi078 bash[32124]: audit 2024-09-17T08:50:07.891107+0000 mon.a (mon.0) 562 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T08:50:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:08 smithi078 bash[32124]: audit 2024-09-17T08:50:07.891851+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T08:50:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:08 smithi078 bash[22670]: audit 2024-09-17T08:50:07.891107+0000 mon.a (mon.0) 562 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T08:50:08.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:08 smithi078 bash[22670]: audit 2024-09-17T08:50:07.891851+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T08:50:08.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:08 smithi136 bash[24812]: audit 2024-09-17T08:50:07.891107+0000 mon.a (mon.0) 562 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T08:50:08.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:08 smithi136 bash[24812]: audit 2024-09-17T08:50:07.891851+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T08:50:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:09 smithi136 bash[24812]: cluster 2024-09-17T08:50:08.184132+0000 mgr.y (mgr.14150) 288 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:09 smithi136 bash[24812]: audit 2024-09-17T08:50:08.365259+0000 mon.a (mon.0) 563 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T08:50:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:09 smithi136 bash[24812]: cluster 2024-09-17T08:50:08.365400+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-17T08:50:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:09 smithi136 bash[24812]: audit 2024-09-17T08:50:08.365692+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:09 smithi136 bash[24812]: audit 2024-09-17T08:50:08.367140+0000 mon.a (mon.0) 566 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:50:09.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:09 smithi136 bash[24812]: audit 2024-09-17T08:50:08.367862+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[32124]: cluster 2024-09-17T08:50:08.184132+0000 mgr.y (mgr.14150) 288 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[32124]: audit 2024-09-17T08:50:08.365259+0000 mon.a (mon.0) 563 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[32124]: cluster 2024-09-17T08:50:08.365400+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[32124]: audit 2024-09-17T08:50:08.365692+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[32124]: audit 2024-09-17T08:50:08.367140+0000 mon.a (mon.0) 566 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[32124]: audit 2024-09-17T08:50:08.367862+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[22670]: cluster 2024-09-17T08:50:08.184132+0000 mgr.y (mgr.14150) 288 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[22670]: audit 2024-09-17T08:50:08.365259+0000 mon.a (mon.0) 563 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T08:50:09.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[22670]: cluster 2024-09-17T08:50:08.365400+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-17T08:50:09.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[22670]: audit 2024-09-17T08:50:08.365692+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:09.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[22670]: audit 2024-09-17T08:50:08.367140+0000 mon.a (mon.0) 566 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:50:09.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:09 smithi078 bash[22670]: audit 2024-09-17T08:50:08.367862+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:50:09.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.939+0000 7feb79ffb640 1 -- 172.21.15.136:0/2790101273 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feb7c111540 con 0x7feb6c06ce00 2024-09-17T08:50:09.938 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 6 on host 'smithi136' 2024-09-17T08:50:09.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feb6c06ce00 msgr2=0x7feb6c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:50:09.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feb6c06ce00 0x7feb6c06f2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb70005fd0 tx=0x7feb70005850 comp rx=0 tx=0).stop 2024-09-17T08:50:09.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c072f10 msgr2=0x7feb7c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:50:09.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c072f10 0x7feb7c19b910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb68009230 tx=0x7feb68005120 comp rx=0 tx=0).stop 2024-09-17T08:50:09.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 shutdown_connections 2024-09-17T08:50:09.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7feb6c06ce00 0x7feb6c06f2c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:09.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb7c10c430 0x7feb7c1a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:09.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb7c0744e0 0x7feb7c19be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:09.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 --2- 172.21.15.136:0/2790101273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb7c072f10 0x7feb7c19b910 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:09.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 >> 172.21.15.136:0/2790101273 conn(0x7feb7c0fb620 msgr2=0x7feb7c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:50:09.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 shutdown_connections 2024-09-17T08:50:09.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:09.943+0000 7feb83170640 1 -- 172.21.15.136:0/2790101273 wait complete. 2024-09-17T08:50:10.557 DEBUG:teuthology.orchestra.run.smithi136:osd.6> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.6.service 2024-09-17T08:50:10.561 INFO:tasks.cephadm:Deploying osd.7 on smithi136 with /dev/vg_nvme/lv_1... 2024-09-17T08:50:10.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-17T08:50:10.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: audit 2024-09-17T08:50:09.371412+0000 mon.a (mon.0) 567 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:50:10.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: cluster 2024-09-17T08:50:09.371633+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-09-17T08:50:10.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: audit 2024-09-17T08:50:09.372465+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: audit 2024-09-17T08:50:09.381889+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: audit 2024-09-17T08:50:09.918174+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:10.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: audit 2024-09-17T08:50:09.926606+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:10.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: audit 2024-09-17T08:50:09.935573+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:10.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: cluster 2024-09-17T08:50:10.369946+0000 mon.a (mon.0) 574 : cluster [INF] osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] boot 2024-09-17T08:50:10.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: cluster 2024-09-17T08:50:10.370040+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-17T08:50:10.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:10 smithi136 bash[24812]: audit 2024-09-17T08:50:10.370382+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: audit 2024-09-17T08:50:09.371412+0000 mon.a (mon.0) 567 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:50:10.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: cluster 2024-09-17T08:50:09.371633+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-09-17T08:50:10.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: audit 2024-09-17T08:50:09.372465+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: audit 2024-09-17T08:50:09.381889+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: audit 2024-09-17T08:50:09.918174+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: audit 2024-09-17T08:50:09.926606+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: audit 2024-09-17T08:50:09.935573+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: cluster 2024-09-17T08:50:10.369946+0000 mon.a (mon.0) 574 : cluster [INF] osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] boot 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: cluster 2024-09-17T08:50:10.370040+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[22670]: audit 2024-09-17T08:50:10.370382+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: audit 2024-09-17T08:50:09.371412+0000 mon.a (mon.0) 567 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:50:10.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: cluster 2024-09-17T08:50:09.371633+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: audit 2024-09-17T08:50:09.372465+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: audit 2024-09-17T08:50:09.381889+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: audit 2024-09-17T08:50:09.918174+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: audit 2024-09-17T08:50:09.926606+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: audit 2024-09-17T08:50:09.935573+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: cluster 2024-09-17T08:50:10.369946+0000 mon.a (mon.0) 574 : cluster [INF] osd.6 [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] boot 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: cluster 2024-09-17T08:50:10.370040+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-17T08:50:10.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:10 smithi078 bash[32124]: audit 2024-09-17T08:50:10.370382+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:50:11.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:11 smithi136 bash[24812]: cluster 2024-09-17T08:50:08.875604+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:50:11.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:11 smithi136 bash[24812]: cluster 2024-09-17T08:50:08.875692+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:50:11.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:11 smithi136 bash[24812]: cluster 2024-09-17T08:50:10.184722+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:11.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:11 smithi136 bash[24812]: cluster 2024-09-17T08:50:10.514143+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-17T08:50:11.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[22670]: cluster 2024-09-17T08:50:08.875604+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:50:11.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[22670]: cluster 2024-09-17T08:50:08.875692+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:50:11.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[22670]: cluster 2024-09-17T08:50:10.184722+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:11.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[22670]: cluster 2024-09-17T08:50:10.514143+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-17T08:50:11.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[32124]: cluster 2024-09-17T08:50:08.875604+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:50:11.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[32124]: cluster 2024-09-17T08:50:08.875692+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:50:11.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[32124]: cluster 2024-09-17T08:50:10.184722+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T08:50:11.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:11 smithi078 bash[32124]: cluster 2024-09-17T08:50:10.514143+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-17T08:50:12.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:12 smithi136 bash[24812]: cluster 2024-09-17T08:50:11.516007+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-17T08:50:12.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:12 smithi136 bash[24812]: cluster 2024-09-17T08:50:12.185295+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:12.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:12 smithi078 bash[32124]: cluster 2024-09-17T08:50:11.516007+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-17T08:50:12.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:12 smithi078 bash[32124]: cluster 2024-09-17T08:50:12.185295+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:12.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:12 smithi078 bash[22670]: cluster 2024-09-17T08:50:11.516007+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-17T08:50:12.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:12 smithi078 bash[22670]: cluster 2024-09-17T08:50:12.185295+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:13.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:13 smithi136 bash[24812]: cluster 2024-09-17T08:50:12.531764+0000 mon.a (mon.0) 579 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-17T08:50:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:13 smithi078 bash[22670]: cluster 2024-09-17T08:50:12.531764+0000 mon.a (mon.0) 579 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-17T08:50:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:13 smithi078 bash[32124]: cluster 2024-09-17T08:50:12.531764+0000 mon.a (mon.0) 579 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-17T08:50:14.777 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:50:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:14 smithi078 bash[22670]: cluster 2024-09-17T08:50:13.528845+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-09-17T08:50:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:14 smithi078 bash[22670]: cluster 2024-09-17T08:50:14.185789+0000 mgr.y (mgr.14150) 291 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:14 smithi078 bash[32124]: cluster 2024-09-17T08:50:13.528845+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-09-17T08:50:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:14 smithi078 bash[32124]: cluster 2024-09-17T08:50:14.185789+0000 mgr.y (mgr.14150) 291 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:14.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:14 smithi136 bash[24812]: cluster 2024-09-17T08:50:13.528845+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-09-17T08:50:14.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:14 smithi136 bash[24812]: cluster 2024-09-17T08:50:14.185789+0000 mgr.y (mgr.14150) 291 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:17.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:17 smithi136 bash[24812]: cluster 2024-09-17T08:50:16.186401+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-17T08:50:17.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:17 smithi078 bash[22670]: cluster 2024-09-17T08:50:16.186401+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-17T08:50:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:17 smithi078 bash[32124]: cluster 2024-09-17T08:50:16.186401+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-17T08:50:19.302 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-17T08:50:19.506 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-17T08:50:19.521 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-09-17T08:50:19.522 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-09-17T08:50:19.522 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125491 s, 836 MB/s 2024-09-17T08:50:19.522 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-09-17T08:50:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:19 smithi136 bash[24812]: cluster 2024-09-17T08:50:18.186970+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-17T08:50:19.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:19 smithi078 bash[22670]: cluster 2024-09-17T08:50:18.186970+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-17T08:50:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:19 smithi078 bash[32124]: cluster 2024-09-17T08:50:18.186970+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-17T08:50:20.262 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_1 2024-09-17T08:50:21.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: cluster 2024-09-17T08:50:20.187669+0000 mgr.y (mgr.14150) 294 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.652330+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.661626+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.663951+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.665994+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.667897+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.677861+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.680100+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.681876+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:21 smithi136 bash[24812]: audit 2024-09-17T08:50:20.692080+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: cluster 2024-09-17T08:50:20.187669+0000 mgr.y (mgr.14150) 294 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.652330+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.661626+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.663951+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.665994+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.667897+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.677861+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.680100+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.681876+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[22670]: audit 2024-09-17T08:50:20.692080+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: cluster 2024-09-17T08:50:20.187669+0000 mgr.y (mgr.14150) 294 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.652330+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.661626+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.663951+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.665994+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.667897+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.677861+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.680100+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.681876+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:21 smithi078 bash[32124]: audit 2024-09-17T08:50:20.692080+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:22.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:22 smithi136 bash[24812]: cephadm 2024-09-17T08:50:20.642999+0000 mgr.y (mgr.14150) 295 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:50:22.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:22 smithi136 bash[24812]: cephadm 2024-09-17T08:50:20.669255+0000 mgr.y (mgr.14150) 296 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 5755M 2024-09-17T08:50:22.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:22 smithi078 bash[22670]: cephadm 2024-09-17T08:50:20.642999+0000 mgr.y (mgr.14150) 295 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:50:22.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:22 smithi078 bash[22670]: cephadm 2024-09-17T08:50:20.669255+0000 mgr.y (mgr.14150) 296 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 5755M 2024-09-17T08:50:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:22 smithi078 bash[32124]: cephadm 2024-09-17T08:50:20.642999+0000 mgr.y (mgr.14150) 295 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:50:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:22 smithi078 bash[32124]: cephadm 2024-09-17T08:50:20.669255+0000 mgr.y (mgr.14150) 296 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 5755M 2024-09-17T08:50:23.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:23 smithi136 bash[24812]: cluster 2024-09-17T08:50:22.188290+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T08:50:23.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:23 smithi078 bash[22670]: cluster 2024-09-17T08:50:22.188290+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T08:50:23.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:23 smithi078 bash[32124]: cluster 2024-09-17T08:50:22.188290+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T08:50:24.958 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:50:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:25 smithi136 bash[24812]: cluster 2024-09-17T08:50:24.188857+0000 mgr.y (mgr.14150) 298 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T08:50:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:25 smithi078 bash[22670]: cluster 2024-09-17T08:50:24.188857+0000 mgr.y (mgr.14150) 298 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T08:50:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:25 smithi078 bash[32124]: cluster 2024-09-17T08:50:24.188857+0000 mgr.y (mgr.14150) 298 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T08:50:27.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:27 smithi136 bash[24812]: cluster 2024-09-17T08:50:26.189432+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:50:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:27 smithi078 bash[22670]: cluster 2024-09-17T08:50:26.189432+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:50:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:27 smithi078 bash[32124]: cluster 2024-09-17T08:50:26.189432+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T08:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2682731668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0102050 msgr2=0x7f30f0102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2682731668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0102050 0x7f30f0102450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009900 tx=0x7f30d802a410 comp rx=0 tx=0).stop 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2682731668 shutdown_connections 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2682731668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0103c10 0x7f30f010a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2682731668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f0103250 0x7f30f01036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2682731668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0102050 0x7f30f0102450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2682731668 >> 172.21.15.136:0/2682731668 conn(0x7f30f00fd7e0 msgr2=0x7f30f00ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2682731668 shutdown_connections 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2682731668 wait complete. 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 Processor -- start 2024-09-17T08:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- start start 2024-09-17T08:50:27.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0102050 0x7f30f0197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:50:27.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f0103250 0x7f30f0197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:50:27.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0103c10 0x7f30f019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:50:27.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f019f030 con 0x7f30f0103250 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f019f1a0 con 0x7f30f0103c10 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f019f360 con 0x7f30f0102050 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0103c10 0x7f30f019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0103c10 0x7f30f019eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46024/0 (socket says 172.21.15.136:46024) 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 -- 172.21.15.136:0/2189916677 learned_addr learned my addr 172.21.15.136:0/2189916677 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 -- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0102050 msgr2=0x7f30f0197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30edd9b640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f0103250 0x7f30f0197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30ee59c640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0102050 0x7f30f0197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0102050 0x7f30f0197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 -- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f0103250 msgr2=0x7f30f0197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f0103250 0x7f30f0197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 -- 172.21.15.136:0/2189916677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8009560 con 0x7f30f0103c10 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30edd9b640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f0103250 0x7f30f0197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30eed9d640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0103c10 0x7f30f019eaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f30e800cad0 tx=0x7f30e800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30e77fe640 1 -- 172.21.15.136:0/2189916677 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800ae20 con 0x7f30f0103c10 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f019f640 con 0x7f30f0103c10 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30e77fe640 1 -- 172.21.15.136:0/2189916677 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f30e8005020 con 0x7f30f0103c10 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30e77fe640 1 -- 172.21.15.136:0/2189916677 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800f6b0 con 0x7f30f0103c10 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f019fb90 con 0x7f30f0103c10 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.711+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f0102450 con 0x7f30f0103c10 2024-09-17T08:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.715+0000 7f30e77fe640 1 -- 172.21.15.136:0/2189916677 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7f30e8004a40 con 0x7f30f0103c10 2024-09-17T08:50:27.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.715+0000 7f30e77fe640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f30dc06ce00 0x7f30dc06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:50:27.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.715+0000 7f30e77fe640 1 -- 172.21.15.136:0/2189916677 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4855+0+0 (secure 0 0 0) 0x7f30e808bed0 con 0x7f30f0103c10 2024-09-17T08:50:27.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.715+0000 7f30ee59c640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f30dc06ce00 0x7f30dc06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:50:27.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.715+0000 7f30ee59c640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f30dc06ce00 0x7f30dc06f2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30d802a930 tx=0x7f30d8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:50:27.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.719+0000 7f30e77fe640 1 -- 172.21.15.136:0/2189916677 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30e8056580 con 0x7f30f0103c10 2024-09-17T08:50:27.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:50:27.903+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f30f010d050 con 0x7f30dc06ce00 2024-09-17T08:50:28.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:28 smithi136 bash[24812]: audit 2024-09-17T08:50:27.911531+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:50:28.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:28 smithi136 bash[24812]: audit 2024-09-17T08:50:27.917476+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:50:28.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:28 smithi136 bash[24812]: audit 2024-09-17T08:50:27.919260+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:28.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:28 smithi078 bash[22670]: audit 2024-09-17T08:50:27.911531+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:50:28.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:28 smithi078 bash[22670]: audit 2024-09-17T08:50:27.917476+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:50:28.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:28 smithi078 bash[22670]: audit 2024-09-17T08:50:27.919260+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:28 smithi078 bash[32124]: audit 2024-09-17T08:50:27.911531+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T08:50:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:28 smithi078 bash[32124]: audit 2024-09-17T08:50:27.917476+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T08:50:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:28 smithi078 bash[32124]: audit 2024-09-17T08:50:27.919260+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:29.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:29 smithi136 bash[24812]: audit 2024-09-17T08:50:27.905358+0000 mgr.y (mgr.14150) 300 : audit [DBG] from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:50:29.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:29 smithi136 bash[24812]: cluster 2024-09-17T08:50:28.189952+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:29 smithi078 bash[22670]: audit 2024-09-17T08:50:27.905358+0000 mgr.y (mgr.14150) 300 : audit [DBG] from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:50:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:29 smithi078 bash[22670]: cluster 2024-09-17T08:50:28.189952+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:29 smithi078 bash[32124]: audit 2024-09-17T08:50:27.905358+0000 mgr.y (mgr.14150) 300 : audit [DBG] from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:50:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:29 smithi078 bash[32124]: cluster 2024-09-17T08:50:28.189952+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:31.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:31 smithi136 bash[24812]: cluster 2024-09-17T08:50:30.190562+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:31 smithi078 bash[22670]: cluster 2024-09-17T08:50:30.190562+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:31 smithi078 bash[32124]: cluster 2024-09-17T08:50:30.190562+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:33.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:33 smithi136 bash[24812]: cluster 2024-09-17T08:50:32.191141+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:33.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:33 smithi078 bash[22670]: cluster 2024-09-17T08:50:32.191141+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:33.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:33 smithi078 bash[32124]: cluster 2024-09-17T08:50:32.191141+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:35.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:35 smithi136 bash[24812]: cluster 2024-09-17T08:50:34.191689+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:35 smithi078 bash[22670]: cluster 2024-09-17T08:50:34.191689+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:35.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:35 smithi078 bash[32124]: cluster 2024-09-17T08:50:34.191689+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:36.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:36 smithi136 bash[24812]: audit 2024-09-17T08:50:36.097361+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]: dispatch 2024-09-17T08:50:36.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:36 smithi136 bash[24812]: audit 2024-09-17T08:50:36.097875+0000 mon.b (mon.1) 22 : audit [INF] from='client.? 172.21.15.136:0/1972673035' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]: dispatch 2024-09-17T08:50:36.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:36 smithi136 bash[24812]: audit 2024-09-17T08:50:36.106057+0000 mon.a (mon.0) 594 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]': finished 2024-09-17T08:50:36.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:36 smithi136 bash[24812]: cluster 2024-09-17T08:50:36.106234+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-17T08:50:36.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:36 smithi136 bash[24812]: audit 2024-09-17T08:50:36.106468+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:50:36.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[22670]: audit 2024-09-17T08:50:36.097361+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]: dispatch 2024-09-17T08:50:36.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[22670]: audit 2024-09-17T08:50:36.097875+0000 mon.b (mon.1) 22 : audit [INF] from='client.? 172.21.15.136:0/1972673035' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]: dispatch 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[22670]: audit 2024-09-17T08:50:36.106057+0000 mon.a (mon.0) 594 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]': finished 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[22670]: cluster 2024-09-17T08:50:36.106234+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[22670]: audit 2024-09-17T08:50:36.106468+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[32124]: audit 2024-09-17T08:50:36.097361+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]: dispatch 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[32124]: audit 2024-09-17T08:50:36.097875+0000 mon.b (mon.1) 22 : audit [INF] from='client.? 172.21.15.136:0/1972673035' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]: dispatch 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[32124]: audit 2024-09-17T08:50:36.106057+0000 mon.a (mon.0) 594 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1efbd419-346f-4371-9e11-ab0e006c195b"}]': finished 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[32124]: cluster 2024-09-17T08:50:36.106234+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-17T08:50:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:36 smithi078 bash[32124]: audit 2024-09-17T08:50:36.106468+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:50:37.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:37 smithi078 bash[22670]: cluster 2024-09-17T08:50:36.192216+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:37.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:37 smithi078 bash[22670]: audit 2024-09-17T08:50:36.772123+0000 mon.b (mon.1) 23 : audit [DBG] from='client.? 172.21.15.136:0/3792980031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:50:37.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:37 smithi078 bash[32124]: cluster 2024-09-17T08:50:36.192216+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:37.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:37 smithi078 bash[32124]: audit 2024-09-17T08:50:36.772123+0000 mon.b (mon.1) 23 : audit [DBG] from='client.? 172.21.15.136:0/3792980031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:50:37.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:37 smithi136 bash[24812]: cluster 2024-09-17T08:50:36.192216+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:37.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:37 smithi136 bash[24812]: audit 2024-09-17T08:50:36.772123+0000 mon.b (mon.1) 23 : audit [DBG] from='client.? 172.21.15.136:0/3792980031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T08:50:39.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:39 smithi136 bash[24812]: cluster 2024-09-17T08:50:38.192777+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:39 smithi078 bash[22670]: cluster 2024-09-17T08:50:38.192777+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:39 smithi078 bash[32124]: cluster 2024-09-17T08:50:38.192777+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:41.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:41 smithi078 bash[32124]: cluster 2024-09-17T08:50:40.193339+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:41 smithi078 bash[22670]: cluster 2024-09-17T08:50:40.193339+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:41.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:41 smithi136 bash[24812]: cluster 2024-09-17T08:50:40.193339+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:43 smithi078 bash[32124]: cluster 2024-09-17T08:50:42.193908+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:43.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:43 smithi078 bash[22670]: cluster 2024-09-17T08:50:42.193908+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:43.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:43 smithi136 bash[24812]: cluster 2024-09-17T08:50:42.193908+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:45 smithi078 bash[32124]: cluster 2024-09-17T08:50:44.194459+0000 mgr.y (mgr.14150) 309 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:45 smithi078 bash[22670]: cluster 2024-09-17T08:50:44.194459+0000 mgr.y (mgr.14150) 309 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:45.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:45 smithi136 bash[24812]: cluster 2024-09-17T08:50:44.194459+0000 mgr.y (mgr.14150) 309 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:47 smithi078 bash[32124]: cluster 2024-09-17T08:50:46.195002+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:47.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:47 smithi078 bash[22670]: cluster 2024-09-17T08:50:46.195002+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:47.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:47 smithi136 bash[24812]: cluster 2024-09-17T08:50:46.195002+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[22670]: cluster 2024-09-17T08:50:48.195552+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[22670]: audit 2024-09-17T08:50:48.444551+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T08:50:49.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[22670]: audit 2024-09-17T08:50:48.446518+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:49.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[22670]: cephadm 2024-09-17T08:50:48.447970+0000 mgr.y (mgr.14150) 312 : cephadm [INF] Deploying daemon osd.7 on smithi136 2024-09-17T08:50:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[32124]: cluster 2024-09-17T08:50:48.195552+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[32124]: audit 2024-09-17T08:50:48.444551+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T08:50:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[32124]: audit 2024-09-17T08:50:48.446518+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:49 smithi078 bash[32124]: cephadm 2024-09-17T08:50:48.447970+0000 mgr.y (mgr.14150) 312 : cephadm [INF] Deploying daemon osd.7 on smithi136 2024-09-17T08:50:49.681 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:49 smithi136 bash[24812]: cluster 2024-09-17T08:50:48.195552+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:49.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:49 smithi136 bash[24812]: audit 2024-09-17T08:50:48.444551+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T08:50:49.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:49 smithi136 bash[24812]: audit 2024-09-17T08:50:48.446518+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:49.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:49 smithi136 bash[24812]: cephadm 2024-09-17T08:50:48.447970+0000 mgr.y (mgr.14150) 312 : cephadm [INF] Deploying daemon osd.7 on smithi136 2024-09-17T08:50:51.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:51 smithi136 bash[24812]: cluster 2024-09-17T08:50:50.196113+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:51 smithi078 bash[22670]: cluster 2024-09-17T08:50:50.196113+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:51 smithi078 bash[32124]: cluster 2024-09-17T08:50:50.196113+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:52.643 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.643 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.644 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.644 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.644 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.906 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.907 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.907 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.907 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:52.907 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:50:52 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:50:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[22670]: cluster 2024-09-17T08:50:52.196777+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[22670]: audit 2024-09-17T08:50:52.943006+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[22670]: audit 2024-09-17T08:50:52.951352+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[22670]: audit 2024-09-17T08:50:52.960541+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[32124]: cluster 2024-09-17T08:50:52.196777+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[32124]: audit 2024-09-17T08:50:52.943006+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[32124]: audit 2024-09-17T08:50:52.951352+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:53 smithi078 bash[32124]: audit 2024-09-17T08:50:52.960541+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:53.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:53 smithi136 bash[24812]: cluster 2024-09-17T08:50:52.196777+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:53.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:53 smithi136 bash[24812]: audit 2024-09-17T08:50:52.943006+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:50:53.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:53 smithi136 bash[24812]: audit 2024-09-17T08:50:52.951352+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:53.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:53 smithi136 bash[24812]: audit 2024-09-17T08:50:52.960541+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:55 smithi136 bash[24812]: cluster 2024-09-17T08:50:54.197412+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:55 smithi078 bash[22670]: cluster 2024-09-17T08:50:54.197412+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:55 smithi078 bash[32124]: cluster 2024-09-17T08:50:54.197412+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:57.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:57 smithi078 bash[22670]: cluster 2024-09-17T08:50:56.198147+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:57.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:57 smithi078 bash[32124]: cluster 2024-09-17T08:50:56.198147+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:57.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:57 smithi136 bash[24812]: cluster 2024-09-17T08:50:56.198147+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:59.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:59 smithi136 bash[24812]: audit 2024-09-17T08:50:58.147813+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:59 smithi136 bash[24812]: audit 2024-09-17T08:50:58.157052+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:59 smithi136 bash[24812]: audit 2024-09-17T08:50:58.158955+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:59.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:59 smithi136 bash[24812]: audit 2024-09-17T08:50:58.161650+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:59.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:59 smithi136 bash[24812]: audit 2024-09-17T08:50:58.171777+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:50:59 smithi136 bash[24812]: cluster 2024-09-17T08:50:58.198740+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:59.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[22670]: audit 2024-09-17T08:50:58.147813+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[22670]: audit 2024-09-17T08:50:58.157052+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[22670]: audit 2024-09-17T08:50:58.158955+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[22670]: audit 2024-09-17T08:50:58.161650+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[22670]: audit 2024-09-17T08:50:58.171777+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[22670]: cluster 2024-09-17T08:50:58.198740+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[32124]: audit 2024-09-17T08:50:58.147813+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[32124]: audit 2024-09-17T08:50:58.157052+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[32124]: audit 2024-09-17T08:50:58.158955+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[32124]: audit 2024-09-17T08:50:58.161650+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[32124]: audit 2024-09-17T08:50:58.171777+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:50:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:50:59 smithi078 bash[32124]: cluster 2024-09-17T08:50:58.198740+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:51:00.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:00 smithi136 bash[24812]: audit 2024-09-17T08:50:59.575033+0000 mon.a (mon.0) 607 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T08:51:00.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:00 smithi136 bash[24812]: audit 2024-09-17T08:50:59.575786+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T08:51:00.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:00 smithi078 bash[22670]: audit 2024-09-17T08:50:59.575033+0000 mon.a (mon.0) 607 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T08:51:00.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:00 smithi078 bash[22670]: audit 2024-09-17T08:50:59.575786+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T08:51:00.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:00 smithi078 bash[32124]: audit 2024-09-17T08:50:59.575033+0000 mon.a (mon.0) 607 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T08:51:00.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:00 smithi078 bash[32124]: audit 2024-09-17T08:50:59.575786+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T08:51:01.496 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.494+0000 7f30e77fe640 1 -- 172.21.15.136:0/2189916677 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f30f010d050 con 0x7f30dc06ce00 2024-09-17T08:51:01.496 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 7 on host 'smithi136' 2024-09-17T08:51:01.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f30dc06ce00 msgr2=0x7f30dc06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:01.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f30dc06ce00 0x7f30dc06f2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30d802a930 tx=0x7f30d8005fd0 comp rx=0 tx=0).stop 2024-09-17T08:51:01.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0103c10 msgr2=0x7f30f019eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:01.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0103c10 0x7f30f019eaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f30e800cad0 tx=0x7f30e800cf90 comp rx=0 tx=0).stop 2024-09-17T08:51:01.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 shutdown_connections 2024-09-17T08:51:01.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f30dc06ce00 0x7f30dc06f2c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:01.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30f0103c10 0x7f30f019eaf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:01.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f0103250 0x7f30f0197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:01.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 --2- 172.21.15.136:0/2189916677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0102050 0x7f30f0197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:01.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 >> 172.21.15.136:0/2189916677 conn(0x7f30f00fd7e0 msgr2=0x7f30f00ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:01.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 shutdown_connections 2024-09-17T08:51:01.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:01.498+0000 7f30f4c93640 1 -- 172.21.15.136:0/2189916677 wait complete. 2024-09-17T08:51:01.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:01 smithi136 bash[24812]: audit 2024-09-17T08:51:00.186975+0000 mon.a (mon.0) 608 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T08:51:01.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:01 smithi136 bash[24812]: cluster 2024-09-17T08:51:00.187167+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-17T08:51:01.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:01 smithi136 bash[24812]: audit 2024-09-17T08:51:00.187439+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:01.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:01 smithi136 bash[24812]: audit 2024-09-17T08:51:00.189154+0000 mon.a (mon.0) 611 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:51:01.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:01 smithi136 bash[24812]: audit 2024-09-17T08:51:00.189819+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:51:01.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:01 smithi136 bash[24812]: cluster 2024-09-17T08:51:00.199220+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:51:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[22670]: audit 2024-09-17T08:51:00.186975+0000 mon.a (mon.0) 608 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[22670]: cluster 2024-09-17T08:51:00.187167+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[22670]: audit 2024-09-17T08:51:00.187439+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[22670]: audit 2024-09-17T08:51:00.189154+0000 mon.a (mon.0) 611 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[22670]: audit 2024-09-17T08:51:00.189819+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[22670]: cluster 2024-09-17T08:51:00.199220+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[32124]: audit 2024-09-17T08:51:00.186975+0000 mon.a (mon.0) 608 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[32124]: cluster 2024-09-17T08:51:00.187167+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[32124]: audit 2024-09-17T08:51:00.187439+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[32124]: audit 2024-09-17T08:51:00.189154+0000 mon.a (mon.0) 611 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:51:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[32124]: audit 2024-09-17T08:51:00.189819+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-17T08:51:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:01 smithi078 bash[32124]: cluster 2024-09-17T08:51:00.199220+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:51:02.159 DEBUG:teuthology.orchestra.run.smithi136:osd.7> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.7.service 2024-09-17T08:51:02.161 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-17T08:51:02.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T08:51:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: audit 2024-09-17T08:51:01.203203+0000 mon.a (mon.0) 612 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:51:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: cluster 2024-09-17T08:51:01.203360+0000 mon.a (mon.0) 613 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-09-17T08:51:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: audit 2024-09-17T08:51:01.203891+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: audit 2024-09-17T08:51:01.213254+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: audit 2024-09-17T08:51:01.475384+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: audit 2024-09-17T08:51:01.483010+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:02.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: audit 2024-09-17T08:51:01.493823+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:02.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:02 smithi136 bash[24812]: audit 2024-09-17T08:51:01.532919+0000 mon.a (mon.0) 619 : audit [INF] from='osd.7 ' entity='osd.7' 2024-09-17T08:51:02.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: audit 2024-09-17T08:51:01.203203+0000 mon.a (mon.0) 612 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: cluster 2024-09-17T08:51:01.203360+0000 mon.a (mon.0) 613 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: audit 2024-09-17T08:51:01.203891+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: audit 2024-09-17T08:51:01.213254+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: audit 2024-09-17T08:51:01.475384+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: audit 2024-09-17T08:51:01.483010+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: audit 2024-09-17T08:51:01.493823+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[22670]: audit 2024-09-17T08:51:01.532919+0000 mon.a (mon.0) 619 : audit [INF] from='osd.7 ' entity='osd.7' 2024-09-17T08:51:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: audit 2024-09-17T08:51:01.203203+0000 mon.a (mon.0) 612 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-17T08:51:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: cluster 2024-09-17T08:51:01.203360+0000 mon.a (mon.0) 613 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-09-17T08:51:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: audit 2024-09-17T08:51:01.203891+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: audit 2024-09-17T08:51:01.213254+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: audit 2024-09-17T08:51:01.475384+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: audit 2024-09-17T08:51:01.483010+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: audit 2024-09-17T08:51:01.493823+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:02 smithi078 bash[32124]: audit 2024-09-17T08:51:01.532919+0000 mon.a (mon.0) 619 : audit [INF] from='osd.7 ' entity='osd.7' 2024-09-17T08:51:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:03 smithi136 bash[24812]: cluster 2024-09-17T08:51:00.599670+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:51:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:03 smithi136 bash[24812]: cluster 2024-09-17T08:51:00.599744+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:51:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:03 smithi136 bash[24812]: cluster 2024-09-17T08:51:02.199849+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:51:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:03 smithi136 bash[24812]: cluster 2024-09-17T08:51:02.200713+0000 mon.a (mon.0) 620 : cluster [INF] osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] boot 2024-09-17T08:51:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:03 smithi136 bash[24812]: cluster 2024-09-17T08:51:02.200830+0000 mon.a (mon.0) 621 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-17T08:51:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:03 smithi136 bash[24812]: audit 2024-09-17T08:51:02.201656+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:03.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[22670]: cluster 2024-09-17T08:51:00.599670+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[22670]: cluster 2024-09-17T08:51:00.599744+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[22670]: cluster 2024-09-17T08:51:02.199849+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[22670]: cluster 2024-09-17T08:51:02.200713+0000 mon.a (mon.0) 620 : cluster [INF] osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] boot 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[22670]: cluster 2024-09-17T08:51:02.200830+0000 mon.a (mon.0) 621 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[22670]: audit 2024-09-17T08:51:02.201656+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[32124]: cluster 2024-09-17T08:51:00.599670+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[32124]: cluster 2024-09-17T08:51:00.599744+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T08:51:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[32124]: cluster 2024-09-17T08:51:02.199849+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-17T08:51:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[32124]: cluster 2024-09-17T08:51:02.200713+0000 mon.a (mon.0) 620 : cluster [INF] osd.7 [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] boot 2024-09-17T08:51:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[32124]: cluster 2024-09-17T08:51:02.200830+0000 mon.a (mon.0) 621 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-17T08:51:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:03 smithi078 bash[32124]: audit 2024-09-17T08:51:02.201656+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:51:04.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:04 smithi136 bash[24812]: cluster 2024-09-17T08:51:03.204270+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-17T08:51:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:04 smithi078 bash[22670]: cluster 2024-09-17T08:51:03.204270+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-17T08:51:04.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:04 smithi078 bash[32124]: cluster 2024-09-17T08:51:03.204270+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-17T08:51:05.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:05 smithi136 bash[24812]: cluster 2024-09-17T08:51:04.200416+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:05.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:05 smithi136 bash[24812]: cluster 2024-09-17T08:51:04.220594+0000 mon.a (mon.0) 624 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-17T08:51:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:05 smithi078 bash[22670]: cluster 2024-09-17T08:51:04.200416+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:05 smithi078 bash[22670]: cluster 2024-09-17T08:51:04.220594+0000 mon.a (mon.0) 624 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-17T08:51:05.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:05 smithi078 bash[32124]: cluster 2024-09-17T08:51:04.200416+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:05 smithi078 bash[32124]: cluster 2024-09-17T08:51:04.220594+0000 mon.a (mon.0) 624 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-17T08:51:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:06 smithi136 bash[24812]: cluster 2024-09-17T08:51:05.245752+0000 mon.a (mon.0) 625 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-17T08:51:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:06 smithi078 bash[22670]: cluster 2024-09-17T08:51:05.245752+0000 mon.a (mon.0) 625 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-17T08:51:06.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:06 smithi078 bash[32124]: cluster 2024-09-17T08:51:05.245752+0000 mon.a (mon.0) 625 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-17T08:51:06.880 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:51:07.528 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:07 smithi136 bash[24812]: cluster 2024-09-17T08:51:06.200995+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v307: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-17T08:51:07.529 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:07 smithi136 bash[24812]: cluster 2024-09-17T08:51:06.267355+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-17T08:51:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:07 smithi078 bash[22670]: cluster 2024-09-17T08:51:06.200995+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v307: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-17T08:51:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:07 smithi078 bash[22670]: cluster 2024-09-17T08:51:06.267355+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-17T08:51:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:07 smithi078 bash[32124]: cluster 2024-09-17T08:51:06.200995+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v307: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-17T08:51:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:07 smithi078 bash[32124]: cluster 2024-09-17T08:51:06.267355+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-17T08:51:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:09 smithi136 bash[24812]: cluster 2024-09-17T08:51:08.201595+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-17T08:51:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:09 smithi078 bash[22670]: cluster 2024-09-17T08:51:08.201595+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-17T08:51:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:09 smithi078 bash[32124]: cluster 2024-09-17T08:51:08.201595+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-17T08:51:09.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2084407860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 msgr2=0x7ff098101570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:09.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2084407860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 0x7ff098101570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009900 tx=0x7ff08c02a3f0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2084407860 shutdown_connections 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2084407860 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 0x7ff098108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2084407860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 0x7ff098101570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2084407860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0980fe110 0x7ff0980fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2084407860 >> 172.21.15.78:0/2084407860 conn(0x7ff0980f9ca0 msgr2=0x7ff0980fc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2084407860 shutdown_connections 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2084407860 wait complete. 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.761+0000 7ff09ddc1640 1 Processor -- start 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 -- start start 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0980fe110 0x7ff0981952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 0x7ff098195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 0x7ff09819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09819cdf0 con 0x7ff0981010f0 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09819cf60 con 0x7ff0980fe110 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09819d120 con 0x7ff098101ab0 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff096ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 0x7ff098195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 0x7ff09819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff096ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 0x7ff098195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60896/0 (socket says 172.21.15.78:60896) 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff096ffd640 1 -- 172.21.15.78:0/2621869288 learned_addr learned my addr 172.21.15.78:0/2621869288 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 0x7ff09819c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:40820/0 (socket says 172.21.15.78:40820) 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff0977fe640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0980fe110 0x7ff0981952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 -- 172.21.15.78:0/2621869288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0980fe110 msgr2=0x7ff0981952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0980fe110 0x7ff0981952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 -- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 msgr2=0x7ff098195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 0x7ff098195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 -- 172.21.15.78:0/2621869288 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090009840 con 0x7ff098101ab0 2024-09-17T08:51:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff0977fe640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0980fe110 0x7ff0981952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:51:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff097fff640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 0x7ff09819c8b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff09000ec50 tx=0x7ff09000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff094ff9640 1 -- 172.21.15.78:0/2621869288 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090003b70 con 0x7ff098101ab0 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c009560 con 0x7ff098101ab0 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff094ff9640 1 -- 172.21.15.78:0/2621869288 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7ff09000ce70 con 0x7ff098101ab0 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff094ff9640 1 -- 172.21.15.78:0/2621869288 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090010690 con 0x7ff098101ab0 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09819d6f0 con 0x7ff098101ab0 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0980fe510 con 0x7ff098101ab0 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff094ff9640 1 -- 172.21.15.78:0/2621869288 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7ff090004020 con 0x7ff098101ab0 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff094ff9640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7ff08006ce00 0x7ff08006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff094ff9640 1 -- 172.21.15.78:0/2621869288 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5287+0+0 (secure 0 0 0) 0x7ff090014070 con 0x7ff098101ab0 2024-09-17T08:51:09.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.765+0000 7ff0977fe640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7ff08006ce00 0x7ff08006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:09.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.769+0000 7ff0977fe640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7ff08006ce00 0x7ff08006f2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0880058c0 tx=0x7ff088005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:09.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.773+0000 7ff094ff9640 1 -- 172.21.15.78:0/2621869288 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff090056cb0 con 0x7ff098101ab0 2024-09-17T08:51:09.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.945+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff09810ae40 con 0x7ff098101ab0 2024-09-17T08:51:09.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff094ff9640 1 -- 172.21.15.78:0/2621869288 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v59) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff09005a2d0 con 0x7ff098101ab0 2024-09-17T08:51:09.948 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:51:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7ff08006ce00 msgr2=0x7ff08006f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7ff08006ce00 0x7ff08006f2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0880058c0 tx=0x7ff088005850 comp rx=0 tx=0).stop 2024-09-17T08:51:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 msgr2=0x7ff09819c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 0x7ff09819c8b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff09000ec50 tx=0x7ff09000c6a0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 shutdown_connections 2024-09-17T08:51:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7ff08006ce00 0x7ff08006f2c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff098101ab0 0x7ff09819c8b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0981010f0 0x7ff098195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 --2- 172.21.15.78:0/2621869288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0980fe110 0x7ff0981952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 >> 172.21.15.78:0/2621869288 conn(0x7ff0980f9ca0 msgr2=0x7ff0980fb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 shutdown_connections 2024-09-17T08:51:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:09.949+0000 7ff09ddc1640 1 -- 172.21.15.78:0/2621869288 wait complete. 2024-09-17T08:51:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:10 smithi136 bash[24812]: audit 2024-09-17T08:51:09.950560+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.78:0/2621869288' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T08:51:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:10 smithi078 bash[22670]: audit 2024-09-17T08:51:09.950560+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.78:0/2621869288' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T08:51:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:10 smithi078 bash[32124]: audit 2024-09-17T08:51:09.950560+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.78:0/2621869288' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T08:51:10.705 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1726563062,"num_in_osds":8,"osd_in_since":1726563036,"num_remapped_pgs":0} 2024-09-17T08:51:10.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T08:51:11.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: cluster 2024-09-17T08:51:10.202141+0000 mgr.y (mgr.14150) 323 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T08:51:11.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.772460+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.778447+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.780316+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.781596+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.782667+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.783924+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.790357+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.792598+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:11.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.793874+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:11.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:11 smithi136 bash[24812]: audit 2024-09-17T08:51:10.803096+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: cluster 2024-09-17T08:51:10.202141+0000 mgr.y (mgr.14150) 323 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T08:51:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.772460+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.778447+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.780316+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.781596+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.782667+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.783924+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.790357+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.792598+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.793874+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:11.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[22670]: audit 2024-09-17T08:51:10.803096+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: cluster 2024-09-17T08:51:10.202141+0000 mgr.y (mgr.14150) 323 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T08:51:11.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.772460+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.778447+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.780316+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.781596+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.782667+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.783924+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:51:11.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.790357+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:11.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.792598+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:11.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.793874+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:11.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:11 smithi078 bash[32124]: audit 2024-09-17T08:51:10.803096+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:12.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:12 smithi136 bash[24812]: cephadm 2024-09-17T08:51:10.765437+0000 mgr.y (mgr.14150) 324 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:51:12.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:12 smithi136 bash[24812]: cephadm 2024-09-17T08:51:10.784818+0000 mgr.y (mgr.14150) 325 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 4316M 2024-09-17T08:51:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:12 smithi078 bash[22670]: cephadm 2024-09-17T08:51:10.765437+0000 mgr.y (mgr.14150) 324 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:51:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:12 smithi078 bash[22670]: cephadm 2024-09-17T08:51:10.784818+0000 mgr.y (mgr.14150) 325 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 4316M 2024-09-17T08:51:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:12 smithi078 bash[32124]: cephadm 2024-09-17T08:51:10.765437+0000 mgr.y (mgr.14150) 324 : cephadm [INF] Detected new or changed devices on smithi136 2024-09-17T08:51:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:12 smithi078 bash[32124]: cephadm 2024-09-17T08:51:10.784818+0000 mgr.y (mgr.14150) 325 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 4316M 2024-09-17T08:51:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:13 smithi136 bash[24812]: cluster 2024-09-17T08:51:12.202736+0000 mgr.y (mgr.14150) 326 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:51:13.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:13 smithi078 bash[22670]: cluster 2024-09-17T08:51:12.202736+0000 mgr.y (mgr.14150) 326 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:51:13.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:13 smithi078 bash[32124]: cluster 2024-09-17T08:51:12.202736+0000 mgr.y (mgr.14150) 326 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T08:51:15.446 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:51:15.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:15 smithi136 bash[24812]: cluster 2024-09-17T08:51:14.203304+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:15.553 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:15 smithi078 bash[32124]: cluster 2024-09-17T08:51:14.203304+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:15.553 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:15 smithi078 bash[22670]: cluster 2024-09-17T08:51:14.203304+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:17.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:17 smithi078 bash[22670]: cluster 2024-09-17T08:51:16.203888+0000 mgr.y (mgr.14150) 328 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:17.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:17 smithi078 bash[32124]: cluster 2024-09-17T08:51:16.203888+0000 mgr.y (mgr.14150) 328 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:17.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:17 smithi136 bash[24812]: cluster 2024-09-17T08:51:16.203888+0000 mgr.y (mgr.14150) 328 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- 172.21.15.78:0/3520022187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 msgr2=0x7f78bc102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 --2- 172.21.15.78:0/3520022187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc102600 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009ca0 tx=0x7f78b402a8b0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- 172.21.15.78:0/3520022187 shutdown_connections 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 --2- 172.21.15.78:0/3520022187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc107350 0x7f78bc10eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 --2- 172.21.15.78:0/3520022187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78bc102bd0 0x7f78bc106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 --2- 172.21.15.78:0/3520022187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc102600 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- 172.21.15.78:0/3520022187 >> 172.21.15.78:0/3520022187 conn(0x7f78bc0fdca0 msgr2=0x7f78bc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- 172.21.15.78:0/3520022187 shutdown_connections 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- 172.21.15.78:0/3520022187 wait complete. 2024-09-17T08:51:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 Processor -- start 2024-09-17T08:51:18.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- start start 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78bc102bd0 0x7f78bc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc107350 0x7f78bc197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc197e90 con 0x7f78bc107350 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc198000 con 0x7f78bc102bd0 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1981c0 con 0x7f78bc102220 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c24f6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c24f6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:38502/0 (socket says 172.21.15.78:38502) 2024-09-17T08:51:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c2cf7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc107350 0x7f78bc197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c24f6640 1 -- 172.21.15.78:0/3023057121 learned_addr learned my addr 172.21.15.78:0/3023057121 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c1cf5640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78bc102bd0 0x7f78bc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c2cf7640 1 -- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 msgr2=0x7f78bc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c2cf7640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c2cf7640 1 -- 172.21.15.78:0/3023057121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78bc102bd0 msgr2=0x7f78bc19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c2cf7640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78bc102bd0 0x7f78bc19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c2cf7640 1 -- 172.21.15.78:0/3023057121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009490 con 0x7f78bc107350 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c24f6640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c2cf7640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc107350 0x7f78bc197790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78b800e970 tx=0x7f78b800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78b37fe640 1 -- 172.21.15.78:0/3023057121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800ccc0 con 0x7f78bc107350 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b4009900 con 0x7f78bc107350 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78b37fe640 1 -- 172.21.15.78:0/3023057121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f78b8004470 con 0x7f78bc107350 2024-09-17T08:51:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78b37fe640 1 -- 172.21.15.78:0/3023057121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8003dd0 con 0x7f78bc107350 2024-09-17T08:51:18.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.428+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc1a4640 con 0x7f78bc107350 2024-09-17T08:51:18.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.432+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc103700 con 0x7f78bc107350 2024-09-17T08:51:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.432+0000 7f78b37fe640 1 -- 172.21.15.78:0/3023057121 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7f78b8003f30 con 0x7f78bc107350 2024-09-17T08:51:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.432+0000 7f78b37fe640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f78a806cdd0 0x7f78a806f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.432+0000 7f78b37fe640 1 -- 172.21.15.78:0/3023057121 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5287+0+0 (secure 0 0 0) 0x7f78b8014070 con 0x7f78bc107350 2024-09-17T08:51:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.432+0000 7f78c24f6640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f78a806cdd0 0x7f78a806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.432+0000 7f78c24f6640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f78a806cdd0 0x7f78a806f290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78b4000f80 tx=0x7f78b4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:18.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.436+0000 7f78b37fe640 1 -- 172.21.15.78:0/3023057121 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f78b80568e0 con 0x7f78bc107350 2024-09-17T08:51:18.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.608+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78bc10a530 con 0x7f78bc107350 2024-09-17T08:51:18.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.608+0000 7f78b37fe640 1 -- 172.21.15.78:0/3023057121 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13509 (secure 0 0 0) 0x7f78b8059f00 con 0x7f78bc107350 2024-09-17T08:51:18.611 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:51:18.611 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":59,"fsid":"7121dba6-74d0-11ef-bceb-c7b262605968","created":"2024-09-17T08:41:29.091359+0000","modified":"2024-09-17T08:51:06.249555+0000","last_up_change":"2024-09-17T08:51:02.190193+0000","last_in_change":"2024-09-17T08:50:36.098438+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T08:46:46.674639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd390083-c887-4412-9871-258ea390ed44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6803","nonce":2443355414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6805","nonce":2443355414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6809","nonce":2443355414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6807","nonce":2443355414}]},"public_addr":"172.21.15.78:6803/2443355414","cluster_addr":"172.21.15.78:6805/2443355414","heartbeat_back_addr":"172.21.15.78:6809/2443355414","heartbeat_front_addr":"172.21.15.78:6807/2443355414","state":["exists","up"]},{"osd":1,"uuid":"df02033a-c192-474c-8e90-ad746ec2147c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6811","nonce":4126079653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6813","nonce":4126079653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6817","nonce":4126079653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6815","nonce":4126079653}]},"public_addr":"172.21.15.78:6811/4126079653","cluster_addr":"172.21.15.78:6813/4126079653","heartbeat_back_addr":"172.21.15.78:6817/4126079653","heartbeat_front_addr":"172.21.15.78:6815/4126079653","state":["exists","up"]},{"osd":2,"uuid":"40d1111b-74f6-4d54-a1ab-d64ba1a626d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6819","nonce":671761081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6821","nonce":671761081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6825","nonce":671761081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6823","nonce":671761081}]},"public_addr":"172.21.15.78:6819/671761081","cluster_addr":"172.21.15.78:6821/671761081","heartbeat_back_addr":"172.21.15.78:6825/671761081","heartbeat_front_addr":"172.21.15.78:6823/671761081","state":["exists","up"]},{"osd":3,"uuid":"5abaea7b-fc8a-4cea-8b72-19fda0086dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6827","nonce":2849516131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6829","nonce":2849516131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6833","nonce":2849516131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6831","nonce":2849516131}]},"public_addr":"172.21.15.78:6827/2849516131","cluster_addr":"172.21.15.78:6829/2849516131","heartbeat_back_addr":"172.21.15.78:6833/2849516131","heartbeat_front_addr":"172.21.15.78:6831/2849516131","state":["exists","up"]},{"osd":4,"uuid":"baf3a9a4-6777-4698-9a2d-92e24e144473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6801","nonce":3532303027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6803","nonce":3532303027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6807","nonce":3532303027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6805","nonce":3532303027}]},"public_addr":"172.21.15.136:6801/3532303027","cluster_addr":"172.21.15.136:6803/3532303027","heartbeat_back_addr":"172.21.15.136:6807/3532303027","heartbeat_front_addr":"172.21.15.136:6805/3532303027","state":["exists","up"]},{"osd":5,"uuid":"3d3392e2-86a8-480b-9bdd-b4fe43046626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6809","nonce":3791268694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6811","nonce":3791268694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6815","nonce":3791268694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6813","nonce":3791268694}]},"public_addr":"172.21.15.136:6809/3791268694","cluster_addr":"172.21.15.136:6811/3791268694","heartbeat_back_addr":"172.21.15.136:6815/3791268694","heartbeat_front_addr":"172.21.15.136:6813/3791268694","state":["exists","up"]},{"osd":6,"uuid":"60c90e5d-be39-43a6-bfc9-63078abe1459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6817","nonce":456908616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6819","nonce":456908616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6823","nonce":456908616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6821","nonce":456908616}]},"public_addr":"172.21.15.136:6817/456908616","cluster_addr":"172.21.15.136:6819/456908616","heartbeat_back_addr":"172.21.15.136:6823/456908616","heartbeat_front_addr":"172.21.15.136:6821/456908616","state":["exists","up"]},{"osd":7,"uuid":"1efbd419-346f-4371-9e11-ab0e006c195b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6825","nonce":339955563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6827","nonce":339955563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6831","nonce":339955563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6829","nonce":339955563}]},"public_addr":"172.21.15.136:6825/339955563","cluster_addr":"172.21.15.136:6827/339955563","heartbeat_back_addr":"172.21.15.136:6831/339955563","heartbeat_front_addr":"172.21.15.136:6829/339955563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:44:57.870041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:45:50.021659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:46:43.001282+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:47:35.822754+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:48:25.595972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:49:17.170749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:50:08.875696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:51:00.599747+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/4006917361":"2024-09-18T08:42:28.063929+0000","172.21.15.78:6801/2109055855":"2024-09-18T08:42:28.063929+0000","172.21.15.78:6800/2109055855":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/952016135":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/2034125281":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/3522572920":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/1382206719":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/2714442386":"2024-09-18T08:41:56.432451+0000","172.21.15.78:6801/3976204901":"2024-09-18T08:41:56.432451+0000","172.21.15.78:6800/3976204901":"2024-09-18T08:41:56.432451+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T08:51:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f78a806cdd0 msgr2=0x7f78a806f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f78a806cdd0 0x7f78a806f290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78b4000f80 tx=0x7f78b4005c50 comp rx=0 tx=0).stop 2024-09-17T08:51:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc107350 msgr2=0x7f78bc197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc107350 0x7f78bc197790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78b800e970 tx=0x7f78b800ee30 comp rx=0 tx=0).stop 2024-09-17T08:51:18.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 shutdown_connections 2024-09-17T08:51:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f78a806cdd0 0x7f78a806f290 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc107350 0x7f78bc197790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78bc102bd0 0x7f78bc19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 --2- 172.21.15.78:0/3023057121 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78bc102220 0x7f78bc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 >> 172.21.15.78:0/3023057121 conn(0x7f78bc0fdca0 msgr2=0x7f78bc0fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 shutdown_connections 2024-09-17T08:51:18.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:18.612+0000 7f78c475a640 1 -- 172.21.15.78:0/3023057121 wait complete. 2024-09-17T08:51:19.256 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T08:46:46.674639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T08:51:19.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T08:51:19.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:19 smithi078 bash[22670]: cluster 2024-09-17T08:51:18.204290+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:19.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:19 smithi078 bash[22670]: audit 2024-09-17T08:51:18.612614+0000 mon.a (mon.0) 637 : audit [DBG] from='client.? 172.21.15.78:0/3023057121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:51:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:19 smithi078 bash[32124]: cluster 2024-09-17T08:51:18.204290+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:19 smithi078 bash[32124]: audit 2024-09-17T08:51:18.612614+0000 mon.a (mon.0) 637 : audit [DBG] from='client.? 172.21.15.78:0/3023057121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:51:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:19 smithi136 bash[24812]: cluster 2024-09-17T08:51:18.204290+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:19.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:19 smithi136 bash[24812]: audit 2024-09-17T08:51:18.612614+0000 mon.a (mon.0) 637 : audit [DBG] from='client.? 172.21.15.78:0/3023057121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:51:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:21 smithi078 bash[22670]: cluster 2024-09-17T08:51:20.204843+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:21.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:21 smithi078 bash[32124]: cluster 2024-09-17T08:51:20.204843+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:21 smithi136 bash[24812]: cluster 2024-09-17T08:51:20.204843+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:23.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:23 smithi078 bash[22670]: cluster 2024-09-17T08:51:22.205419+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:23.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:23 smithi078 bash[32124]: cluster 2024-09-17T08:51:22.205419+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:23 smithi136 bash[24812]: cluster 2024-09-17T08:51:22.205419+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:51:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:25 smithi078 bash[22670]: cluster 2024-09-17T08:51:24.205948+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:25 smithi078 bash[32124]: cluster 2024-09-17T08:51:24.205948+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:25.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:25 smithi136 bash[24812]: cluster 2024-09-17T08:51:24.205948+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:26.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- 172.21.15.78:0/256872260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 msgr2=0x7fd204101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:26.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 --2- 172.21.15.78:0/256872260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd204101370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009860 tx=0x7fd1ec02a3d0 comp rx=0 tx=0).stop 2024-09-17T08:51:26.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- 172.21.15.78:0/256872260 shutdown_connections 2024-09-17T08:51:26.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 --2- 172.21.15.78:0/256872260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20410a3c0 0x7fd20410c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:26.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 --2- 172.21.15.78:0/256872260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 0x7fd204109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:26.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 --2- 172.21.15.78:0/256872260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd204101370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:26.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- 172.21.15.78:0/256872260 >> 172.21.15.78:0/256872260 conn(0x7fd2040fa9f0 msgr2=0x7fd2040fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:26.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- 172.21.15.78:0/256872260 shutdown_connections 2024-09-17T08:51:26.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- 172.21.15.78:0/256872260 wait complete. 2024-09-17T08:51:26.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 Processor -- start 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- start start 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd20419b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 0x7fd20419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20410a3c0 0x7fd204195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204195c70 con 0x7fd2041018b0 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204195de0 con 0x7fd20410a3c0 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd204195fa0 con 0x7fd204100f90 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd20419b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd201d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 0x7fd20419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd201d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 0x7fd20419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39156/0 (socket says 172.21.15.78:39156) 2024-09-17T08:51:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd20419b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51192/0 (socket says 172.21.15.78:51192) 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd201d9b640 1 -- 172.21.15.78:0/2677127030 learned_addr learned my addr 172.21.15.78:0/2677127030 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd202d9d640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20410a3c0 0x7fd204195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 -- 172.21.15.78:0/2677127030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20410a3c0 msgr2=0x7fd204195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20410a3c0 0x7fd204195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 -- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 msgr2=0x7fd20419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 0x7fd20419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 -- 172.21.15.78:0/2677127030 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009560 con 0x7fd204100f90 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd202d9d640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20410a3c0 0x7fd204195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd201d9b640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 0x7fd20419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd20259c640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd20419b530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec02a8f0 tx=0x7fd1ec004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd1fb7fe640 1 -- 172.21.15.78:0/2677127030 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec004050 con 0x7fd204100f90 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd1fb7fe640 1 -- 172.21.15.78:0/2677127030 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fd1ec0306a0 con 0x7fd204100f90 2024-09-17T08:51:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec009490 con 0x7fd204100f90 2024-09-17T08:51:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.912+0000 7fd1fb7fe640 1 -- 172.21.15.78:0/2677127030 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec003850 con 0x7fd204100f90 2024-09-17T08:51:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.916+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2041a2350 con 0x7fd204100f90 2024-09-17T08:51:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.916+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd204069030 con 0x7fd204100f90 2024-09-17T08:51:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.916+0000 7fd1fb7fe640 1 -- 172.21.15.78:0/2677127030 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7fd1ec0041b0 con 0x7fd204100f90 2024-09-17T08:51:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.916+0000 7fd1fb7fe640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fd1f006cdd0 0x7fd1f006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.916+0000 7fd1fb7fe640 1 -- 172.21.15.78:0/2677127030 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5287+0+0 (secure 0 0 0) 0x7fd1ec0acf50 con 0x7fd204100f90 2024-09-17T08:51:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.916+0000 7fd201d9b640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fd1f006cdd0 0x7fd1f006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.916+0000 7fd201d9b640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fd1f006cdd0 0x7fd1f006f290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd204196a90 tx=0x7fd1f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:26.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:26.920+0000 7fd1fb7fe640 1 -- 172.21.15.78:0/2677127030 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd1ec077500 con 0x7fd204100f90 2024-09-17T08:51:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.088+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd204101370 con 0x7fd204100f90 2024-09-17T08:51:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.088+0000 7fd1fb7fe640 1 -- 172.21.15.78:0/2677127030 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1ec07fe60 con 0x7fd204100f90 2024-09-17T08:51:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-17T08:51:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fd1f006cdd0 msgr2=0x7fd1f006f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fd1f006cdd0 0x7fd1f006f290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd204196a90 tx=0x7fd1f4009260 comp rx=0 tx=0).stop 2024-09-17T08:51:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 msgr2=0x7fd20419b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd20419b530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec02a8f0 tx=0x7fd1ec004970 comp rx=0 tx=0).stop 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 shutdown_connections 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fd1f006cdd0 0x7fd1f006f290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd20410a3c0 0x7fd204195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2041018b0 0x7fd20419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 --2- 172.21.15.78:0/2677127030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd204100f90 0x7fd20419b530 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 >> 172.21.15.78:0/2677127030 conn(0x7fd2040fa9f0 msgr2=0x7fd2040fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 shutdown_connections 2024-09-17T08:51:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:51:27.092+0000 7fd208bc0640 1 -- 172.21.15.78:0/2677127030 wait complete. 2024-09-17T08:51:27.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:27 smithi078 bash[22670]: cluster 2024-09-17T08:51:26.206518+0000 mgr.y (mgr.14150) 333 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:27.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:27 smithi078 bash[22670]: audit 2024-09-17T08:51:27.092158+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.78:0/2677127030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T08:51:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:27 smithi078 bash[32124]: cluster 2024-09-17T08:51:26.206518+0000 mgr.y (mgr.14150) 333 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:27.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:27 smithi078 bash[32124]: audit 2024-09-17T08:51:27.092158+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.78:0/2677127030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T08:51:27.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:27 smithi136 bash[24812]: cluster 2024-09-17T08:51:26.206518+0000 mgr.y (mgr.14150) 333 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:27 smithi136 bash[24812]: audit 2024-09-17T08:51:27.092158+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.78:0/2677127030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T08:51:27.798 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi078 2024-09-17T08:51:27.798 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply rgw foo.a --placement '1;smithi078=foo.a' 2024-09-17T08:51:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:29 smithi078 bash[22670]: cluster 2024-09-17T08:51:28.207097+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:29 smithi078 bash[32124]: cluster 2024-09-17T08:51:28.207097+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:29.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:29 smithi136 bash[24812]: cluster 2024-09-17T08:51:28.207097+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:31 smithi078 bash[22670]: cluster 2024-09-17T08:51:30.207688+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:31 smithi078 bash[32124]: cluster 2024-09-17T08:51:30.207688+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:31.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:31 smithi136 bash[24812]: cluster 2024-09-17T08:51:30.207688+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:32.509 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:51:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:33 smithi078 bash[22670]: cluster 2024-09-17T08:51:32.208246+0000 mgr.y (mgr.14150) 336 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:33 smithi078 bash[32124]: cluster 2024-09-17T08:51:32.208246+0000 mgr.y (mgr.14150) 336 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:33.680 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:33 smithi136 bash[24812]: cluster 2024-09-17T08:51:32.208246+0000 mgr.y (mgr.14150) 336 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:35.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 -- 172.21.15.136:0/223112051 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fe8b0 msgr2=0x7f0a600fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:35.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 --2- 172.21.15.136:0/223112051 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fe8b0 0x7f0a600fed60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009ca0 tx=0x7f0a5802a8b0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 -- 172.21.15.136:0/223112051 shutdown_connections 2024-09-17T08:51:35.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 --2- 172.21.15.136:0/223112051 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fe8b0 0x7f0a600fed60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 --2- 172.21.15.136:0/223112051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a600fdef0 0x7f0a600fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 --2- 172.21.15.136:0/223112051 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a601003f0 0x7f0a601007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 -- 172.21.15.136:0/223112051 >> 172.21.15.136:0/223112051 conn(0x7f0a600f9ca0 msgr2=0x7f0a600fc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:35.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 -- 172.21.15.136:0/223112051 shutdown_connections 2024-09-17T08:51:35.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.134+0000 7f0a6834f640 1 -- 172.21.15.136:0/223112051 wait complete. 2024-09-17T08:51:35.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 Processor -- start 2024-09-17T08:51:35.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 -- start start 2024-09-17T08:51:35.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fdef0 0x7f0a60197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:35.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a600fe8b0 0x7f0a60197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:35.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a601003f0 0x7f0a6019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:35.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6019ee20 con 0x7f0a600fe8b0 2024-09-17T08:51:35.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6019ef90 con 0x7f0a600fdef0 2024-09-17T08:51:35.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6019f150 con 0x7f0a601003f0 2024-09-17T08:51:35.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fdef0 0x7f0a60197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:35.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fdef0 0x7f0a60197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55806/0 (socket says 172.21.15.136:55806) 2024-09-17T08:51:35.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 -- 172.21.15.136:0/2917529412 learned_addr learned my addr 172.21.15.136:0/2917529412 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:51:35.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a668ec640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a601003f0 0x7f0a6019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a658ea640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a600fe8b0 0x7f0a60197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 -- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a601003f0 msgr2=0x7f0a6019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a601003f0 0x7f0a6019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 -- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a600fe8b0 msgr2=0x7f0a60197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a600fe8b0 0x7f0a60197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 -- 172.21.15.136:0/2917529412 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009900 con 0x7f0a600fdef0 2024-09-17T08:51:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a660eb640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fdef0 0x7f0a60197320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c920 tx=0x7f0a5c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a577fe640 1 -- 172.21.15.136:0/2917529412 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c007c70 con 0x7f0a600fdef0 2024-09-17T08:51:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6019f430 con 0x7f0a600fdef0 2024-09-17T08:51:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a577fe640 1 -- 172.21.15.136:0/2917529412 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0a5c007dd0 con 0x7f0a600fdef0 2024-09-17T08:51:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a577fe640 1 -- 172.21.15.136:0/2917529412 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c018660 con 0x7f0a600fdef0 2024-09-17T08:51:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6019f980 con 0x7f0a600fdef0 2024-09-17T08:51:35.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a600fed60 con 0x7f0a600fdef0 2024-09-17T08:51:35.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a577fe640 1 -- 172.21.15.136:0/2917529412 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7f0a5c00f450 con 0x7f0a600fdef0 2024-09-17T08:51:35.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a577fe640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0a4c06ce00 0x7f0a4c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:35.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a577fe640 1 -- 172.21.15.136:0/2917529412 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5287+0+0 (secure 0 0 0) 0x7f0a5c08c190 con 0x7f0a600fdef0 2024-09-17T08:51:35.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.138+0000 7f0a658ea640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0a4c06ce00 0x7f0a4c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:35.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.142+0000 7f0a658ea640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0a4c06ce00 0x7f0a4c06f2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a500058c0 tx=0x7f0a50005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:35.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.146+0000 7f0a577fe640 1 -- 172.21.15.136:0/2917529412 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a5c056690 con 0x7f0a600fdef0 2024-09-17T08:51:35.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.334+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi078=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a6010d0e0 con 0x7f0a4c06ce00 2024-09-17T08:51:35.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.346+0000 7f0a577fe640 1 -- 172.21.15.136:0/2917529412 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7f0a6010d0e0 con 0x7f0a4c06ce00 2024-09-17T08:51:35.348 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled rgw.foo.a update... 2024-09-17T08:51:35.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0a4c06ce00 msgr2=0x7f0a4c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:35.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0a4c06ce00 0x7f0a4c06f2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a500058c0 tx=0x7f0a50005850 comp rx=0 tx=0).stop 2024-09-17T08:51:35.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fdef0 msgr2=0x7f0a60197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:35.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fdef0 0x7f0a60197320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c920 tx=0x7f0a5c00cde0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 shutdown_connections 2024-09-17T08:51:35.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f0a4c06ce00 0x7f0a4c06f2c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a601003f0 0x7f0a6019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a600fe8b0 0x7f0a60197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 --2- 172.21.15.136:0/2917529412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a600fdef0 0x7f0a60197320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:35.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 >> 172.21.15.136:0/2917529412 conn(0x7f0a600f9ca0 msgr2=0x7f0a600fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:35.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 shutdown_connections 2024-09-17T08:51:35.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:35.350+0000 7f0a6834f640 1 -- 172.21.15.136:0/2917529412 wait complete. 2024-09-17T08:51:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:35 smithi078 bash[22670]: cluster 2024-09-17T08:51:34.208768+0000 mgr.y (mgr.14150) 337 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:35.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:35 smithi078 bash[32124]: cluster 2024-09-17T08:51:34.208768+0000 mgr.y (mgr.14150) 337 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:35 smithi136 bash[24812]: cluster 2024-09-17T08:51:34.208768+0000 mgr.y (mgr.14150) 337 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:35.969 DEBUG:teuthology.orchestra.run.smithi078:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@rgw.foo.a.service 2024-09-17T08:51:35.972 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi136 2024-09-17T08:51:35.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd pool create datapool 3 3 replicated 2024-09-17T08:51:36.297 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:51:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:36.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.338820+0000 mgr.y (mgr.14150) 338 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi078=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:51:36.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: cephadm 2024-09-17T08:51:35.342292+0000 mgr.y (mgr.14150) 339 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi078=foo.a;count:1 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.349587+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.351392+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.881094+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.882357+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.889067+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.894028+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.898802+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.905235+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[22670]: audit 2024-09-17T08:51:35.906817+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.338820+0000 mgr.y (mgr.14150) 338 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi078=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: cephadm 2024-09-17T08:51:35.342292+0000 mgr.y (mgr.14150) 339 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi078=foo.a;count:1 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.349587+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.351392+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.881094+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.882357+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.889067+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.894028+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T08:51:36.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.898802+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T08:51:36.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.905235+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:36 smithi078 bash[32124]: audit 2024-09-17T08:51:35.906817+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.338820+0000 mgr.y (mgr.14150) 338 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi078=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: cephadm 2024-09-17T08:51:35.342292+0000 mgr.y (mgr.14150) 339 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi078=foo.a;count:1 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.349587+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.351392+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.881094+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.882357+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.889067+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.894028+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T08:51:36.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.898802+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T08:51:36.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.905235+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:36.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:36 smithi136 bash[24812]: audit 2024-09-17T08:51:35.906817+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:37.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:37 smithi078 bash[22670]: cephadm 2024-09-17T08:51:35.908211+0000 mgr.y (mgr.14150) 340 : cephadm [INF] Deploying daemon rgw.foo.a on smithi078 2024-09-17T08:51:37.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:37 smithi078 bash[22670]: cluster 2024-09-17T08:51:36.209197+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:37.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:37 smithi078 bash[32124]: cephadm 2024-09-17T08:51:35.908211+0000 mgr.y (mgr.14150) 340 : cephadm [INF] Deploying daemon rgw.foo.a on smithi078 2024-09-17T08:51:37.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:37 smithi078 bash[32124]: cluster 2024-09-17T08:51:36.209197+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:37.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:37 smithi136 bash[24812]: cephadm 2024-09-17T08:51:35.908211+0000 mgr.y (mgr.14150) 340 : cephadm [INF] Deploying daemon rgw.foo.a on smithi078 2024-09-17T08:51:37.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:37 smithi136 bash[24812]: cluster 2024-09-17T08:51:36.209197+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:38.484 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.484 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.485 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.485 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.486 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.486 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.853 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.853 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.854 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.854 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.854 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.854 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.854 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.854 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:51:38.854 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:51:38 smithi078 systemd[1]: Started Ceph rgw.foo.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:51:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[22670]: cluster 2024-09-17T08:51:38.209607+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[22670]: audit 2024-09-17T08:51:38.769352+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[22670]: audit 2024-09-17T08:51:38.775410+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[22670]: audit 2024-09-17T08:51:38.780161+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[22670]: audit 2024-09-17T08:51:38.784548+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[22670]: audit 2024-09-17T08:51:38.789349+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[22670]: audit 2024-09-17T08:51:38.819002+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[32124]: cluster 2024-09-17T08:51:38.209607+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[32124]: audit 2024-09-17T08:51:38.769352+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[32124]: audit 2024-09-17T08:51:38.775410+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[32124]: audit 2024-09-17T08:51:38.780161+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[32124]: audit 2024-09-17T08:51:38.784548+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[32124]: audit 2024-09-17T08:51:38.789349+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:39 smithi078 bash[32124]: audit 2024-09-17T08:51:38.819002+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:39.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:39 smithi136 bash[24812]: cluster 2024-09-17T08:51:38.209607+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:39 smithi136 bash[24812]: audit 2024-09-17T08:51:38.769352+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:39 smithi136 bash[24812]: audit 2024-09-17T08:51:38.775410+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:39 smithi136 bash[24812]: audit 2024-09-17T08:51:38.780161+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:39 smithi136 bash[24812]: audit 2024-09-17T08:51:38.784548+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:39 smithi136 bash[24812]: audit 2024-09-17T08:51:38.789349+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:39 smithi136 bash[24812]: audit 2024-09-17T08:51:38.819002+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:40.668 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:51:40.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:40 smithi136 bash[24812]: cephadm 2024-09-17T08:51:38.780822+0000 mgr.y (mgr.14150) 343 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi078=foo.a;count:1 2024-09-17T08:51:40.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:40 smithi136 bash[24812]: audit 2024-09-17T08:51:39.426290+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:40.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:40 smithi078 bash[22670]: cephadm 2024-09-17T08:51:38.780822+0000 mgr.y (mgr.14150) 343 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi078=foo.a;count:1 2024-09-17T08:51:40.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:40 smithi078 bash[22670]: audit 2024-09-17T08:51:39.426290+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:40 smithi078 bash[32124]: cephadm 2024-09-17T08:51:38.780822+0000 mgr.y (mgr.14150) 343 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi078=foo.a;count:1 2024-09-17T08:51:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:40 smithi078 bash[32124]: audit 2024-09-17T08:51:39.426290+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:41.728 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:41 smithi136 bash[24812]: cluster 2024-09-17T08:51:40.210122+0000 mgr.y (mgr.14150) 344 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:41.728 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:41 smithi136 bash[24812]: cluster 2024-09-17T08:51:40.442177+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-17T08:51:41.728 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:41 smithi136 bash[24812]: audit 2024-09-17T08:51:40.444128+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T08:51:41.728 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:41 smithi136 bash[24812]: audit 2024-09-17T08:51:40.446244+0000 mon.a (mon.0) 655 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T08:51:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[32124]: cluster 2024-09-17T08:51:40.210122+0000 mgr.y (mgr.14150) 344 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[32124]: cluster 2024-09-17T08:51:40.442177+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-17T08:51:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[32124]: audit 2024-09-17T08:51:40.444128+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T08:51:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[32124]: audit 2024-09-17T08:51:40.446244+0000 mon.a (mon.0) 655 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T08:51:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[22670]: cluster 2024-09-17T08:51:40.210122+0000 mgr.y (mgr.14150) 344 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[22670]: cluster 2024-09-17T08:51:40.442177+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-17T08:51:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[22670]: audit 2024-09-17T08:51:40.444128+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T08:51:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:41 smithi078 bash[22670]: audit 2024-09-17T08:51:40.446244+0000 mon.a (mon.0) 655 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T08:51:42.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:42 smithi136 bash[24812]: audit 2024-09-17T08:51:41.442970+0000 mon.a (mon.0) 656 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T08:51:42.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:42 smithi136 bash[24812]: cluster 2024-09-17T08:51:41.443485+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-17T08:51:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:42 smithi078 bash[22670]: audit 2024-09-17T08:51:41.442970+0000 mon.a (mon.0) 656 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T08:51:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:42 smithi078 bash[22670]: cluster 2024-09-17T08:51:41.443485+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-17T08:51:42.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:42 smithi078 bash[32124]: audit 2024-09-17T08:51:41.442970+0000 mon.a (mon.0) 656 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T08:51:42.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:42 smithi078 bash[32124]: cluster 2024-09-17T08:51:41.443485+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-17T08:51:43.678 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- 172.21.15.136:0/287802812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644074460 msgr2=0x7fe6440728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:43.678 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 --2- 172.21.15.136:0/287802812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644074460 0x7fe6440728c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009900 tx=0x7fe63c02a410 comp rx=0 tx=0).stop 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- 172.21.15.136:0/287802812 shutdown_connections 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 --2- 172.21.15.136:0/287802812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe644107cd0 0x7fe64410a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 --2- 172.21.15.136:0/287802812 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe644072e00 0x7fe644073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 --2- 172.21.15.136:0/287802812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644074460 0x7fe6440728c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- 172.21.15.136:0/287802812 >> 172.21.15.136:0/287802812 conn(0x7fe6440fb5f0 msgr2=0x7fe6440fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- 172.21.15.136:0/287802812 shutdown_connections 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- 172.21.15.136:0/287802812 wait complete. 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 Processor -- start 2024-09-17T08:51:43.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- start start 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644072e00 0x7fe644197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe644074460 0x7fe6441979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe644107cd0 0x7fe64419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419ef90 con 0x7fe644107cd0 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419f100 con 0x7fe644072e00 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64c59c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419f2c0 con 0x7fe644074460 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64a338640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644072e00 0x7fe644197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64a338640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644072e00 0x7fe644197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56762/0 (socket says 172.21.15.136:56762) 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64a338640 1 -- 172.21.15.136:0/1480579770 learned_addr learned my addr 172.21.15.136:0/1480579770 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:51:43.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe649b37640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe644074460 0x7fe6441979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.678+0000 7fe64ab39640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe644107cd0 0x7fe64419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64a338640 1 -- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe644074460 msgr2=0x7fe6441979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64a338640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe644074460 0x7fe6441979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64a338640 1 -- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe644107cd0 msgr2=0x7fe64419ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64a338640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe644107cd0 0x7fe64419ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64a338640 1 -- 172.21.15.136:0/1480579770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c009560 con 0x7fe644072e00 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64ab39640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe644107cd0 0x7fe64419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64a338640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644072e00 0x7fe644197490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe63c005940 tx=0x7fe63c004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe6437fe640 1 -- 172.21.15.136:0/1480579770 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c031ca0 con 0x7fe644072e00 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe6437fe640 1 -- 172.21.15.136:0/1480579770 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fe63c031e00 con 0x7fe644072e00 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64419f540 con 0x7fe644072e00 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe6437fe640 1 -- 172.21.15.136:0/1480579770 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c003960 con 0x7fe644072e00 2024-09-17T08:51:43.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64419fa30 con 0x7fe644072e00 2024-09-17T08:51:43.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644073260 con 0x7fe644072e00 2024-09-17T08:51:43.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe6437fe640 1 -- 172.21.15.136:0/1480579770 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7fe63c003ac0 con 0x7fe644072e00 2024-09-17T08:51:43.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe6437fe640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fe62c06ce00 0x7fe62c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:51:43.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe6437fe640 1 -- 172.21.15.136:0/1480579770 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6011+0+0 (secure 0 0 0) 0x7fe63c0ad340 con 0x7fe644072e00 2024-09-17T08:51:43.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe649b37640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fe62c06ce00 0x7fe62c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:51:43.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.682+0000 7fe649b37640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fe62c06ce00 0x7fe62c06f2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6441989b0 tx=0x7fe63800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:51:43.686 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.686+0000 7fe6437fe640 1 -- 172.21.15.136:0/1480579770 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe63c077620 con 0x7fe644072e00 2024-09-17T08:51:43.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:43 smithi136 bash[24812]: cluster 2024-09-17T08:51:42.210767+0000 mgr.y (mgr.14150) 345 : cluster [DBG] pgmap v328: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:43.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:43 smithi136 bash[24812]: cluster 2024-09-17T08:51:42.475039+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-17T08:51:43.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:43 smithi136 bash[24812]: audit 2024-09-17T08:51:42.481069+0000 mon.c (mon.2) 16 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T08:51:43.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:43 smithi136 bash[24812]: audit 2024-09-17T08:51:42.482347+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T08:51:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[32124]: cluster 2024-09-17T08:51:42.210767+0000 mgr.y (mgr.14150) 345 : cluster [DBG] pgmap v328: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[32124]: cluster 2024-09-17T08:51:42.475039+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-17T08:51:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[32124]: audit 2024-09-17T08:51:42.481069+0000 mon.c (mon.2) 16 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T08:51:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[32124]: audit 2024-09-17T08:51:42.482347+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T08:51:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[22670]: cluster 2024-09-17T08:51:42.210767+0000 mgr.y (mgr.14150) 345 : cluster [DBG] pgmap v328: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:51:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[22670]: cluster 2024-09-17T08:51:42.475039+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-17T08:51:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[22670]: audit 2024-09-17T08:51:42.481069+0000 mon.c (mon.2) 16 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T08:51:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:43 smithi078 bash[22670]: audit 2024-09-17T08:51:42.482347+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T08:51:43.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:43.866+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7fe6441063d0 con 0x7fe644072e00 2024-09-17T08:51:44.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.478+0000 7fe6437fe640 1 -- 172.21.15.136:0/1480579770 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v64) v1 ==== 160+0+0 (secure 0 0 0) 0x7fe63c07ac40 con 0x7fe644072e00 2024-09-17T08:51:44.477 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'datapool' created 2024-09-17T08:51:44.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fe62c06ce00 msgr2=0x7fe62c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fe62c06ce00 0x7fe62c06f2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6441989b0 tx=0x7fe63800b390 comp rx=0 tx=0).stop 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644072e00 msgr2=0x7fe644197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644072e00 0x7fe644197490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe63c005940 tx=0x7fe63c004360 comp rx=0 tx=0).stop 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 shutdown_connections 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7fe62c06ce00 0x7fe62c06f2c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe644107cd0 0x7fe64419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe644074460 0x7fe6441979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 --2- 172.21.15.136:0/1480579770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644072e00 0x7fe644197490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.486+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 >> 172.21.15.136:0/1480579770 conn(0x7fe6440fb5f0 msgr2=0x7fe6440fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.490+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 shutdown_connections 2024-09-17T08:51:44.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:51:44.490+0000 7fe64c59c640 1 -- 172.21.15.136:0/1480579770 wait complete. 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:43.475017+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: cluster 2024-09-17T08:51:43.475295+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:43.871007+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.136:0/1480579770' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:43.956218+0000 mon.a (mon.0) 662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:44.367083+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:44.375589+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:44.376958+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:44.378147+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:44.470636+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-17T08:51:44.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: cluster 2024-09-17T08:51:44.470796+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-17T08:51:44.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:44.473488+0000 mon.c (mon.2) 17 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T08:51:44.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:44 smithi136 bash[24812]: audit 2024-09-17T08:51:44.474128+0000 mon.a (mon.0) 669 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T08:51:44.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:43.475017+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: cluster 2024-09-17T08:51:43.475295+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:43.871007+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.136:0/1480579770' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:43.956218+0000 mon.a (mon.0) 662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:44.367083+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:44.375589+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:44.376958+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:44.378147+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:44.470636+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: cluster 2024-09-17T08:51:44.470796+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:44.473488+0000 mon.c (mon.2) 17 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T08:51:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[22670]: audit 2024-09-17T08:51:44.474128+0000 mon.a (mon.0) 669 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:43.475017+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: cluster 2024-09-17T08:51:43.475295+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:43.871007+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.136:0/1480579770' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:43.956218+0000 mon.a (mon.0) 662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:44.367083+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:44.375589+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:44.376958+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:44.378147+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:44.470636+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: cluster 2024-09-17T08:51:44.470796+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:44.473488+0000 mon.c (mon.2) 17 : audit [INF] from='client.? 172.21.15.78:0/3347541821' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T08:51:44.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:44 smithi078 bash[32124]: audit 2024-09-17T08:51:44.474128+0000 mon.a (mon.0) 669 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T08:51:45.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- rbd pool init datapool 2024-09-17T08:51:45.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:45 smithi136 bash[24812]: cluster 2024-09-17T08:51:44.211327+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v331: 65 pgs: 9 creating+peering, 17 active+clean, 39 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 767 B/s wr, 1 op/s 2024-09-17T08:51:45.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:45 smithi136 bash[24812]: cephadm 2024-09-17T08:51:44.388532+0000 mgr.y (mgr.14150) 347 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-17T08:51:45.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:45 smithi136 bash[24812]: audit 2024-09-17T08:51:45.476821+0000 mon.a (mon.0) 670 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T08:51:45.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:45 smithi136 bash[24812]: cluster 2024-09-17T08:51:45.477259+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-17T08:51:45.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[22670]: cluster 2024-09-17T08:51:44.211327+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v331: 65 pgs: 9 creating+peering, 17 active+clean, 39 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 767 B/s wr, 1 op/s 2024-09-17T08:51:45.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[22670]: cephadm 2024-09-17T08:51:44.388532+0000 mgr.y (mgr.14150) 347 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-17T08:51:45.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[22670]: audit 2024-09-17T08:51:45.476821+0000 mon.a (mon.0) 670 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T08:51:45.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[22670]: cluster 2024-09-17T08:51:45.477259+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-17T08:51:45.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[32124]: cluster 2024-09-17T08:51:44.211327+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v331: 65 pgs: 9 creating+peering, 17 active+clean, 39 unknown; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 767 B/s wr, 1 op/s 2024-09-17T08:51:45.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[32124]: cephadm 2024-09-17T08:51:44.388532+0000 mgr.y (mgr.14150) 347 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-17T08:51:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[32124]: audit 2024-09-17T08:51:45.476821+0000 mon.a (mon.0) 670 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T08:51:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:45 smithi078 bash[32124]: cluster 2024-09-17T08:51:45.477259+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-17T08:51:47.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:46 smithi136 bash[24812]: cluster 2024-09-17T08:51:46.212077+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v334: 100 pgs: 19 creating+peering, 46 active+clean, 35 unknown; 578 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-17T08:51:47.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:46 smithi136 bash[24812]: cluster 2024-09-17T08:51:46.710047+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-17T08:51:47.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:46 smithi136 bash[24812]: audit 2024-09-17T08:51:46.711601+0000 mon.c (mon.2) 18 : audit [INF] from='client.? 172.21.15.78:0/2867000391' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:46 smithi136 bash[24812]: audit 2024-09-17T08:51:46.712508+0000 mon.c (mon.2) 19 : audit [INF] from='client.? 172.21.15.78:0/1085750018' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:46 smithi136 bash[24812]: audit 2024-09-17T08:51:46.713712+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:46 smithi136 bash[24812]: audit 2024-09-17T08:51:46.714618+0000 mon.a (mon.0) 674 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:46 smithi136 bash[24812]: cluster 2024-09-17T08:51:46.746669+0000 mon.a (mon.0) 675 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:51:47.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[22670]: cluster 2024-09-17T08:51:46.212077+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v334: 100 pgs: 19 creating+peering, 46 active+clean, 35 unknown; 578 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[22670]: cluster 2024-09-17T08:51:46.710047+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[22670]: audit 2024-09-17T08:51:46.711601+0000 mon.c (mon.2) 18 : audit [INF] from='client.? 172.21.15.78:0/2867000391' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[22670]: audit 2024-09-17T08:51:46.712508+0000 mon.c (mon.2) 19 : audit [INF] from='client.? 172.21.15.78:0/1085750018' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[22670]: audit 2024-09-17T08:51:46.713712+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[22670]: audit 2024-09-17T08:51:46.714618+0000 mon.a (mon.0) 674 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[22670]: cluster 2024-09-17T08:51:46.746669+0000 mon.a (mon.0) 675 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[32124]: cluster 2024-09-17T08:51:46.212077+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v334: 100 pgs: 19 creating+peering, 46 active+clean, 35 unknown; 578 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[32124]: cluster 2024-09-17T08:51:46.710047+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[32124]: audit 2024-09-17T08:51:46.711601+0000 mon.c (mon.2) 18 : audit [INF] from='client.? 172.21.15.78:0/2867000391' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[32124]: audit 2024-09-17T08:51:46.712508+0000 mon.c (mon.2) 19 : audit [INF] from='client.? 172.21.15.78:0/1085750018' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[32124]: audit 2024-09-17T08:51:46.713712+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[32124]: audit 2024-09-17T08:51:46.714618+0000 mon.a (mon.0) 674 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T08:51:47.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:46 smithi078 bash[32124]: cluster 2024-09-17T08:51:46.746669+0000 mon.a (mon.0) 675 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:51:49.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: audit 2024-09-17T08:51:47.709102+0000 mon.a (mon.0) 676 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T08:51:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: audit 2024-09-17T08:51:47.709437+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T08:51:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: cluster 2024-09-17T08:51:47.710240+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-17T08:51:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: audit 2024-09-17T08:51:47.717080+0000 mon.c (mon.2) 20 : audit [INF] from='client.? 172.21.15.78:0/2867000391' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: audit 2024-09-17T08:51:47.718037+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: audit 2024-09-17T08:51:47.719069+0000 mon.c (mon.2) 21 : audit [INF] from='client.? 172.21.15.78:0/1085750018' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: audit 2024-09-17T08:51:47.719876+0000 mon.a (mon.0) 680 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:48 smithi136 bash[24812]: cluster 2024-09-17T08:51:48.212920+0000 mgr.y (mgr.14150) 349 : cluster [DBG] pgmap v337: 132 pgs: 30 creating+peering, 74 active+clean, 28 unknown; 578 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:51:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: audit 2024-09-17T08:51:47.709102+0000 mon.a (mon.0) 676 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T08:51:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: audit 2024-09-17T08:51:47.709437+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T08:51:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: cluster 2024-09-17T08:51:47.710240+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-17T08:51:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: audit 2024-09-17T08:51:47.717080+0000 mon.c (mon.2) 20 : audit [INF] from='client.? 172.21.15.78:0/2867000391' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: audit 2024-09-17T08:51:47.718037+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: audit 2024-09-17T08:51:47.719069+0000 mon.c (mon.2) 21 : audit [INF] from='client.? 172.21.15.78:0/1085750018' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: audit 2024-09-17T08:51:47.719876+0000 mon.a (mon.0) 680 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[22670]: cluster 2024-09-17T08:51:48.212920+0000 mgr.y (mgr.14150) 349 : cluster [DBG] pgmap v337: 132 pgs: 30 creating+peering, 74 active+clean, 28 unknown; 578 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:51:49.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: audit 2024-09-17T08:51:47.709102+0000 mon.a (mon.0) 676 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T08:51:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: audit 2024-09-17T08:51:47.709437+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T08:51:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: cluster 2024-09-17T08:51:47.710240+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-17T08:51:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: audit 2024-09-17T08:51:47.717080+0000 mon.c (mon.2) 20 : audit [INF] from='client.? 172.21.15.78:0/2867000391' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: audit 2024-09-17T08:51:47.718037+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: audit 2024-09-17T08:51:47.719069+0000 mon.c (mon.2) 21 : audit [INF] from='client.? 172.21.15.78:0/1085750018' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: audit 2024-09-17T08:51:47.719876+0000 mon.a (mon.0) 680 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T08:51:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:48 smithi078 bash[32124]: cluster 2024-09-17T08:51:48.212920+0000 mgr.y (mgr.14150) 349 : cluster [DBG] pgmap v337: 132 pgs: 30 creating+peering, 74 active+clean, 28 unknown; 578 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:51:49.886 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:48.724466+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:48.724686+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: cluster 2024-09-17T08:51:48.724863+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:48.955856+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:48.967040+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:48.975749+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:49.024981+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:49.026904+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:49.027701+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:49.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: cephadm 2024-09-17T08:51:49.032106+0000 mgr.y (mgr.14150) 350 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-17T08:51:49.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:49 smithi136 bash[24812]: audit 2024-09-17T08:51:49.256805+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:48.724466+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:48.724686+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: cluster 2024-09-17T08:51:48.724863+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:48.955856+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:48.967040+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:48.975749+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:49.024981+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:49.026904+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:49.027701+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: cephadm 2024-09-17T08:51:49.032106+0000 mgr.y (mgr.14150) 350 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[22670]: audit 2024-09-17T08:51:49.256805+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:48.724466+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:48.724686+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: cluster 2024-09-17T08:51:48.724863+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:48.955856+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:48.967040+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:48.975749+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:49.024981+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:49.026904+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:49.027701+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: cephadm 2024-09-17T08:51:49.032106+0000 mgr.y (mgr.14150) 350 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-17T08:51:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:49 smithi078 bash[32124]: audit 2024-09-17T08:51:49.256805+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:51:51.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:50 smithi136 bash[24812]: cluster 2024-09-17T08:51:50.214207+0000 mgr.y (mgr.14150) 351 : cluster [DBG] pgmap v339: 132 pgs: 19 creating+peering, 111 active+clean, 2 unknown; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 1.9 KiB/s wr, 71 op/s 2024-09-17T08:51:51.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:50 smithi078 bash[22670]: cluster 2024-09-17T08:51:50.214207+0000 mgr.y (mgr.14150) 351 : cluster [DBG] pgmap v339: 132 pgs: 19 creating+peering, 111 active+clean, 2 unknown; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 1.9 KiB/s wr, 71 op/s 2024-09-17T08:51:51.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:50 smithi078 bash[32124]: cluster 2024-09-17T08:51:50.214207+0000 mgr.y (mgr.14150) 351 : cluster [DBG] pgmap v339: 132 pgs: 19 creating+peering, 111 active+clean, 2 unknown; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 1.9 KiB/s wr, 71 op/s 2024-09-17T08:51:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:53 smithi136 bash[24812]: cluster 2024-09-17T08:51:52.215178+0000 mgr.y (mgr.14150) 352 : cluster [DBG] pgmap v340: 132 pgs: 14 creating+peering, 118 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-09-17T08:51:53.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:53 smithi136 bash[24812]: audit 2024-09-17T08:51:52.859248+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-17T08:51:53.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:53 smithi136 bash[24812]: audit 2024-09-17T08:51:52.860146+0000 mon.b (mon.1) 27 : audit [INF] from='client.? 172.21.15.136:0/4248672717' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-17T08:51:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:53 smithi078 bash[22670]: cluster 2024-09-17T08:51:52.215178+0000 mgr.y (mgr.14150) 352 : cluster [DBG] pgmap v340: 132 pgs: 14 creating+peering, 118 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-09-17T08:51:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:53 smithi078 bash[22670]: audit 2024-09-17T08:51:52.859248+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-17T08:51:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:53 smithi078 bash[22670]: audit 2024-09-17T08:51:52.860146+0000 mon.b (mon.1) 27 : audit [INF] from='client.? 172.21.15.136:0/4248672717' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-17T08:51:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:53 smithi078 bash[32124]: cluster 2024-09-17T08:51:52.215178+0000 mgr.y (mgr.14150) 352 : cluster [DBG] pgmap v340: 132 pgs: 14 creating+peering, 118 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-09-17T08:51:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:53 smithi078 bash[32124]: audit 2024-09-17T08:51:52.859248+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-17T08:51:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:53 smithi078 bash[32124]: audit 2024-09-17T08:51:52.860146+0000 mon.b (mon.1) 27 : audit [INF] from='client.? 172.21.15.136:0/4248672717' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-17T08:51:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:54 smithi136 bash[24812]: audit 2024-09-17T08:51:53.278455+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-17T08:51:54.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:54 smithi136 bash[24812]: cluster 2024-09-17T08:51:53.278728+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-17T08:51:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:54 smithi078 bash[22670]: audit 2024-09-17T08:51:53.278455+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-17T08:51:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:54 smithi078 bash[22670]: cluster 2024-09-17T08:51:53.278728+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-17T08:51:54.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:54 smithi078 bash[32124]: audit 2024-09-17T08:51:53.278455+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-17T08:51:54.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:54 smithi078 bash[32124]: cluster 2024-09-17T08:51:53.278728+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-17T08:51:55.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:55 smithi136 bash[24812]: cluster 2024-09-17T08:51:54.216099+0000 mgr.y (mgr.14150) 353 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 5.4 KiB/s wr, 173 op/s 2024-09-17T08:51:55.535 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:55 smithi136 bash[24812]: cluster 2024-09-17T08:51:54.282268+0000 mon.a (mon.0) 694 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T08:51:55.535 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:55 smithi136 bash[24812]: cluster 2024-09-17T08:51:54.282320+0000 mon.a (mon.0) 695 : cluster [INF] Cluster is now healthy 2024-09-17T08:51:55.535 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:55 smithi136 bash[24812]: cluster 2024-09-17T08:51:54.298127+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-17T08:51:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[22670]: cluster 2024-09-17T08:51:54.216099+0000 mgr.y (mgr.14150) 353 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 5.4 KiB/s wr, 173 op/s 2024-09-17T08:51:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[22670]: cluster 2024-09-17T08:51:54.282268+0000 mon.a (mon.0) 694 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T08:51:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[22670]: cluster 2024-09-17T08:51:54.282320+0000 mon.a (mon.0) 695 : cluster [INF] Cluster is now healthy 2024-09-17T08:51:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[22670]: cluster 2024-09-17T08:51:54.298127+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-17T08:51:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[32124]: cluster 2024-09-17T08:51:54.216099+0000 mgr.y (mgr.14150) 353 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 5.4 KiB/s wr, 173 op/s 2024-09-17T08:51:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[32124]: cluster 2024-09-17T08:51:54.282268+0000 mon.a (mon.0) 694 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T08:51:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[32124]: cluster 2024-09-17T08:51:54.282320+0000 mon.a (mon.0) 695 : cluster [INF] Cluster is now healthy 2024-09-17T08:51:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:55 smithi078 bash[32124]: cluster 2024-09-17T08:51:54.298127+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-17T08:51:56.025 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.136 --placement '1;smithi136=iscsi.a' 2024-09-17T08:51:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:56 smithi078 bash[22670]: cluster 2024-09-17T08:51:55.300113+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-17T08:51:56.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:56 smithi078 bash[32124]: cluster 2024-09-17T08:51:55.300113+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-17T08:51:56.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:56 smithi136 bash[24812]: cluster 2024-09-17T08:51:55.300113+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-17T08:51:57.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:57 smithi078 bash[22670]: cluster 2024-09-17T08:51:56.216931+0000 mgr.y (mgr.14150) 354 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-17T08:51:57.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:57 smithi078 bash[32124]: cluster 2024-09-17T08:51:56.216931+0000 mgr.y (mgr.14150) 354 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-17T08:51:57.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:57 smithi136 bash[24812]: cluster 2024-09-17T08:51:56.216931+0000 mgr.y (mgr.14150) 354 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-17T08:51:59.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:51:59 smithi078 bash[22670]: cluster 2024-09-17T08:51:58.218029+0000 mgr.y (mgr.14150) 355 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 4.7 KiB/s wr, 122 op/s 2024-09-17T08:51:59.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:51:59 smithi078 bash[32124]: cluster 2024-09-17T08:51:58.218029+0000 mgr.y (mgr.14150) 355 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 4.7 KiB/s wr, 122 op/s 2024-09-17T08:51:59.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:51:59 smithi136 bash[24812]: cluster 2024-09-17T08:51:58.218029+0000 mgr.y (mgr.14150) 355 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 4.7 KiB/s wr, 122 op/s 2024-09-17T08:52:00.771 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:52:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:01 smithi078 bash[22670]: cluster 2024-09-17T08:52:00.219149+0000 mgr.y (mgr.14150) 356 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 1.3 KiB/s wr, 28 op/s 2024-09-17T08:52:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:01 smithi078 bash[22670]: cluster 2024-09-17T08:52:00.543378+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-17T08:52:01.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:01 smithi078 bash[32124]: cluster 2024-09-17T08:52:00.219149+0000 mgr.y (mgr.14150) 356 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 1.3 KiB/s wr, 28 op/s 2024-09-17T08:52:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:01 smithi078 bash[32124]: cluster 2024-09-17T08:52:00.543378+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-17T08:52:01.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:01 smithi136 bash[24812]: cluster 2024-09-17T08:52:00.219149+0000 mgr.y (mgr.14150) 356 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 1.3 KiB/s wr, 28 op/s 2024-09-17T08:52:01.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:01 smithi136 bash[24812]: cluster 2024-09-17T08:52:00.543378+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-17T08:52:03.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:03 smithi136 bash[24812]: cluster 2024-09-17T08:52:02.219915+0000 mgr.y (mgr.14150) 357 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 258 B/s wr, 0 op/s 2024-09-17T08:52:03.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:03 smithi078 bash[22670]: cluster 2024-09-17T08:52:02.219915+0000 mgr.y (mgr.14150) 357 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 258 B/s wr, 0 op/s 2024-09-17T08:52:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:03 smithi078 bash[32124]: cluster 2024-09-17T08:52:02.219915+0000 mgr.y (mgr.14150) 357 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 258 B/s wr, 0 op/s 2024-09-17T08:52:03.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- 172.21.15.136:0/2131425097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80102050 msgr2=0x7f1a80102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:03.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/2131425097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80102050 0x7f1a80102450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009900 tx=0x7f1a7802a3f0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- 172.21.15.136:0/2131425097 shutdown_connections 2024-09-17T08:52:03.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/2131425097 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a80103c10 0x7f1a8010a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/2131425097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a80103250 0x7f1a801036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/2131425097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80102050 0x7f1a80102450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- 172.21.15.136:0/2131425097 >> 172.21.15.136:0/2131425097 conn(0x7f1a800fd7e0 msgr2=0x7f1a800ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:03.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- 172.21.15.136:0/2131425097 shutdown_connections 2024-09-17T08:52:03.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- 172.21.15.136:0/2131425097 wait complete. 2024-09-17T08:52:03.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 Processor -- start 2024-09-17T08:52:03.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- start start 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a80102050 0x7f1a80197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80103250 0x7f1a80197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a80103c10 0x7f1a8019ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8019ef50 con 0x7f1a80103c10 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8019f0c0 con 0x7f1a80103250 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a84fc5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8019f280 con 0x7f1a80102050 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a7dd9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80103250 0x7f1a80197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a7dd9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80103250 0x7f1a80197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45702/0 (socket says 172.21.15.136:45702) 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.729+0000 7f1a7dd9b640 1 -- 172.21.15.136:0/4188203322 learned_addr learned my addr 172.21.15.136:0/4188203322 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7e59c640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a80102050 0x7f1a80197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7ed9d640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a80103c10 0x7f1a8019ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:03.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7dd9b640 1 -- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a80102050 msgr2=0x7f1a80197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7dd9b640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a80102050 0x7f1a80197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7dd9b640 1 -- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a80103c10 msgr2=0x7f1a8019ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7dd9b640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a80103c10 0x7f1a8019ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7dd9b640 1 -- 172.21.15.136:0/4188203322 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78009560 con 0x7f1a80103250 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7dd9b640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80103250 0x7f1a80197990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c890 tx=0x7f1a7400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a6f7fe640 1 -- 172.21.15.136:0/4188203322 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74004220 con 0x7f1a80103250 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8019f560 con 0x7f1a80103250 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a6f7fe640 1 -- 172.21.15.136:0/4188203322 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1a74007e00 con 0x7f1a80103250 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a6f7fe640 1 -- 172.21.15.136:0/4188203322 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740047a0 con 0x7f1a80103250 2024-09-17T08:52:03.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8019fa60 con 0x7f1a80103250 2024-09-17T08:52:03.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a80102450 con 0x7f1a80103250 2024-09-17T08:52:03.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a6f7fe640 1 -- 172.21.15.136:0/4188203322 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 90763+0+0 (secure 0 0 0) 0x7f1a740079b0 con 0x7f1a80103250 2024-09-17T08:52:03.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a6f7fe640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f1a6806ce00 0x7f1a6806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:03.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a6f7fe640 1 -- 172.21.15.136:0/4188203322 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1a7408c4b0 con 0x7f1a80103250 2024-09-17T08:52:03.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.733+0000 7f1a7e59c640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f1a6806ce00 0x7f1a6806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:03.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.737+0000 7f1a7e59c640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f1a6806ce00 0x7f1a6806f2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a78005940 tx=0x7f1a780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:03.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.737+0000 7f1a6f7fe640 1 -- 172.21.15.136:0/4188203322 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1a740562a0 con 0x7f1a80103250 2024-09-17T08:52:03.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.925+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.136", "placement": "1;smithi136=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a800009a0 con 0x7f1a6806ce00 2024-09-17T08:52:03.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.941+0000 7f1a6f7fe640 1 -- 172.21.15.136:0/4188203322 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f1a800009a0 con 0x7f1a6806ce00 2024-09-17T08:52:03.942 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled iscsi.datapool update... 2024-09-17T08:52:03.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f1a6806ce00 msgr2=0x7f1a6806f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f1a6806ce00 0x7f1a6806f2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a78005940 tx=0x7f1a780058d0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80103250 msgr2=0x7f1a80197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80103250 0x7f1a80197990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c890 tx=0x7f1a7400cd50 comp rx=0 tx=0).stop 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 shutdown_connections 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f1a6806ce00 0x7f1a6806f2c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a80103c10 0x7f1a8019ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a80103250 0x7f1a80197990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 --2- 172.21.15.136:0/4188203322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a80102050 0x7f1a80197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 >> 172.21.15.136:0/4188203322 conn(0x7f1a800fd7e0 msgr2=0x7f1a800ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 shutdown_connections 2024-09-17T08:52:03.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:03.945+0000 7f1a84fc5640 1 -- 172.21.15.136:0/4188203322 wait complete. 2024-09-17T08:52:04.805 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-09-17T08:52:04.805 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:52:04.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-17T08:52:04.820 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:52:04.821 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-17T08:52:04.835 DEBUG:teuthology.orchestra.run.smithi136:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@iscsi.iscsi.a.service 2024-09-17T08:52:04.881 INFO:tasks.cephadm:Adding prometheus.a on smithi136 2024-09-17T08:52:04.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply prometheus '1;smithi136=a' 2024-09-17T08:52:05.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.930776+0000 mgr.y (mgr.14150) 358 : audit [DBG] from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.136", "placement": "1;smithi136=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:05.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: cephadm 2024-09-17T08:52:03.936402+0000 mgr.y (mgr.14150) 359 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi136=iscsi.a;count:1 2024-09-17T08:52:05.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.943906+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:05.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.945784+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:05.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.949549+0000 mon.a (mon.0) 701 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:05.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.951380+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:05.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.962438+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:05.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.969085+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T08:52:05.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.976544+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-17T08:52:05.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: audit 2024-09-17T08:52:03.996810+0000 mon.a (mon.0) 706 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:05.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: cephadm 2024-09-17T08:52:03.999004+0000 mgr.y (mgr.14150) 360 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi136 2024-09-17T08:52:05.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[22670]: cluster 2024-09-17T08:52:04.221108+0000 mgr.y (mgr.14150) 361 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 229 B/s wr, 0 op/s 2024-09-17T08:52:05.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.930776+0000 mgr.y (mgr.14150) 358 : audit [DBG] from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.136", "placement": "1;smithi136=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:05.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: cephadm 2024-09-17T08:52:03.936402+0000 mgr.y (mgr.14150) 359 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi136=iscsi.a;count:1 2024-09-17T08:52:05.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.943906+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:05.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.945784+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:05.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.949549+0000 mon.a (mon.0) 701 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:05.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.951380+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:05.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.962438+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:05.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.969085+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T08:52:05.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.976544+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-17T08:52:05.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: audit 2024-09-17T08:52:03.996810+0000 mon.a (mon.0) 706 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:05.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: cephadm 2024-09-17T08:52:03.999004+0000 mgr.y (mgr.14150) 360 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi136 2024-09-17T08:52:05.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:04 smithi078 bash[32124]: cluster 2024-09-17T08:52:04.221108+0000 mgr.y (mgr.14150) 361 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 229 B/s wr, 0 op/s 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.930776+0000 mgr.y (mgr.14150) 358 : audit [DBG] from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.136", "placement": "1;smithi136=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: cephadm 2024-09-17T08:52:03.936402+0000 mgr.y (mgr.14150) 359 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi136=iscsi.a;count:1 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.943906+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.945784+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.949549+0000 mon.a (mon.0) 701 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.951380+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.962438+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.969085+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T08:52:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.976544+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-17T08:52:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: audit 2024-09-17T08:52:03.996810+0000 mon.a (mon.0) 706 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: cephadm 2024-09-17T08:52:03.999004+0000 mgr.y (mgr.14150) 360 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi136 2024-09-17T08:52:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:04 smithi136 bash[24812]: cluster 2024-09-17T08:52:04.221108+0000 mgr.y (mgr.14150) 361 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 229 B/s wr, 0 op/s 2024-09-17T08:52:06.695 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.695 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.695 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.696 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.696 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.696 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.697 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.697 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.963 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.964 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.964 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.965 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.965 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:06.965 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:07.276 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:06 smithi136 systemd[1]: Started Ceph iscsi.iscsi.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:52:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:07 smithi136 bash[24812]: cluster 2024-09-17T08:52:06.222177+0000 mgr.y (mgr.14150) 362 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:07 smithi136 bash[24812]: audit 2024-09-17T08:52:07.009001+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:07 smithi136 bash[24812]: audit 2024-09-17T08:52:07.018911+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:07 smithi136 bash[24812]: audit 2024-09-17T08:52:07.027466+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:07 smithi136 bash[24812]: audit 2024-09-17T08:52:07.042158+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:07 smithi136 bash[24812]: audit 2024-09-17T08:52:07.073619+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[22670]: cluster 2024-09-17T08:52:06.222177+0000 mgr.y (mgr.14150) 362 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[22670]: audit 2024-09-17T08:52:07.009001+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[22670]: audit 2024-09-17T08:52:07.018911+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[22670]: audit 2024-09-17T08:52:07.027466+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[22670]: audit 2024-09-17T08:52:07.042158+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[22670]: audit 2024-09-17T08:52:07.073619+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[32124]: cluster 2024-09-17T08:52:06.222177+0000 mgr.y (mgr.14150) 362 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[32124]: audit 2024-09-17T08:52:07.009001+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[32124]: audit 2024-09-17T08:52:07.018911+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[32124]: audit 2024-09-17T08:52:07.027466+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[32124]: audit 2024-09-17T08:52:07.042158+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:07 smithi078 bash[32124]: audit 2024-09-17T08:52:07.073619+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:08 smithi136 bash[24812]: cephadm 2024-09-17T08:52:07.029037+0000 mgr.y (mgr.14150) 363 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-17T08:52:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:08 smithi078 bash[32124]: cephadm 2024-09-17T08:52:07.029037+0000 mgr.y (mgr.14150) 363 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-17T08:52:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:08 smithi078 bash[22670]: cephadm 2024-09-17T08:52:07.029037+0000 mgr.y (mgr.14150) 363 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-17T08:52:09.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:08 smithi136 bash[49380]: log file path now is '/var/log/tcmu-runner.log' 2024-09-17T08:52:09.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[24812]: cluster 2024-09-17T08:52:08.223294+0000 mgr.y (mgr.14150) 364 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:09.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[24812]: cluster 2024-09-17T08:52:08.304561+0000 mon.a (mon.0) 712 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-17T08:52:09.291 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: debug Started the configuration object watcher 2024-09-17T08:52:09.292 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: debug Checking for config object changes every 1s 2024-09-17T08:52:09.292 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: debug Processing osd blocklist entries for this node 2024-09-17T08:52:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:09 smithi078 bash[22670]: cluster 2024-09-17T08:52:08.223294+0000 mgr.y (mgr.14150) 364 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:09 smithi078 bash[22670]: cluster 2024-09-17T08:52:08.304561+0000 mon.a (mon.0) 712 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-17T08:52:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:09 smithi078 bash[32124]: cluster 2024-09-17T08:52:08.223294+0000 mgr.y (mgr.14150) 364 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:09 smithi078 bash[32124]: cluster 2024-09-17T08:52:08.304561+0000 mon.a (mon.0) 712 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-17T08:52:09.791 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: debug Reading the configuration object to update local LIO configuration 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: debug Configuration does not have an entry for this host(smithi136.front.sepia.ceph.com) - nothing to define to LIO 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: * Serving Flask app 'rbd-target-api' (lazy loading) 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: * Environment: production 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: Use a production WSGI server instead. 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: * Debug mode: off 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: debug * Running on all addresses. 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: * Running on all addresses. 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: debug * Running on http://[fe80::ec4:7aff:fe88:6e43]:5000/ (Press CTRL+C to quit) 2024-09-17T08:52:09.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:09 smithi136 bash[49406]: * Running on http://[fe80::ec4:7aff:fe88:6e43]:5000/ (Press CTRL+C to quit) 2024-09-17T08:52:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:10 smithi136 bash[24812]: audit 2024-09-17T08:52:09.320633+0000 mon.b (mon.1) 28 : audit [DBG] from='client.? 172.21.15.136:0/3841997258' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T08:52:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:10 smithi136 bash[24812]: audit 2024-09-17T08:52:09.437031+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:10 smithi078 bash[22670]: audit 2024-09-17T08:52:09.320633+0000 mon.b (mon.1) 28 : audit [DBG] from='client.? 172.21.15.136:0/3841997258' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T08:52:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:10 smithi078 bash[22670]: audit 2024-09-17T08:52:09.437031+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:10 smithi078 bash[32124]: audit 2024-09-17T08:52:09.320633+0000 mon.b (mon.1) 28 : audit [DBG] from='client.? 172.21.15.136:0/3841997258' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T08:52:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:10 smithi078 bash[32124]: audit 2024-09-17T08:52:09.437031+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:10.626 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:52:11.704 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:11 smithi136 bash[24812]: cluster 2024-09-17T08:52:10.224393+0000 mgr.y (mgr.14150) 365 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:11.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:11 smithi078 bash[22670]: cluster 2024-09-17T08:52:10.224393+0000 mgr.y (mgr.14150) 365 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:11.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:11 smithi078 bash[32124]: cluster 2024-09-17T08:52:10.224393+0000 mgr.y (mgr.14150) 365 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:13.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 -- 172.21.15.136:0/1817043229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 msgr2=0x7f63fc102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:13.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 --2- 172.21.15.136:0/1817043229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc102cd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009900 tx=0x7f63f802a410 comp rx=0 tx=0).stop 2024-09-17T08:52:13.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 -- 172.21.15.136:0/1817043229 shutdown_connections 2024-09-17T08:52:13.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 --2- 172.21.15.136:0/1817043229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63fc105b40 0x7f63fc107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 --2- 172.21.15.136:0/1817043229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63fc103210 0x7f63fc105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 --2- 172.21.15.136:0/1817043229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc102cd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 -- 172.21.15.136:0/1817043229 >> 172.21.15.136:0/1817043229 conn(0x7f63fc0fa520 msgr2=0x7f63fc0fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 -- 172.21.15.136:0/1817043229 shutdown_connections 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 -- 172.21.15.136:0/1817043229 wait complete. 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 Processor -- start 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 -- start start 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.601+0000 7f640363d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc100240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63fc103210 0x7f63fc0fe890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63fc105b40 0x7f63fc0fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0ff560 con 0x7f63fc103210 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0ff6d0 con 0x7f63fc1008e0 2024-09-17T08:52:13.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc19f3a0 con 0x7f63fc105b40 2024-09-17T08:52:13.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc100240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:13.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc100240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53162/0 (socket says 172.21.15.136:53162) 2024-09-17T08:52:13.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 -- 172.21.15.136:0/2055607019 learned_addr learned my addr 172.21.15.136:0/2055607019 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:52:13.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f6400bd8640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63fc103210 0x7f63fc0fe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:13.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f6401bda640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63fc105b40 0x7f63fc0fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:13.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 -- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63fc105b40 msgr2=0x7f63fc0fedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:13.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63fc105b40 0x7f63fc0fedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 -- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63fc103210 msgr2=0x7f63fc0fe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63fc103210 0x7f63fc0fe890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 -- 172.21.15.136:0/2055607019 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8009560 con 0x7f63fc1008e0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f6401bda640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63fc105b40 0x7f63fc0fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f6400bd8640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63fc103210 0x7f63fc0fe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f64013d9640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc100240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63f802aa00 tx=0x7f63f8004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f63f27fc640 1 -- 172.21.15.136:0/2055607019 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8031ca0 con 0x7f63fc1008e0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc19f5f0 con 0x7f63fc1008e0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f63f27fc640 1 -- 172.21.15.136:0/2055607019 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f63f8031e00 con 0x7f63fc1008e0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f63f27fc640 1 -- 172.21.15.136:0/2055607019 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8003a70 con 0x7f63fc1008e0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc19fb10 con 0x7f63fc1008e0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc1035f0 con 0x7f63fc1008e0 2024-09-17T08:52:13.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f63f27fc640 1 -- 172.21.15.136:0/2055607019 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 90814+0+0 (secure 0 0 0) 0x7f63f8003bd0 con 0x7f63fc1008e0 2024-09-17T08:52:13.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f63f27fc640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f63e806ce70 0x7f63e806f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:13.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f63f27fc640 1 -- 172.21.15.136:0/2055607019 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f63f80adae0 con 0x7f63fc1008e0 2024-09-17T08:52:13.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.605+0000 7f6400bd8640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f63e806ce70 0x7f63e806f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:13.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.609+0000 7f6400bd8640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f63e806ce70 0x7f63e806f330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0fffc0 tx=0x7f63ec005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:13.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.609+0000 7f63f27fc640 1 -- 172.21.15.136:0/2055607019 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f63f8077720 con 0x7f63fc1008e0 2024-09-17T08:52:13.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.785+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f63fc10ae50 con 0x7f63e806ce70 2024-09-17T08:52:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:13 smithi136 bash[24812]: cluster 2024-09-17T08:52:12.225310+0000 mgr.y (mgr.14150) 366 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:13 smithi136 bash[24812]: audit 2024-09-17T08:52:13.384149+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:13 smithi136 bash[24812]: audit 2024-09-17T08:52:13.394824+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:13 smithi136 bash[24812]: audit 2024-09-17T08:52:13.397053+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:13 smithi136 bash[24812]: audit 2024-09-17T08:52:13.399003+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:13 smithi136 bash[24812]: audit 2024-09-17T08:52:13.408721+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.797+0000 7f63f27fc640 1 -- 172.21.15.136:0/2055607019 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f63fc10ae50 con 0x7f63e806ce70 2024-09-17T08:52:13.799 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled prometheus update... 2024-09-17T08:52:13.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f63e806ce70 msgr2=0x7f63e806f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:13.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f63e806ce70 0x7f63e806f330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0fffc0 tx=0x7f63ec005d30 comp rx=0 tx=0).stop 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 msgr2=0x7f63fc100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc100240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63f802aa00 tx=0x7f63f8004430 comp rx=0 tx=0).stop 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 shutdown_connections 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f63e806ce70 0x7f63e806f330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63fc105b40 0x7f63fc0fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63fc103210 0x7f63fc0fe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 --2- 172.21.15.136:0/2055607019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63fc1008e0 0x7f63fc100240 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 >> 172.21.15.136:0/2055607019 conn(0x7f63fc0fa520 msgr2=0x7f63fc1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 shutdown_connections 2024-09-17T08:52:13.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:13.801+0000 7f640363d640 1 -- 172.21.15.136:0/2055607019 wait complete. 2024-09-17T08:52:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[32124]: cluster 2024-09-17T08:52:12.225310+0000 mgr.y (mgr.14150) 366 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[32124]: audit 2024-09-17T08:52:13.384149+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[32124]: audit 2024-09-17T08:52:13.394824+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[32124]: audit 2024-09-17T08:52:13.397053+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[32124]: audit 2024-09-17T08:52:13.399003+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[32124]: audit 2024-09-17T08:52:13.408721+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[22670]: cluster 2024-09-17T08:52:12.225310+0000 mgr.y (mgr.14150) 366 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[22670]: audit 2024-09-17T08:52:13.384149+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[22670]: audit 2024-09-17T08:52:13.394824+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[22670]: audit 2024-09-17T08:52:13.397053+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[22670]: audit 2024-09-17T08:52:13.399003+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:13 smithi078 bash[22670]: audit 2024-09-17T08:52:13.408721+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.405 DEBUG:teuthology.orchestra.run.smithi136:prometheus.a> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@prometheus.a.service 2024-09-17T08:52:14.407 INFO:tasks.cephadm:Adding node-exporter.a on smithi078 2024-09-17T08:52:14.407 INFO:tasks.cephadm:Adding node-exporter.b on smithi136 2024-09-17T08:52:14.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply node-exporter '2;smithi078=a;smithi136=b' 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.498470+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.499265+0000 mgr.y (mgr.14150) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: cephadm 2024-09-17T08:52:13.500929+0000 mgr.y (mgr.14150) 368 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.136:5000 to Dashboard 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.501304+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.511114+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.522620+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi136"}]: dispatch 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.531182+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.535181+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:14.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.537990+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:14.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.539528+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:14.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.547837+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.801073+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.802809+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:14.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.806148+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:14.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.807913+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:14.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:14 smithi136 bash[24812]: audit 2024-09-17T08:52:13.818113+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.498470+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T08:52:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.499265+0000 mgr.y (mgr.14150) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: cephadm 2024-09-17T08:52:13.500929+0000 mgr.y (mgr.14150) 368 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.136:5000 to Dashboard 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.501304+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.511114+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.522620+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi136"}]: dispatch 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.531182+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.535181+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.537990+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.539528+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.547837+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.801073+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.802809+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.806148+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.807913+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[22670]: audit 2024-09-17T08:52:13.818113+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.498470+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.499265+0000 mgr.y (mgr.14150) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: cephadm 2024-09-17T08:52:13.500929+0000 mgr.y (mgr.14150) 368 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.136:5000 to Dashboard 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.501304+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.511114+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.522620+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi136"}]: dispatch 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.531182+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.535181+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.537990+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.539528+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.547837+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.801073+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.802809+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.806148+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.807913+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:14.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:14 smithi078 bash[32124]: audit 2024-09-17T08:52:13.818113+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:15 smithi136 bash[24812]: audit 2024-09-17T08:52:13.501820+0000 mgr.y (mgr.14150) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T08:52:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:15 smithi136 bash[24812]: audit 2024-09-17T08:52:13.523563+0000 mgr.y (mgr.14150) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi136"}]: dispatch 2024-09-17T08:52:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:15 smithi136 bash[24812]: audit 2024-09-17T08:52:13.791046+0000 mgr.y (mgr.14150) 371 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:15 smithi136 bash[24812]: cephadm 2024-09-17T08:52:13.793970+0000 mgr.y (mgr.14150) 372 : cephadm [INF] Saving service prometheus spec with placement smithi136=a;count:1 2024-09-17T08:52:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:15 smithi136 bash[24812]: cephadm 2024-09-17T08:52:14.115283+0000 mgr.y (mgr.14150) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi136 2024-09-17T08:52:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:15 smithi136 bash[24812]: cluster 2024-09-17T08:52:14.226374+0000 mgr.y (mgr.14150) 374 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[32124]: audit 2024-09-17T08:52:13.501820+0000 mgr.y (mgr.14150) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T08:52:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[32124]: audit 2024-09-17T08:52:13.523563+0000 mgr.y (mgr.14150) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi136"}]: dispatch 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[32124]: audit 2024-09-17T08:52:13.791046+0000 mgr.y (mgr.14150) 371 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[32124]: cephadm 2024-09-17T08:52:13.793970+0000 mgr.y (mgr.14150) 372 : cephadm [INF] Saving service prometheus spec with placement smithi136=a;count:1 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[32124]: cephadm 2024-09-17T08:52:14.115283+0000 mgr.y (mgr.14150) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi136 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[32124]: cluster 2024-09-17T08:52:14.226374+0000 mgr.y (mgr.14150) 374 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[22670]: audit 2024-09-17T08:52:13.501820+0000 mgr.y (mgr.14150) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[22670]: audit 2024-09-17T08:52:13.523563+0000 mgr.y (mgr.14150) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi136"}]: dispatch 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[22670]: audit 2024-09-17T08:52:13.791046+0000 mgr.y (mgr.14150) 371 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[22670]: cephadm 2024-09-17T08:52:13.793970+0000 mgr.y (mgr.14150) 372 : cephadm [INF] Saving service prometheus spec with placement smithi136=a;count:1 2024-09-17T08:52:15.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[22670]: cephadm 2024-09-17T08:52:14.115283+0000 mgr.y (mgr.14150) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi136 2024-09-17T08:52:15.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:15 smithi078 bash[22670]: cluster 2024-09-17T08:52:14.226374+0000 mgr.y (mgr.14150) 374 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:17.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:17 smithi136 bash[24812]: cluster 2024-09-17T08:52:16.227444+0000 mgr.y (mgr.14150) 375 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:17 smithi078 bash[22670]: cluster 2024-09-17T08:52:16.227444+0000 mgr.y (mgr.14150) 375 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:17 smithi078 bash[32124]: cluster 2024-09-17T08:52:16.227444+0000 mgr.y (mgr.14150) 375 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:19.147 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:52:19.314 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:52:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:19 smithi136 bash[24812]: cluster 2024-09-17T08:52:18.228504+0000 mgr.y (mgr.14150) 376 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:19 smithi078 bash[22670]: cluster 2024-09-17T08:52:18.228504+0000 mgr.y (mgr.14150) 376 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:19 smithi078 bash[32124]: cluster 2024-09-17T08:52:18.228504+0000 mgr.y (mgr.14150) 376 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:20 smithi136 bash[24812]: audit 2024-09-17T08:52:19.062230+0000 mgr.y (mgr.14150) 377 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:20 smithi078 bash[22670]: audit 2024-09-17T08:52:19.062230+0000 mgr.y (mgr.14150) 377 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:20 smithi078 bash[32124]: audit 2024-09-17T08:52:19.062230+0000 mgr.y (mgr.14150) 377 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:21 smithi136 bash[24812]: cluster 2024-09-17T08:52:20.229706+0000 mgr.y (mgr.14150) 378 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:21.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:21 smithi078 bash[32124]: cluster 2024-09-17T08:52:20.229706+0000 mgr.y (mgr.14150) 378 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:21.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:21 smithi078 bash[22670]: cluster 2024-09-17T08:52:20.229706+0000 mgr.y (mgr.14150) 378 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:23 smithi136 bash[24812]: cluster 2024-09-17T08:52:22.230817+0000 mgr.y (mgr.14150) 379 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:23.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:23 smithi078 bash[22670]: cluster 2024-09-17T08:52:22.230817+0000 mgr.y (mgr.14150) 379 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:23.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:23 smithi078 bash[32124]: cluster 2024-09-17T08:52:22.230817+0000 mgr.y (mgr.14150) 379 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 -- 172.21.15.136:0/2670242214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 msgr2=0x7f69a4100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 --2- 172.21.15.136:0/2670242214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4100250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6994009900 tx=0x7f699402a410 comp rx=0 tx=0).stop 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 -- 172.21.15.136:0/2670242214 shutdown_connections 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 --2- 172.21.15.136:0/2670242214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a4101970 0x7f69a4108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 --2- 172.21.15.136:0/2670242214 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4100fb0 0x7f69a4101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 --2- 172.21.15.136:0/2670242214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4100250 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 -- 172.21.15.136:0/2670242214 >> 172.21.15.136:0/2670242214 conn(0x7f69a40fb620 msgr2=0x7f69a40fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 -- 172.21.15.136:0/2670242214 shutdown_connections 2024-09-17T08:52:25.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.565+0000 7f69aab33640 1 -- 172.21.15.136:0/2670242214 wait complete. 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 Processor -- start 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 -- start start 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4195220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a4100fb0 0x7f69a4195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4101970 0x7f69a419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a419cd20 con 0x7f69a4100fb0 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a419ce90 con 0x7f69a40ffe50 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a419d050 con 0x7f69a4101970 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4195220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4195220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:52666/0 (socket says 172.21.15.136:52666) 2024-09-17T08:52:25.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 -- 172.21.15.136:0/245176141 learned_addr learned my addr 172.21.15.136:0/245176141 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a3fff640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a4100fb0 0x7f69a4195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a90d0640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4101970 0x7f69a419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 -- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4101970 msgr2=0x7f69a419c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4101970 0x7f69a419c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 -- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a4100fb0 msgr2=0x7f69a4195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a4100fb0 0x7f69a4195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 -- 172.21.15.136:0/245176141 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994009560 con 0x7f69a40ffe50 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a3fff640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a4100fb0 0x7f69a4195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a88cf640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4195220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6994005940 tx=0x7f6994004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:25.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a1ffb640 1 -- 172.21.15.136:0/245176141 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994031ca0 con 0x7f69a40ffe50 2024-09-17T08:52:25.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a419d2d0 con 0x7f69a40ffe50 2024-09-17T08:52:25.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a1ffb640 1 -- 172.21.15.136:0/245176141 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f6994031e00 con 0x7f69a40ffe50 2024-09-17T08:52:25.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a1ffb640 1 -- 172.21.15.136:0/245176141 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994003a60 con 0x7f69a40ffe50 2024-09-17T08:52:25.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a419d7c0 con 0x7f69a40ffe50 2024-09-17T08:52:25.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a4100250 con 0x7f69a40ffe50 2024-09-17T08:52:25.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a1ffb640 1 -- 172.21.15.136:0/245176141 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 90814+0+0 (secure 0 0 0) 0x7f6994003bc0 con 0x7f69a40ffe50 2024-09-17T08:52:25.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a1ffb640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f698c06ce90 0x7f698c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:25.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.569+0000 7f69a1ffb640 1 -- 172.21.15.136:0/245176141 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f69940adaf0 con 0x7f69a40ffe50 2024-09-17T08:52:25.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.573+0000 7f69a3fff640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f698c06ce90 0x7f698c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:25.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.573+0000 7f69a3fff640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f698c06ce90 0x7f698c06f350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69a4196740 tx=0x7f699800a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:25.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.577+0000 7f69a1ffb640 1 -- 172.21.15.136:0/245176141 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6994077730 con 0x7f69a40ffe50 2024-09-17T08:52:25.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.765+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi078=a;smithi136=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f69a410ae50 con 0x7f698c06ce90 2024-09-17T08:52:25.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69a1ffb640 1 -- 172.21.15.136:0/245176141 <== mgr.14150 v2:172.21.15.78:6800/2295189925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f69a410ae50 con 0x7f698c06ce90 2024-09-17T08:52:25.785 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled node-exporter update... 2024-09-17T08:52:25.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f698c06ce90 msgr2=0x7f698c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:25.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f698c06ce90 0x7f698c06f350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69a4196740 tx=0x7f699800a560 comp rx=0 tx=0).stop 2024-09-17T08:52:25.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 msgr2=0x7f69a4195220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:25.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4195220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6994005940 tx=0x7f6994004430 comp rx=0 tx=0).stop 2024-09-17T08:52:25.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 shutdown_connections 2024-09-17T08:52:25.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f698c06ce90 0x7f698c06f350 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4101970 0x7f69a419c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a4100fb0 0x7f69a4195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 --2- 172.21.15.136:0/245176141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69a40ffe50 0x7f69a4195220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:25.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 >> 172.21.15.136:0/245176141 conn(0x7f69a40fb620 msgr2=0x7f69a40fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:25.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.785+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 shutdown_connections 2024-09-17T08:52:25.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:25.789+0000 7f69aab33640 1 -- 172.21.15.136:0/245176141 wait complete. 2024-09-17T08:52:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:25 smithi136 bash[24812]: cluster 2024-09-17T08:52:24.232055+0000 mgr.y (mgr.14150) 380 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:25.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:25 smithi078 bash[22670]: cluster 2024-09-17T08:52:24.232055+0000 mgr.y (mgr.14150) 380 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:25.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:25 smithi078 bash[32124]: cluster 2024-09-17T08:52:24.232055+0000 mgr.y (mgr.14150) 380 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-17T08:52:26.641 DEBUG:teuthology.orchestra.run.smithi078:node-exporter.a> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@node-exporter.a.service 2024-09-17T08:52:26.644 DEBUG:teuthology.orchestra.run.smithi136:node-exporter.b> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@node-exporter.b.service 2024-09-17T08:52:26.646 INFO:tasks.cephadm:Adding alertmanager.a on smithi078 2024-09-17T08:52:26.646 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply alertmanager '1;smithi078=a' 2024-09-17T08:52:26.959 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:26 smithi136 bash[24812]: audit 2024-09-17T08:52:25.772336+0000 mgr.y (mgr.14150) 381 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi078=a;smithi136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:26.959 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:26 smithi136 bash[24812]: cephadm 2024-09-17T08:52:25.775538+0000 mgr.y (mgr.14150) 382 : cephadm [INF] Saving service node-exporter spec with placement smithi078=a;smithi136=b;count:2 2024-09-17T08:52:26.959 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:26 smithi136 bash[24812]: audit 2024-09-17T08:52:25.786777+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:26.959 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:26 smithi136 bash[24812]: cluster 2024-09-17T08:52:26.233122+0000 mgr.y (mgr.14150) 383 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:52:27.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[22670]: audit 2024-09-17T08:52:25.772336+0000 mgr.y (mgr.14150) 381 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi078=a;smithi136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:27.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[22670]: cephadm 2024-09-17T08:52:25.775538+0000 mgr.y (mgr.14150) 382 : cephadm [INF] Saving service node-exporter spec with placement smithi078=a;smithi136=b;count:2 2024-09-17T08:52:27.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[22670]: audit 2024-09-17T08:52:25.786777+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:27.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[22670]: cluster 2024-09-17T08:52:26.233122+0000 mgr.y (mgr.14150) 383 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:52:27.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[32124]: audit 2024-09-17T08:52:25.772336+0000 mgr.y (mgr.14150) 381 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi078=a;smithi136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:27.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[32124]: cephadm 2024-09-17T08:52:25.775538+0000 mgr.y (mgr.14150) 382 : cephadm [INF] Saving service node-exporter spec with placement smithi078=a;smithi136=b;count:2 2024-09-17T08:52:27.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[32124]: audit 2024-09-17T08:52:25.786777+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:27.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:26 smithi078 bash[32124]: cluster 2024-09-17T08:52:26.233122+0000 mgr.y (mgr.14150) 383 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:52:28.525 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:28 smithi136 bash[24812]: audit 2024-09-17T08:52:28.130265+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-09-17T08:52:28.525 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:28 smithi136 bash[24812]: audit 2024-09-17T08:52:28.130965+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.525 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:28 smithi136 bash[24812]: audit 2024-09-17T08:52:28.131336+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.525 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:28 smithi136 bash[24812]: audit 2024-09-17T08:52:28.131694+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[22670]: audit 2024-09-17T08:52:28.130265+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[22670]: audit 2024-09-17T08:52:28.130965+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[22670]: audit 2024-09-17T08:52:28.131336+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[22670]: audit 2024-09-17T08:52:28.131694+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[32124]: audit 2024-09-17T08:52:28.130265+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[32124]: audit 2024-09-17T08:52:28.130965+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[32124]: audit 2024-09-17T08:52:28.131336+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-09-17T08:52:28.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:28 smithi078 bash[32124]: audit 2024-09-17T08:52:28.131694+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T08:52:29.211 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:52:29.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[24812]: audit 2024-09-17T08:52:28.190346+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-09-17T08:52:29.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[24812]: audit 2024-09-17T08:52:28.190776+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2024-09-17T08:52:29.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[24812]: audit 2024-09-17T08:52:28.191048+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2024-09-17T08:52:29.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[24812]: audit 2024-09-17T08:52:28.191250+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-17T08:52:29.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[24812]: cluster 2024-09-17T08:52:28.191427+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-17T08:52:29.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[24812]: cluster 2024-09-17T08:52:28.233784+0000 mgr.y (mgr.14150) 384 : cluster [DBG] pgmap v363: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:52:29.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 bash[24812]: cluster 2024-09-17T08:52:29.193491+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-17T08:52:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[22670]: audit 2024-09-17T08:52:28.190346+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-09-17T08:52:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[22670]: audit 2024-09-17T08:52:28.190776+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2024-09-17T08:52:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[22670]: audit 2024-09-17T08:52:28.191048+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2024-09-17T08:52:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[22670]: audit 2024-09-17T08:52:28.191250+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-17T08:52:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[22670]: cluster 2024-09-17T08:52:28.191427+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-17T08:52:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[22670]: cluster 2024-09-17T08:52:28.233784+0000 mgr.y (mgr.14150) 384 : cluster [DBG] pgmap v363: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:52:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[22670]: cluster 2024-09-17T08:52:29.193491+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-17T08:52:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[32124]: audit 2024-09-17T08:52:28.190346+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-09-17T08:52:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[32124]: audit 2024-09-17T08:52:28.190776+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2024-09-17T08:52:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[32124]: audit 2024-09-17T08:52:28.191048+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2024-09-17T08:52:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[32124]: audit 2024-09-17T08:52:28.191250+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-17T08:52:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[32124]: cluster 2024-09-17T08:52:28.191427+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-17T08:52:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[32124]: cluster 2024-09-17T08:52:28.233784+0000 mgr.y (mgr.14150) 384 : cluster [DBG] pgmap v363: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:52:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:29 smithi078 bash[32124]: cluster 2024-09-17T08:52:29.193491+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-17T08:52:29.737 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.737 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.738 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.738 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.738 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.739 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.739 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.739 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.739 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:29.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.041 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.042 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.042 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.042 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.043 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.043 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: Started Ceph prometheus.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:52:30.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:52:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[24812]: audit 2024-09-17T08:52:29.073638+0000 mgr.y (mgr.14150) 385 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[24812]: audit 2024-09-17T08:52:29.903916+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[24812]: audit 2024-09-17T08:52:29.915990+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[24812]: audit 2024-09-17T08:52:29.936821+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[24812]: audit 2024-09-17T08:52:29.942851+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T08:52:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[22670]: audit 2024-09-17T08:52:29.073638+0000 mgr.y (mgr.14150) 385 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[22670]: audit 2024-09-17T08:52:29.903916+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[22670]: audit 2024-09-17T08:52:29.915990+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[22670]: audit 2024-09-17T08:52:29.936821+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[22670]: audit 2024-09-17T08:52:29.942851+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T08:52:30.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[32124]: audit 2024-09-17T08:52:29.073638+0000 mgr.y (mgr.14150) 385 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:30.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[32124]: audit 2024-09-17T08:52:29.903916+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[32124]: audit 2024-09-17T08:52:29.915990+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[32124]: audit 2024-09-17T08:52:29.936821+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' 2024-09-17T08:52:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[32124]: audit 2024-09-17T08:52:29.942851+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T08:52:31.221 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:31 smithi078 bash[22670]: cluster 2024-09-17T08:52:30.234805+0000 mgr.y (mgr.14150) 386 : cluster [DBG] pgmap v365: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:52:31.221 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:31 smithi078 bash[22670]: audit 2024-09-17T08:52:30.948317+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T08:52:31.221 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:31 smithi078 bash[22670]: cluster 2024-09-17T08:52:30.948427+0000 mon.a (mon.0) 749 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-17T08:52:31.221 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[22923]: ignoring --setuser ceph since I am not root 2024-09-17T08:52:31.222 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:30 smithi078 bash[22923]: ignoring --setgroup ceph since I am not root 2024-09-17T08:52:31.222 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:31 smithi078 bash[22923]: debug 2024-09-17T08:52:31.104+0000 7ffbf0005040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T08:52:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[24812]: cluster 2024-09-17T08:52:30.234805+0000 mgr.y (mgr.14150) 386 : cluster [DBG] pgmap v365: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:52:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[24812]: audit 2024-09-17T08:52:30.948317+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T08:52:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[24812]: cluster 2024-09-17T08:52:30.948427+0000 mon.a (mon.0) 749 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-17T08:52:31.292 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[25711]: ignoring --setuser ceph since I am not root 2024-09-17T08:52:31.292 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[25711]: ignoring --setgroup ceph since I am not root 2024-09-17T08:52:31.292 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:30 smithi136 bash[25711]: debug 2024-09-17T08:52:30.993+0000 7ff2b5cb0640 1 -- 172.21.15.136:0/3947170036 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557883132d00 con 0x557883125400 2024-09-17T08:52:31.292 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[25711]: debug 2024-09-17T08:52:31.109+0000 7ff2b850b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T08:52:31.292 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.106Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-17T08:52:31.292 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.106Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-17T08:52:31.292 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.106Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi136 (none))" 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.106Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.106Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.107Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.108Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.110Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.110Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.112Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.112Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.727µs 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.112Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.112Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.112Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=22.498µs wal_replay_duration=263.776µs wbl_replay_duration=170ns total_replay_duration=307.631µs 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.113Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T08:52:31.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.113Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-17T08:52:31.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.113Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T08:52:31.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.114Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T08:52:31.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.114Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T08:52:31.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.114Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T08:52:31.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.140Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=27.033434ms db_storage=867ns remote_storage=1.394µs web_handler=335ns query_engine=766ns scrape=325.852µs scrape_sd=99.013µs notify=821ns notify_sd=1.494µs rules=26.135264ms tracing=6.932µs 2024-09-17T08:52:31.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.140Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-17T08:52:31.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:31 smithi136 bash[50523]: ts=2024-09-17T08:52:31.140Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-17T08:52:31.404 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:52:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:31 smithi078 bash[32124]: cluster 2024-09-17T08:52:30.234805+0000 mgr.y (mgr.14150) 386 : cluster [DBG] pgmap v365: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:52:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:31 smithi078 bash[32124]: audit 2024-09-17T08:52:30.948317+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14150 172.21.15.78:0/1530174103' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T08:52:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:31 smithi078 bash[32124]: cluster 2024-09-17T08:52:30.948427+0000 mon.a (mon.0) 749 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-17T08:52:32.587 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:32 smithi136 bash[25711]: debug 2024-09-17T08:52:32.325+0000 7ff2b850b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T08:52:32.587 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:32 smithi136 bash[25711]: debug 2024-09-17T08:52:32.393+0000 7ff2b850b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T08:52:32.587 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:32 smithi136 bash[25711]: debug 2024-09-17T08:52:32.549+0000 7ff2b850b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T08:52:32.602 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:32 smithi078 bash[22923]: debug 2024-09-17T08:52:32.284+0000 7ffbf0005040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T08:52:32.602 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:32 smithi078 bash[22923]: debug 2024-09-17T08:52:32.348+0000 7ffbf0005040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T08:52:32.602 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:32 smithi078 bash[22923]: debug 2024-09-17T08:52:32.500+0000 7ffbf0005040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T08:52:33.441 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.128+0000 7ffbf0005040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T08:52:33.442 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.192+0000 7ffbf0005040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T08:52:33.442 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.260+0000 7ffbf0005040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T08:52:33.512 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.189+0000 7ff2b850b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T08:52:33.512 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.261+0000 7ff2b850b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T08:52:33.512 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.329+0000 7ff2b850b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T08:52:33.512 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.513+0000 7ff2b850b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T08:52:33.791 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.589+0000 7ff2b850b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T08:52:33.791 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.657+0000 7ff2b850b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T08:52:33.837 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.440+0000 7ffbf0005040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T08:52:33.837 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.520+0000 7ffbf0005040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T08:52:33.837 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.584+0000 7ffbf0005040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T08:52:34.096 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.836+0000 7ffbf0005040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T08:52:34.096 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:33 smithi078 bash[22923]: debug 2024-09-17T08:52:33.904+0000 7ffbf0005040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T08:52:34.180 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.913+0000 7ff2b850b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T08:52:34.180 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:33 smithi136 bash[25711]: debug 2024-09-17T08:52:33.977+0000 7ff2b850b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T08:52:34.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- 172.21.15.136:0/1620193359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 msgr2=0x7f91a8107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:34.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 --2- 172.21.15.136:0/1620193359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 0x7f91a8107f80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009ca0 tx=0x7f91a002a8c0 comp rx=0 tx=0).stop 2024-09-17T08:52:34.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- 172.21.15.136:0/1620193359 shutdown_connections 2024-09-17T08:52:34.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 --2- 172.21.15.136:0/1620193359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 0x7f91a8107f80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:34.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 --2- 172.21.15.136:0/1620193359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a8103200 0x7f91a81055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:34.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 --2- 172.21.15.136:0/1620193359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91a81008d0 0x7f91a8102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:34.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- 172.21.15.136:0/1620193359 >> 172.21.15.136:0/1620193359 conn(0x7f91a80fa4d0 msgr2=0x7f91a80fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:34.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- 172.21.15.136:0/1620193359 shutdown_connections 2024-09-17T08:52:34.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- 172.21.15.136:0/1620193359 wait complete. 2024-09-17T08:52:34.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 Processor -- start 2024-09-17T08:52:34.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- start start 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91a81008d0 0x7f91a81001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a8103200 0x7f91a80fe880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 0x7f91a80fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a80ff4c0 con 0x7f91a8103200 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a80ff630 con 0x7f91a8105b30 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91afce7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a819f2d0 con 0x7f91a81008d0 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91ae284640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 0x7f91a80fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:34.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91ae284640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 0x7f91a80fedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:42392/0 (socket says 172.21.15.136:42392) 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.221+0000 7f91ae284640 1 -- 172.21.15.136:0/3294749933 learned_addr learned my addr 172.21.15.136:0/3294749933 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ad282640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a8103200 0x7f91a80fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ada83640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91a81008d0 0x7f91a81001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ae284640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91a81008d0 msgr2=0x7f91a81001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ae284640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91a81008d0 0x7f91a81001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ae284640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a8103200 msgr2=0x7f91a80fe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ae284640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a8103200 0x7f91a80fe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ae284640 1 -- 172.21.15.136:0/3294749933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0009900 con 0x7f91a8105b30 2024-09-17T08:52:34.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ad282640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a8103200 0x7f91a80fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:52:34.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ae284640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 0x7f91a80fedc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009dc0 tx=0x7f91a0003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:34.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0003d90 con 0x7f91a8105b30 2024-09-17T08:52:34.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f91a0040070 con 0x7f91a8105b30 2024-09-17T08:52:34.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0004590 con 0x7f91a8105b30 2024-09-17T08:52:34.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a819f4d0 con 0x7f91a8105b30 2024-09-17T08:52:34.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a819f950 con 0x7f91a8105b30 2024-09-17T08:52:34.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) v1 ==== 90828+0+0 (secure 0 0 0) 0x7f91a0042030 con 0x7f91a8105b30 2024-09-17T08:52:34.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a81035e0 con 0x7f91a8105b30 2024-09-17T08:52:34.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f919effd640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 0x7f919406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:34.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ada83640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 msgr2=0x7f919406f380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2295189925 2024-09-17T08:52:34.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f91a00ae080 con 0x7f91a8105b30 2024-09-17T08:52:34.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.225+0000 7f91ada83640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 0x7f919406f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T08:52:34.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.233+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f91a0077e90 con 0x7f91a8105b30 2024-09-17T08:52:34.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:34 smithi078 bash[22923]: debug 2024-09-17T08:52:34.096+0000 7ffbf0005040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T08:52:34.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:34 smithi078 bash[22923]: debug 2024-09-17T08:52:34.168+0000 7ffbf0005040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T08:52:34.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.421+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 --> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi078=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f91a810aec0 con 0x7f919406cec0 2024-09-17T08:52:34.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.429+0000 7f91ada83640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 msgr2=0x7f919406f380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2295189925 2024-09-17T08:52:34.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.429+0000 7f91ada83640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 0x7f919406f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T08:52:34.515 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:34 smithi136 bash[25711]: debug 2024-09-17T08:52:34.181+0000 7ff2b850b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T08:52:34.515 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:34 smithi136 bash[25711]: debug 2024-09-17T08:52:34.265+0000 7ff2b850b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T08:52:34.750 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:34 smithi078 bash[22923]: debug 2024-09-17T08:52:34.416+0000 7ffbf0005040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T08:52:34.750 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:34 smithi078 bash[22923]: debug 2024-09-17T08:52:34.588+0000 7ffbf0005040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:52:34.791 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:34 smithi136 bash[25711]: debug 2024-09-17T08:52:34.513+0000 7ff2b850b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T08:52:34.791 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:34 smithi136 bash[25711]: debug 2024-09-17T08:52:34.685+0000 7ff2b850b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:52:34.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.833+0000 7f91ada83640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 msgr2=0x7f919406f380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2295189925 2024-09-17T08:52:34.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:34.833+0000 7f91ada83640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 0x7f919406f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T08:52:35.001 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:34 smithi078 bash[22923]: debug 2024-09-17T08:52:34.748+0000 7ffbf0005040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T08:52:35.001 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:34 smithi078 bash[22923]: debug 2024-09-17T08:52:34.824+0000 7ffbf0005040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T08:52:35.099 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:34 smithi136 bash[25711]: debug 2024-09-17T08:52:34.845+0000 7ff2b850b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T08:52:35.099 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:34 smithi136 bash[25711]: debug 2024-09-17T08:52:34.925+0000 7ff2b850b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T08:52:35.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:35 smithi078 bash[22923]: debug 2024-09-17T08:52:35.000+0000 7ffbf0005040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:52:35.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:35.637+0000 7f91ada83640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 msgr2=0x7f919406f380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.78:6800/2295189925 2024-09-17T08:52:35.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:35.637+0000 7f91ada83640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 0x7f919406f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-17T08:52:36.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:35 smithi078 bash[22923]: debug 2024-09-17T08:52:35.808+0000 7ffbf0005040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T08:52:36.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:35 smithi078 bash[22923]: debug 2024-09-17T08:52:35.880+0000 7ffbf0005040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T08:52:36.182 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:35 smithi136 bash[25711]: debug 2024-09-17T08:52:35.097+0000 7ff2b850b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T08:52:36.182 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:35 smithi136 bash[25711]: debug 2024-09-17T08:52:35.885+0000 7ff2b850b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T08:52:36.183 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:35 smithi136 bash[25711]: debug 2024-09-17T08:52:35.961+0000 7ff2b850b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T08:52:36.541 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: debug 2024-09-17T08:52:36.181+0000 7ff2b850b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T08:52:36.541 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: debug 2024-09-17T08:52:36.253+0000 7ff2b850b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T08:52:36.556 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: debug 2024-09-17T08:52:36.100+0000 7ffbf0005040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T08:52:36.557 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: debug 2024-09-17T08:52:36.176+0000 7ffbf0005040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T08:52:36.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:36.673+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mgrmap(e 18) v1 ==== 90445+0+0 (secure 0 0 0) 0x7f91a000a040 con 0x7f91a8105b30 2024-09-17T08:52:36.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:36.673+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 msgr2=0x7f919406f380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T08:52:36.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:36.673+0000 7f919effd640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/2295189925,v1:172.21.15.78:6801/2295189925] conn(0x7f919406cec0 0x7f919406f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: cluster 2024-09-17T08:52:36.656596+0000 mon.a (mon.0) 750 : cluster [INF] Active manager daemon y restarted 2024-09-17T08:52:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: cluster 2024-09-17T08:52:36.657273+0000 mon.a (mon.0) 751 : cluster [INF] Activating manager daemon y 2024-09-17T08:52:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: cluster 2024-09-17T08:52:36.675927+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-09-17T08:52:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: cluster 2024-09-17T08:52:36.676367+0000 mon.a (mon.0) 753 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0192859s), standbys: x 2024-09-17T08:52:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.678862+0000 mon.a (mon.0) 754 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:52:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.679013+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:52:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.679149+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.681971+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.682141+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.682707+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.683008+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.683325+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.683614+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.683918+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.684203+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.684486+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.684886+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.685150+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.685305+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T08:52:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22670]: audit 2024-09-17T08:52:36.685812+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T08:52:36.854 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: debug 2024-09-17T08:52:36.556+0000 7ffbf0005040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T08:52:36.854 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: debug 2024-09-17T08:52:36.632+0000 7ffbf0005040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T08:52:36.854 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: [17/Sep/2024:08:52:36] ENGINE Bus STARTING 2024-09-17T08:52:36.854 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: CherryPy Checker: 2024-09-17T08:52:36.854 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: The Application mounted at '' has an empty config. 2024-09-17T08:52:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: cluster 2024-09-17T08:52:36.656596+0000 mon.a (mon.0) 750 : cluster [INF] Active manager daemon y restarted 2024-09-17T08:52:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: cluster 2024-09-17T08:52:36.657273+0000 mon.a (mon.0) 751 : cluster [INF] Activating manager daemon y 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: cluster 2024-09-17T08:52:36.675927+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: cluster 2024-09-17T08:52:36.676367+0000 mon.a (mon.0) 753 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0192859s), standbys: x 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.678862+0000 mon.a (mon.0) 754 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.679013+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.679149+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.681971+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.682141+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.682707+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.683008+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.683325+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.683614+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.683918+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:52:36.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.684203+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:52:36.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.684486+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:52:36.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.684886+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:52:36.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.685150+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T08:52:36.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.685305+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T08:52:36.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[32124]: audit 2024-09-17T08:52:36.685812+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T08:52:36.895 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: debug 2024-09-17T08:52:36.633+0000 7ff2b850b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T08:52:36.895 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: debug 2024-09-17T08:52:36.717+0000 7ff2b850b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T08:52:36.895 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: [17/Sep/2024:08:52:36] ENGINE Bus STARTING 2024-09-17T08:52:36.895 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: CherryPy Checker: 2024-09-17T08:52:36.895 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: The Application mounted at '' has an empty config. 2024-09-17T08:52:36.895 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: [17/Sep/2024:08:52:36] ENGINE Serving on http://:::9283 2024-09-17T08:52:36.895 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[25711]: [17/Sep/2024:08:52:36] ENGINE Bus STARTED 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: cluster 2024-09-17T08:52:36.656596+0000 mon.a (mon.0) 750 : cluster [INF] Active manager daemon y restarted 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: cluster 2024-09-17T08:52:36.657273+0000 mon.a (mon.0) 751 : cluster [INF] Activating manager daemon y 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: cluster 2024-09-17T08:52:36.675927+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: cluster 2024-09-17T08:52:36.676367+0000 mon.a (mon.0) 753 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0192859s), standbys: x 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.678862+0000 mon.a (mon.0) 754 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.679013+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.679149+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.681971+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T08:52:36.896 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.682141+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.682707+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.683008+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.683325+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.683614+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.683918+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.684203+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.684486+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.684886+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.685150+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T08:52:36.897 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.685305+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T08:52:36.898 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:36 smithi136 bash[24812]: audit 2024-09-17T08:52:36.685812+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T08:52:37.147 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: [17/Sep/2024:08:52:36] ENGINE Serving on http://:::9283 2024-09-17T08:52:37.147 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:36 smithi078 bash[22923]: [17/Sep/2024:08:52:36] ENGINE Bus STARTED 2024-09-17T08:52:37.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.729+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mon.1 v2:172.21.15.136:3300/0 8 ==== mgrmap(e 19) v1 ==== 90572+0+0 (secure 0 0 0) 0x7f91a00046f0 con 0x7f91a8105b30 2024-09-17T08:52:37.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.729+0000 7f919effd640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f919401d1f0 0x7f91940786c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:37.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.729+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 --> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi078=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f91a810aec0 con 0x7f919401d1f0 2024-09-17T08:52:37.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.733+0000 7f91ada83640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f919401d1f0 0x7f91940786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:37.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.733+0000 7f91ada83640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f919401d1f0 0x7f91940786c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91a4004690 tx=0x7f91a4004600 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:37.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.741+0000 7f919effd640 1 -- 172.21.15.136:0/3294749933 <== mgr.14532 v2:172.21.15.78:6800/1209266769 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f91a810aec0 con 0x7f919401d1f0 2024-09-17T08:52:37.742 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled alertmanager update... 2024-09-17T08:52:37.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f919401d1f0 msgr2=0x7f91940786c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:37.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f919401d1f0 0x7f91940786c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91a4004690 tx=0x7f91a4004600 comp rx=0 tx=0).stop 2024-09-17T08:52:37.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 msgr2=0x7f91a80fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:37.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 --2- 172.21.15.136:0/3294749933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91a8105b30 0x7f91a80fedc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009dc0 tx=0x7f91a0003970 comp rx=0 tx=0).stop 2024-09-17T08:52:37.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91ae284640 1 -- 172.21.15.136:0/3294749933 reap_dead start 2024-09-17T08:52:37.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 shutdown_connections 2024-09-17T08:52:37.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 >> 172.21.15.136:0/3294749933 conn(0x7f91a80fa4d0 msgr2=0x7f91a81014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:37.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 shutdown_connections 2024-09-17T08:52:37.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:37.745+0000 7f91afce7640 1 -- 172.21.15.136:0/3294749933 wait complete. 2024-09-17T08:52:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: cluster 2024-09-17T08:52:36.714645+0000 mon.a (mon.0) 770 : cluster [INF] Manager daemon y is now available 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.733676+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: cluster 2024-09-17T08:52:36.741262+0000 mon.a (mon.0) 772 : cluster [DBG] Standby manager daemon x restarted 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: cluster 2024-09-17T08:52:36.741352+0000 mon.a (mon.0) 773 : cluster [DBG] Standby manager daemon x started 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.745696+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.746368+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.748324+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.748674+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.762676+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.767486+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.772536+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:36.792942+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T08:52:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:37.494133+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:37 smithi136 bash[24812]: audit 2024-09-17T08:52:37.498349+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.095 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: cluster 2024-09-17T08:52:36.714645+0000 mon.a (mon.0) 770 : cluster [INF] Manager daemon y is now available 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.733676+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: cluster 2024-09-17T08:52:36.741262+0000 mon.a (mon.0) 772 : cluster [DBG] Standby manager daemon x restarted 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: cluster 2024-09-17T08:52:36.741352+0000 mon.a (mon.0) 773 : cluster [DBG] Standby manager daemon x started 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.745696+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.746368+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.748324+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.748674+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.762676+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.767486+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.772536+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T08:52:38.096 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:36.792942+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:37.494133+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[22670]: audit 2024-09-17T08:52:37.498349+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: cluster 2024-09-17T08:52:36.714645+0000 mon.a (mon.0) 770 : cluster [INF] Manager daemon y is now available 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.733676+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: cluster 2024-09-17T08:52:36.741262+0000 mon.a (mon.0) 772 : cluster [DBG] Standby manager daemon x restarted 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: cluster 2024-09-17T08:52:36.741352+0000 mon.a (mon.0) 773 : cluster [DBG] Standby manager daemon x started 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.745696+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.746368+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.748324+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.748674+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.136:0/1119104519' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T08:52:38.097 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.762676+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.098 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.767486+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:52:38.098 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.772536+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T08:52:38.098 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:36.792942+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T08:52:38.098 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:37.494133+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.098 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:37 smithi078 bash[32124]: audit 2024-09-17T08:52:37.498349+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: debug 2024-09-17T08:52:38.092+0000 7ffb484a5640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:08:52:38] ENGINE Error in HTTPServer.serve 2024-09-17T08:52:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: Traceback (most recent call last): 2024-09-17T08:52:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:52:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: self._connections.run(self.expiration_interval) 2024-09-17T08:52:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: self._run(expiration_interval) 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: s = self.context.wrap_socket( 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: return self.sslsocket_class._create( 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: self.do_handshake() 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:52:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: self._sslobj.do_handshake() 2024-09-17T08:52:38.354 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22923]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:52:38.535 DEBUG:teuthology.orchestra.run.smithi078:alertmanager.a> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@alertmanager.a.service 2024-09-17T08:52:38.538 INFO:tasks.cephadm:Adding grafana.a on smithi136 2024-09-17T08:52:38.538 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph orch apply grafana '1;smithi136=a' 2024-09-17T08:52:38.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:38 smithi136 bash[24812]: cluster 2024-09-17T08:52:37.724856+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e19: y(active, since 1.06778s), standbys: x 2024-09-17T08:52:38.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:38 smithi136 bash[24812]: cephadm 2024-09-17T08:52:37.740592+0000 mgr.y (mgr.14532) 3 : cephadm [INF] Saving service alertmanager spec with placement smithi078=a;count:1 2024-09-17T08:52:38.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:38 smithi136 bash[24812]: audit 2024-09-17T08:52:37.744708+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:38 smithi136 bash[24812]: cephadm 2024-09-17T08:52:37.872126+0000 mgr.y (mgr.14532) 4 : cephadm [INF] [17/Sep/2024:08:52:37] ENGINE Bus STARTING 2024-09-17T08:52:38.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:38 smithi136 bash[24812]: cephadm 2024-09-17T08:52:37.973825+0000 mgr.y (mgr.14532) 5 : cephadm [INF] [17/Sep/2024:08:52:37] ENGINE Serving on http://172.21.15.78:8765 2024-09-17T08:52:38.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22670]: cluster 2024-09-17T08:52:37.724856+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e19: y(active, since 1.06778s), standbys: x 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22670]: cephadm 2024-09-17T08:52:37.740592+0000 mgr.y (mgr.14532) 3 : cephadm [INF] Saving service alertmanager spec with placement smithi078=a;count:1 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22670]: audit 2024-09-17T08:52:37.744708+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22670]: cephadm 2024-09-17T08:52:37.872126+0000 mgr.y (mgr.14532) 4 : cephadm [INF] [17/Sep/2024:08:52:37] ENGINE Bus STARTING 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[22670]: cephadm 2024-09-17T08:52:37.973825+0000 mgr.y (mgr.14532) 5 : cephadm [INF] [17/Sep/2024:08:52:37] ENGINE Serving on http://172.21.15.78:8765 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[32124]: cluster 2024-09-17T08:52:37.724856+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e19: y(active, since 1.06778s), standbys: x 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[32124]: cephadm 2024-09-17T08:52:37.740592+0000 mgr.y (mgr.14532) 3 : cephadm [INF] Saving service alertmanager spec with placement smithi078=a;count:1 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[32124]: audit 2024-09-17T08:52:37.744708+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[32124]: cephadm 2024-09-17T08:52:37.872126+0000 mgr.y (mgr.14532) 4 : cephadm [INF] [17/Sep/2024:08:52:37] ENGINE Bus STARTING 2024-09-17T08:52:38.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:38 smithi078 bash[32124]: cephadm 2024-09-17T08:52:37.973825+0000 mgr.y (mgr.14532) 5 : cephadm [INF] [17/Sep/2024:08:52:37] ENGINE Serving on http://172.21.15.78:8765 2024-09-17T08:52:39.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:52:40.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: cephadm 2024-09-17T08:52:38.095923+0000 mgr.y (mgr.14532) 6 : cephadm [INF] [17/Sep/2024:08:52:38] ENGINE Serving on https://172.21.15.78:7150 2024-09-17T08:52:40.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: cephadm 2024-09-17T08:52:38.096094+0000 mgr.y (mgr.14532) 7 : cephadm [INF] [17/Sep/2024:08:52:38] ENGINE Bus STARTED 2024-09-17T08:52:40.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: cephadm 2024-09-17T08:52:38.098098+0000 mgr.y (mgr.14532) 8 : cephadm [ERR] [17/Sep/2024:08:52:38] ENGINE Error in HTTPServer.serve 2024-09-17T08:52:40.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: Traceback (most recent call last): 2024-09-17T08:52:40.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:52:40.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: self._connections.run(self.expiration_interval) 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: self._run(expiration_interval) 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: s = self.context.wrap_socket( 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: return self.sslsocket_class._create( 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: self.do_handshake() 2024-09-17T08:52:40.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:52:40.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: self._sslobj.do_handshake() 2024-09-17T08:52:40.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:52:40.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: cluster 2024-09-17T08:52:38.685082+0000 mgr.y (mgr.14532) 9 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:40.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:39 smithi136 bash[24812]: cluster 2024-09-17T08:52:38.757480+0000 mon.a (mon.0) 782 : cluster [DBG] mgrmap e20: y(active, since 2s), standbys: x 2024-09-17T08:52:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: cephadm 2024-09-17T08:52:38.095923+0000 mgr.y (mgr.14532) 6 : cephadm [INF] [17/Sep/2024:08:52:38] ENGINE Serving on https://172.21.15.78:7150 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: cephadm 2024-09-17T08:52:38.096094+0000 mgr.y (mgr.14532) 7 : cephadm [INF] [17/Sep/2024:08:52:38] ENGINE Bus STARTED 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: cephadm 2024-09-17T08:52:38.098098+0000 mgr.y (mgr.14532) 8 : cephadm [ERR] [17/Sep/2024:08:52:38] ENGINE Error in HTTPServer.serve 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: Traceback (most recent call last): 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: self._connections.run(self.expiration_interval) 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: self._run(expiration_interval) 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:52:40.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: s = self.context.wrap_socket( 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: return self.sslsocket_class._create( 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: self.do_handshake() 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:52:40.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: self._sslobj.do_handshake() 2024-09-17T08:52:40.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:52:40.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: cluster 2024-09-17T08:52:38.685082+0000 mgr.y (mgr.14532) 9 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:40.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[22670]: cluster 2024-09-17T08:52:38.757480+0000 mon.a (mon.0) 782 : cluster [DBG] mgrmap e20: y(active, since 2s), standbys: x 2024-09-17T08:52:40.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: cephadm 2024-09-17T08:52:38.095923+0000 mgr.y (mgr.14532) 6 : cephadm [INF] [17/Sep/2024:08:52:38] ENGINE Serving on https://172.21.15.78:7150 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: cephadm 2024-09-17T08:52:38.096094+0000 mgr.y (mgr.14532) 7 : cephadm [INF] [17/Sep/2024:08:52:38] ENGINE Bus STARTED 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: cephadm 2024-09-17T08:52:38.098098+0000 mgr.y (mgr.14532) 8 : cephadm [ERR] [17/Sep/2024:08:52:38] ENGINE Error in HTTPServer.serve 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: Traceback (most recent call last): 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: self._connections.run(self.expiration_interval) 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: self._run(expiration_interval) 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T08:52:40.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: s = self.context.wrap_socket( 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: return self.sslsocket_class._create( 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: self.do_handshake() 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T08:52:40.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: self._sslobj.do_handshake() 2024-09-17T08:52:40.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T08:52:40.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: cluster 2024-09-17T08:52:38.685082+0000 mgr.y (mgr.14532) 9 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:40.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:39 smithi078 bash[32124]: cluster 2024-09-17T08:52:38.757480+0000 mon.a (mon.0) 782 : cluster [DBG] mgrmap e20: y(active, since 2s), standbys: x 2024-09-17T08:52:41.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:40 smithi136 bash[24812]: audit 2024-09-17T08:52:39.083293+0000 mgr.y (mgr.14532) 10 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:41.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:40 smithi078 bash[22670]: audit 2024-09-17T08:52:39.083293+0000 mgr.y (mgr.14532) 10 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:41.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:40 smithi078 bash[32124]: audit 2024-09-17T08:52:39.083293+0000 mgr.y (mgr.14532) 10 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:42.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:41 smithi136 bash[24812]: cluster 2024-09-17T08:52:40.685761+0000 mgr.y (mgr.14532) 11 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:42.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:41 smithi136 bash[24812]: cluster 2024-09-17T08:52:40.771199+0000 mon.a (mon.0) 783 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-17T08:52:42.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:41 smithi078 bash[32124]: cluster 2024-09-17T08:52:40.685761+0000 mgr.y (mgr.14532) 11 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:42.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:41 smithi078 bash[32124]: cluster 2024-09-17T08:52:40.771199+0000 mon.a (mon.0) 783 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-17T08:52:42.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:41 smithi078 bash[22670]: cluster 2024-09-17T08:52:40.685761+0000 mgr.y (mgr.14532) 11 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:42.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:41 smithi078 bash[22670]: cluster 2024-09-17T08:52:40.771199+0000 mon.a (mon.0) 783 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-17T08:52:43.076 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:42.600491+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:42.607742+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:42.684896+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: cluster 2024-09-17T08:52:42.686139+0000 mgr.y (mgr.14532) 12 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:42.689076+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.396833+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.400619+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.404775+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.406098+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.408919+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.410215+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.410412+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.411065+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.411300+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.411877+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.412058+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.412644+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.417772+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.424280+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:42.600491+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:42.607742+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:42.684896+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: cluster 2024-09-17T08:52:42.686139+0000 mgr.y (mgr.14532) 12 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:42.689076+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.396833+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.400619+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.404775+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.406098+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.408919+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.410215+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.410412+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.411065+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.411300+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.411877+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.412058+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.412644+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.417772+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.424280+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.426026+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[32124]: audit 2024-09-17T08:52:43.426934+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.426026+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:43.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:43 smithi078 bash[22670]: audit 2024-09-17T08:52:43.426934+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:42.600491+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:42.607742+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:42.684896+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: cluster 2024-09-17T08:52:42.686139+0000 mgr.y (mgr.14532) 12 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:42.689076+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.396833+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.400619+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.404775+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.406098+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.408919+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.410215+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.410412+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.411065+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.411300+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.411877+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.412058+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.412644+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T08:52:44.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.417772+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.424280+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:44.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.426026+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:52:44.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:43 smithi136 bash[24812]: audit 2024-09-17T08:52:43.426934+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:52:44.894 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:44.895 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:44.895 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:44.895 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:44.895 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:44.896 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:44.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:44.896 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.412750+0000 mgr.y (mgr.14532) 13 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 3804M 2024-09-17T08:52:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.413260+0000 mgr.y (mgr.14532) 14 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 3804M 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.428134+0000 mgr.y (mgr.14532) 15 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.428507+0000 mgr.y (mgr.14532) 16 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.576682+0000 mgr.y (mgr.14532) 17 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.579527+0000 mgr.y (mgr.14532) 18 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.705791+0000 mgr.y (mgr.14532) 19 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.798115+0000 mgr.y (mgr.14532) 20 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.814968+0000 mgr.y (mgr.14532) 21 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: audit 2024-09-17T08:52:43.914768+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: audit 2024-09-17T08:52:43.920425+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: cephadm 2024-09-17T08:52:43.944374+0000 mgr.y (mgr.14532) 22 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: audit 2024-09-17T08:52:44.056048+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: audit 2024-09-17T08:52:44.064103+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:44 smithi136 bash[24812]: audit 2024-09-17T08:52:44.071476+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.351 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.352 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.352 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.353 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.353 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.353 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 systemd[1]: Started Ceph node-exporter.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:52:45.354 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-09-17T08:52:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.412750+0000 mgr.y (mgr.14532) 13 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 3804M 2024-09-17T08:52:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.413260+0000 mgr.y (mgr.14532) 14 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 3804M 2024-09-17T08:52:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.428134+0000 mgr.y (mgr.14532) 15 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:52:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.428507+0000 mgr.y (mgr.14532) 16 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:52:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.576682+0000 mgr.y (mgr.14532) 17 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:52:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.579527+0000 mgr.y (mgr.14532) 18 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.705791+0000 mgr.y (mgr.14532) 19 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.798115+0000 mgr.y (mgr.14532) 20 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.814968+0000 mgr.y (mgr.14532) 21 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: audit 2024-09-17T08:52:43.914768+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: audit 2024-09-17T08:52:43.920425+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: cephadm 2024-09-17T08:52:43.944374+0000 mgr.y (mgr.14532) 22 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: audit 2024-09-17T08:52:44.056048+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: audit 2024-09-17T08:52:44.064103+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[22670]: audit 2024-09-17T08:52:44.071476+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.412750+0000 mgr.y (mgr.14532) 13 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 3804M 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.413260+0000 mgr.y (mgr.14532) 14 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 3804M 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.428134+0000 mgr.y (mgr.14532) 15 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.conf 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.428507+0000 mgr.y (mgr.14532) 16 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.conf 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.576682+0000 mgr.y (mgr.14532) 17 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.579527+0000 mgr.y (mgr.14532) 18 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.705791+0000 mgr.y (mgr.14532) 19 : cephadm [INF] Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.798115+0000 mgr.y (mgr.14532) 20 : cephadm [INF] Updating smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.814968+0000 mgr.y (mgr.14532) 21 : cephadm [INF] Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: audit 2024-09-17T08:52:43.914768+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: audit 2024-09-17T08:52:43.920425+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: cephadm 2024-09-17T08:52:43.944374+0000 mgr.y (mgr.14532) 22 : cephadm [INF] Updating smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T08:52:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: audit 2024-09-17T08:52:44.056048+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: audit 2024-09-17T08:52:44.064103+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:44 smithi078 bash[32124]: audit 2024-09-17T08:52:44.071476+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.852 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: v1.5.0: Pulling from prometheus/node-exporter 2024-09-17T08:52:45.852 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: 22b70bddd3ac: Pulling fs layer 2024-09-17T08:52:45.852 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: 5c12815fee55: Pulling fs layer 2024-09-17T08:52:45.852 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: c0e87333d380: Pulling fs layer 2024-09-17T08:52:45.974 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.974 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.974 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.975 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.975 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.975 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.975 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.976 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.976 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:45.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:45 smithi136 bash[24812]: cephadm 2024-09-17T08:52:44.074309+0000 mgr.y (mgr.14532) 23 : cephadm [INF] Deploying daemon node-exporter.a on smithi078 2024-09-17T08:52:45.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:45 smithi136 bash[24812]: cluster 2024-09-17T08:52:44.686972+0000 mgr.y (mgr.14532) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T08:52:45.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:45 smithi136 bash[24812]: audit 2024-09-17T08:52:45.053380+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:45 smithi136 bash[24812]: audit 2024-09-17T08:52:45.061422+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:45.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:45 smithi136 bash[24812]: audit 2024-09-17T08:52:45.065589+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:46.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- 172.21.15.136:0/3677351499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 msgr2=0x7feb54110720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:46.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 --2- 172.21.15.136:0/3677351499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb54110720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb44009900 tx=0x7feb4402a410 comp rx=0 tx=0).stop 2024-09-17T08:52:46.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- 172.21.15.136:0/3677351499 shutdown_connections 2024-09-17T08:52:46.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 --2- 172.21.15.136:0/3677351499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb54110c60 0x7feb54113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 --2- 172.21.15.136:0/3677351499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb54110720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 --2- 172.21.15.136:0/3677351499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb540749e0 0x7feb54074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- 172.21.15.136:0/3677351499 >> 172.21.15.136:0/3677351499 conn(0x7feb540fdca0 msgr2=0x7feb541000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:46.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- 172.21.15.136:0/3677351499 shutdown_connections 2024-09-17T08:52:46.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- 172.21.15.136:0/3677351499 wait complete. 2024-09-17T08:52:46.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 Processor -- start 2024-09-17T08:52:46.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- start start 2024-09-17T08:52:46.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb540749e0 0x7feb5419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:46.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb5419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:46.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb54110c60 0x7feb541a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb541a0d10 con 0x7feb54110c60 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb541a0e80 con 0x7feb54075300 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb5abb9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb541a0ff0 con 0x7feb540749e0 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb4bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb5419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb4bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb5419c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:34474/0 (socket says 172.21.15.136:34474) 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb4bfff640 1 -- 172.21.15.136:0/1915992603 learned_addr learned my addr 172.21.15.136:0/1915992603 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb58955640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb540749e0 0x7feb5419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.245+0000 7feb59156640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb54110c60 0x7feb541a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb4bfff640 1 -- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb540749e0 msgr2=0x7feb5419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb4bfff640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb540749e0 0x7feb5419bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb4bfff640 1 -- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb54110c60 msgr2=0x7feb541a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb4bfff640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb54110c60 0x7feb541a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb4bfff640 1 -- 172.21.15.136:0/1915992603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb44009560 con 0x7feb54075300 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb58955640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb540749e0 0x7feb5419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb59156640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb54110c60 0x7feb541a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb4bfff640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb5419c310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb44006010 tx=0x7feb44004e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb49ffb640 1 -- 172.21.15.136:0/1915992603 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44005480 con 0x7feb54075300 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb49ffb640 1 -- 172.21.15.136:0/1915992603 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7feb440055e0 con 0x7feb54075300 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb541a1270 con 0x7feb54075300 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb49ffb640 1 -- 172.21.15.136:0/1915992603 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4403c810 con 0x7feb54075300 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb541a89c0 con 0x7feb54075300 2024-09-17T08:52:46.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb54076120 con 0x7feb54075300 2024-09-17T08:52:46.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb49ffb640 1 -- 172.21.15.136:0/1915992603 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7feb440035f0 con 0x7feb54075300 2024-09-17T08:52:46.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb49ffb640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb3c06cec0 0x7feb3c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:46.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb49ffb640 1 -- 172.21.15.136:0/1915992603 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7feb440adb30 con 0x7feb54075300 2024-09-17T08:52:46.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb58955640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb3c06cec0 0x7feb3c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:46.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.249+0000 7feb58955640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb3c06cec0 0x7feb3c06f380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb500058c0 tx=0x7feb50005850 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:46.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.253+0000 7feb49ffb640 1 -- 172.21.15.136:0/1915992603 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb440776e0 con 0x7feb54075300 2024-09-17T08:52:46.291 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:46.291 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:46.291 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:46.292 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:46.292 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[51410]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-09-17T08:52:46.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[22670]: cephadm 2024-09-17T08:52:44.074309+0000 mgr.y (mgr.14532) 23 : cephadm [INF] Deploying daemon node-exporter.a on smithi078 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[22670]: cluster 2024-09-17T08:52:44.686972+0000 mgr.y (mgr.14532) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[22670]: audit 2024-09-17T08:52:45.053380+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[22670]: audit 2024-09-17T08:52:45.061422+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[22670]: audit 2024-09-17T08:52:45.065589+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[32124]: cephadm 2024-09-17T08:52:44.074309+0000 mgr.y (mgr.14532) 23 : cephadm [INF] Deploying daemon node-exporter.a on smithi078 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[32124]: cluster 2024-09-17T08:52:44.686972+0000 mgr.y (mgr.14532) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[32124]: audit 2024-09-17T08:52:45.053380+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[32124]: audit 2024-09-17T08:52:45.061422+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:46.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[32124]: audit 2024-09-17T08:52:45.065589+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:46.353 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: 5c12815fee55: Verifying Checksum 2024-09-17T08:52:46.353 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: 5c12815fee55: Download complete 2024-09-17T08:52:46.353 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:45 smithi078 bash[58214]: 22b70bddd3ac: Download complete 2024-09-17T08:52:46.353 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[58214]: c0e87333d380: Verifying Checksum 2024-09-17T08:52:46.353 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[58214]: c0e87333d380: Download complete 2024-09-17T08:52:46.353 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[58214]: 22b70bddd3ac: Pull complete 2024-09-17T08:52:46.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.437+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 --> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}) v1 -- 0x7feb5419d1c0 con 0x7feb3c06cec0 2024-09-17T08:52:46.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.445+0000 7feb49ffb640 1 -- 172.21.15.136:0/1915992603 <== mgr.14532 v2:172.21.15.78:6800/1209266769 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7feb5000b930 con 0x7feb3c06cec0 2024-09-17T08:52:46.447 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled grafana update... 2024-09-17T08:52:46.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb3c06cec0 msgr2=0x7feb3c06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:46.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb3c06cec0 0x7feb3c06f380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb500058c0 tx=0x7feb50005850 comp rx=0 tx=0).stop 2024-09-17T08:52:46.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 msgr2=0x7feb5419c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb5419c310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb44006010 tx=0x7feb44004e20 comp rx=0 tx=0).stop 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 shutdown_connections 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb3c06cec0 0x7feb3c06f380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb54110c60 0x7feb541a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb54075300 0x7feb5419c310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 --2- 172.21.15.136:0/1915992603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb540749e0 0x7feb5419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 >> 172.21.15.136:0/1915992603 conn(0x7feb540fdca0 msgr2=0x7feb54100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 shutdown_connections 2024-09-17T08:52:46.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:52:46.449+0000 7feb5abb9640 1 -- 172.21.15.136:0/1915992603 wait complete. 2024-09-17T08:52:46.791 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[51410]: v1.5.0: Pulling from prometheus/node-exporter 2024-09-17T08:52:46.852 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[58214]: 5c12815fee55: Pull complete 2024-09-17T08:52:46.853 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:46 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: cephadm 2024-09-17T08:52:45.066221+0000 mgr.y (mgr.14532) 25 : cephadm [INF] Deploying daemon node-exporter.b on smithi136 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: audit 2024-09-17T08:52:46.131651+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: audit 2024-09-17T08:52:46.142827+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: audit 2024-09-17T08:52:46.151234+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: audit 2024-09-17T08:52:46.159424+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: audit 2024-09-17T08:52:46.175680+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: audit 2024-09-17T08:52:46.449782+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.214 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[32124]: audit 2024-09-17T08:52:46.768160+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: cephadm 2024-09-17T08:52:45.066221+0000 mgr.y (mgr.14532) 25 : cephadm [INF] Deploying daemon node-exporter.b on smithi136 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: audit 2024-09-17T08:52:46.131651+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: audit 2024-09-17T08:52:46.142827+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: audit 2024-09-17T08:52:46.151234+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: audit 2024-09-17T08:52:46.159424+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: audit 2024-09-17T08:52:46.175680+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: audit 2024-09-17T08:52:46.449782+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.215 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:46 smithi078 bash[22670]: audit 2024-09-17T08:52:46.768160+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: cephadm 2024-09-17T08:52:45.066221+0000 mgr.y (mgr.14532) 25 : cephadm [INF] Deploying daemon node-exporter.b on smithi136 2024-09-17T08:52:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: audit 2024-09-17T08:52:46.131651+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: audit 2024-09-17T08:52:46.142827+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: audit 2024-09-17T08:52:46.151234+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: audit 2024-09-17T08:52:46.159424+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: audit 2024-09-17T08:52:46.175680+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: audit 2024-09-17T08:52:46.449782+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:46 smithi136 bash[24812]: audit 2024-09-17T08:52:46.768160+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:47.483 DEBUG:teuthology.orchestra.run.smithi136:grafana.a> sudo journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@grafana.a.service 2024-09-17T08:52:47.486 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T08:52:47.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T08:52:47.499 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[58214]: c0e87333d380: Pull complete 2024-09-17T08:52:47.499 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[58214]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-09-17T08:52:47.499 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[58214]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-09-17T08:52:47.648 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: 22b70bddd3ac: Pulling fs layer 2024-09-17T08:52:47.648 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: 5c12815fee55: Pulling fs layer 2024-09-17T08:52:47.648 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: c0e87333d380: Pulling fs layer 2024-09-17T08:52:47.648 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: 22b70bddd3ac: Download complete 2024-09-17T08:52:47.648 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: c0e87333d380: Verifying Checksum 2024-09-17T08:52:47.648 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: c0e87333d380: Download complete 2024-09-17T08:52:47.648 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: 5c12815fee55: Download complete 2024-09-17T08:52:47.791 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[51410]: 22b70bddd3ac: Pull complete 2024-09-17T08:52:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[24812]: cephadm 2024-09-17T08:52:46.203730+0000 mgr.y (mgr.14532) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi078 2024-09-17T08:52:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[24812]: audit 2024-09-17T08:52:46.441798+0000 mgr.y (mgr.14532) 27 : audit [DBG] from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[24812]: cephadm 2024-09-17T08:52:46.443734+0000 mgr.y (mgr.14532) 28 : cephadm [INF] Saving service grafana spec with placement smithi136=a;count:1 2024-09-17T08:52:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:47 smithi136 bash[24812]: cluster 2024-09-17T08:52:46.687724+0000 mgr.y (mgr.14532) 29 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T08:52:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[22670]: cephadm 2024-09-17T08:52:46.203730+0000 mgr.y (mgr.14532) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi078 2024-09-17T08:52:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[22670]: audit 2024-09-17T08:52:46.441798+0000 mgr.y (mgr.14532) 27 : audit [DBG] from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[22670]: cephadm 2024-09-17T08:52:46.443734+0000 mgr.y (mgr.14532) 28 : cephadm [INF] Saving service grafana spec with placement smithi136=a;count:1 2024-09-17T08:52:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[22670]: cluster 2024-09-17T08:52:46.687724+0000 mgr.y (mgr.14532) 29 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T08:52:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[32124]: cephadm 2024-09-17T08:52:46.203730+0000 mgr.y (mgr.14532) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi078 2024-09-17T08:52:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[32124]: audit 2024-09-17T08:52:46.441798+0000 mgr.y (mgr.14532) 27 : audit [DBG] from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T08:52:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[32124]: cephadm 2024-09-17T08:52:46.443734+0000 mgr.y (mgr.14532) 28 : cephadm [INF] Saving service grafana spec with placement smithi136=a;count:1 2024-09-17T08:52:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:47 smithi078 bash[32124]: cluster 2024-09-17T08:52:46.687724+0000 mgr.y (mgr.14532) 29 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T08:52:48.791 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:48 smithi136 bash[51410]: 5c12815fee55: Pull complete 2024-09-17T08:52:49.092 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:48 smithi136 bash[51410]: c0e87333d380: Pull complete 2024-09-17T08:52:49.092 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:48 smithi136 bash[51410]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-09-17T08:52:49.092 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:48 smithi136 bash[51410]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-09-17T08:52:49.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:52:50.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[32124]: cluster 2024-09-17T08:52:48.689181+0000 mgr.y (mgr.14532) 30 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T08:52:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[22670]: cluster 2024-09-17T08:52:48.689181+0000 mgr.y (mgr.14532) 30 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T08:52:50.103 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.861Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-17T08:52:50.103 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.861Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-17T08:52:50.103 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.862Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-17T08:52:50.103 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.862Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-17T08:52:50.103 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-17T08:52:50.104 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T08:52:50.104 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-17T08:52:50.104 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=arp 2024-09-17T08:52:50.104 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-17T08:52:50.104 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-17T08:52:50.104 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-17T08:52:50.104 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=edac 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-17T08:52:50.105 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-17T08:52:50.106 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-17T08:52:50.106 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-17T08:52:50.106 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-17T08:52:50.106 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-17T08:52:50.106 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-17T08:52:50.106 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-17T08:52:50.106 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=os 2024-09-17T08:52:50.107 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=stat 2024-09-17T08:52:50.108 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=time 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=uname 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.863Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.864Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-17T08:52:50.109 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:49 smithi078 bash[58214]: ts=2024-09-17T08:52:49.864Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-17T08:52:50.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:49 smithi136 bash[24812]: cluster 2024-09-17T08:52:48.689181+0000 mgr.y (mgr.14532) 30 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.255Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.255Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=arp 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-17T08:52:50.542 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=edac 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-17T08:52:50.543 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-17T08:52:50.544 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.256Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=os 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=stat 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=time 2024-09-17T08:52:50.545 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-17T08:52:50.546 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=uname 2024-09-17T08:52:50.546 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-17T08:52:50.546 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-17T08:52:50.546 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-17T08:52:50.546 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-17T08:52:50.546 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[51410]: ts=2024-09-17T08:52:50.257Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-17T08:52:51.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:50 smithi136 bash[24812]: audit 2024-09-17T08:52:49.094491+0000 mgr.y (mgr.14532) 31 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:51.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:50 smithi078 bash[22670]: audit 2024-09-17T08:52:49.094491+0000 mgr.y (mgr.14532) 31 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:51.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:50 smithi078 bash[32124]: audit 2024-09-17T08:52:49.094491+0000 mgr.y (mgr.14532) 31 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:52:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:52:52.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:51 smithi136 bash[24812]: cluster 2024-09-17T08:52:50.689931+0000 mgr.y (mgr.14532) 32 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:52.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:51 smithi136 bash[24812]: audit 2024-09-17T08:52:51.799349+0000 mon.a (mon.0) 819 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:52:52.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:51 smithi078 bash[22670]: cluster 2024-09-17T08:52:50.689931+0000 mgr.y (mgr.14532) 32 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:52.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:51 smithi078 bash[22670]: audit 2024-09-17T08:52:51.799349+0000 mon.a (mon.0) 819 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:52:52.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:51 smithi078 bash[32124]: cluster 2024-09-17T08:52:50.689931+0000 mgr.y (mgr.14532) 32 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:52.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:51 smithi078 bash[32124]: audit 2024-09-17T08:52:51.799349+0000 mon.a (mon.0) 819 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:52:54.028 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:53 smithi078 bash[22670]: cluster 2024-09-17T08:52:52.690702+0000 mgr.y (mgr.14532) 33 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:54.029 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:53 smithi078 bash[32124]: cluster 2024-09-17T08:52:52.690702+0000 mgr.y (mgr.14532) 33 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:54.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:53 smithi136 bash[24812]: cluster 2024-09-17T08:52:52.690702+0000 mgr.y (mgr.14532) 33 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:56.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:55 smithi078 bash[22670]: cluster 2024-09-17T08:52:54.692147+0000 mgr.y (mgr.14532) 34 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:56.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:55 smithi078 bash[32124]: cluster 2024-09-17T08:52:54.692147+0000 mgr.y (mgr.14532) 34 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:56.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:55 smithi136 bash[24812]: cluster 2024-09-17T08:52:54.692147+0000 mgr.y (mgr.14532) 34 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- 172.21.15.78:0/1930935565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0feba0 msgr2=0x7ff65c0fef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 --2- 172.21.15.78:0/1930935565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0feba0 0x7ff65c0fef80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009900 tx=0x7ff64c02a410 comp rx=0 tx=0).stop 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- 172.21.15.78:0/1930935565 shutdown_connections 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 --2- 172.21.15.78:0/1930935565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff65c10c750 0x7ff65c10eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 --2- 172.21.15.78:0/1930935565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff65c0ff550 0x7ff65c10c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 --2- 172.21.15.78:0/1930935565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0feba0 0x7ff65c0fef80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- 172.21.15.78:0/1930935565 >> 172.21.15.78:0/1930935565 conn(0x7ff65c0fa9f0 msgr2=0x7ff65c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- 172.21.15.78:0/1930935565 shutdown_connections 2024-09-17T08:52:56.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- 172.21.15.78:0/1930935565 wait complete. 2024-09-17T08:52:56.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 Processor -- start 2024-09-17T08:52:56.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- start start 2024-09-17T08:52:56.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff65c0feba0 0x7ff65c19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:56.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0ff550 0x7ff65c19dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:56.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff65c10c750 0x7ff65c197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:56.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c197ed0 con 0x7ff65c0ff550 2024-09-17T08:52:56.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c198040 con 0x7ff65c0feba0 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff66218e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c198200 con 0x7ff65c10c750 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff65affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0ff550 0x7ff65c19dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff65affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0ff550 0x7ff65c19dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56194/0 (socket says 172.21.15.78:56194) 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.967+0000 7ff65affd640 1 -- 172.21.15.78:0/2472181068 learned_addr learned my addr 172.21.15.78:0/2472181068 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65bfff640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff65c10c750 0x7ff65c197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65b7fe640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff65c0feba0 0x7ff65c19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65affd640 1 -- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff65c10c750 msgr2=0x7ff65c197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65affd640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff65c10c750 0x7ff65c197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65affd640 1 -- 172.21.15.78:0/2472181068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff65c0feba0 msgr2=0x7ff65c19d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65affd640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff65c0feba0 0x7ff65c19d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65affd640 1 -- 172.21.15.78:0/2472181068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009840 con 0x7ff65c0ff550 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65affd640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0ff550 0x7ff65c19dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b4a0 tx=0x7ff65000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff658ff9640 1 -- 172.21.15.78:0/2472181068 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650011830 con 0x7ff65c0ff550 2024-09-17T08:52:56.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff658ff9640 1 -- 172.21.15.78:0/2472181068 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7ff650011de0 con 0x7ff65c0ff550 2024-09-17T08:52:56.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c009560 con 0x7ff65c0ff550 2024-09-17T08:52:56.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff658ff9640 1 -- 172.21.15.78:0/2472181068 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650010ce0 con 0x7ff65c0ff550 2024-09-17T08:52:56.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c1986d0 con 0x7ff65c0ff550 2024-09-17T08:52:56.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c068fb0 con 0x7ff65c0ff550 2024-09-17T08:52:56.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff658ff9640 1 -- 172.21.15.78:0/2472181068 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7ff650010380 con 0x7ff65c0ff550 2024-09-17T08:52:56.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff658ff9640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff64406cec0 0x7ff64406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:52:56.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff658ff9640 1 -- 172.21.15.78:0/2472181068 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7ff65008c5d0 con 0x7ff65c0ff550 2024-09-17T08:52:56.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65b7fe640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff64406cec0 0x7ff64406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:52:56.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.971+0000 7ff65b7fe640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff64406cec0 0x7ff64406f380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff64c000c00 tx=0x7ff64c005a40 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:52:56.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:56.975+0000 7ff658ff9640 1 -- 172.21.15.78:0/2472181068 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff650056200 con 0x7ff65c0ff550 2024-09-17T08:52:57.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.203+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff65c198d90 con 0x7ff65c0ff550 2024-09-17T08:52:57.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.207+0000 7ff658ff9640 1 -- 172.21.15.78:0/2472181068 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff650059820 con 0x7ff65c0ff550 2024-09-17T08:52:57.211 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T08:52:57.211 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBpQ+lm2v5nDBAAdeDBkwY5lUH5YGmWWj5n3w== 2024-09-17T08:52:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff64406cec0 msgr2=0x7ff64406f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff64406cec0 0x7ff64406f380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff64c000c00 tx=0x7ff64c005a40 comp rx=0 tx=0).stop 2024-09-17T08:52:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0ff550 msgr2=0x7ff65c19dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:52:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0ff550 0x7ff65c19dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b4a0 tx=0x7ff65000b8a0 comp rx=0 tx=0).stop 2024-09-17T08:52:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 shutdown_connections 2024-09-17T08:52:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff64406cec0 0x7ff64406f380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff65c10c750 0x7ff65c197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff65c0ff550 0x7ff65c19dcd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 --2- 172.21.15.78:0/2472181068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff65c0feba0 0x7ff65c19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:52:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 >> 172.21.15.78:0/2472181068 conn(0x7ff65c0fa9f0 msgr2=0x7ff65c10cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:52:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 shutdown_connections 2024-09-17T08:52:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:52:57.211+0000 7ff66218e640 1 -- 172.21.15.78:0/2472181068 wait complete. 2024-09-17T08:52:58.084 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:52:58.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T08:52:58.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T08:52:58.141 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T08:52:58.236 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.236 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.237 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.237 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.237 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:57 smithi078 bash[32124]: cluster 2024-09-17T08:52:56.692639+0000 mgr.y (mgr.14532) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:52:58.237 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:57 smithi078 bash[32124]: audit 2024-09-17T08:52:57.207922+0000 mon.a (mon.0) 820 : audit [INF] from='client.? 172.21.15.78:0/2472181068' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:52:58.237 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:57 smithi078 bash[32124]: audit 2024-09-17T08:52:57.213908+0000 mon.a (mon.0) 821 : audit [INF] from='client.? 172.21.15.78:0/2472181068' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T08:52:58.238 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.238 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.238 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.238 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:57 smithi078 bash[22670]: cluster 2024-09-17T08:52:56.692639+0000 mgr.y (mgr.14532) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:52:58.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:57 smithi078 bash[22670]: audit 2024-09-17T08:52:57.207922+0000 mon.a (mon.0) 820 : audit [INF] from='client.? 172.21.15.78:0/2472181068' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:52:58.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:57 smithi078 bash[22670]: audit 2024-09-17T08:52:57.213908+0000 mon.a (mon.0) 821 : audit [INF] from='client.? 172.21.15.78:0/2472181068' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T08:52:58.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:57 smithi136 bash[24812]: cluster 2024-09-17T08:52:56.692639+0000 mgr.y (mgr.14532) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:52:58.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:57 smithi136 bash[24812]: audit 2024-09-17T08:52:57.207922+0000 mon.a (mon.0) 820 : audit [INF] from='client.? 172.21.15.78:0/2472181068' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:52:58.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:57 smithi136 bash[24812]: audit 2024-09-17T08:52:57.213908+0000 mon.a (mon.0) 821 : audit [INF] from='client.? 172.21.15.78:0/2472181068' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T08:52:58.351 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.351 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.352 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.506 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.506 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.507 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.507 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.507 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.508 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.508 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.508 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.509 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.509 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:52:58.868 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:58 smithi078 systemd[1]: Started Ceph alertmanager.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:52:59.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:52:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:52:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[22670]: audit 2024-09-17T08:52:58.544035+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[22670]: audit 2024-09-17T08:52:58.550026+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[22670]: audit 2024-09-17T08:52:58.555600+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[22670]: audit 2024-09-17T08:52:58.559815+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[22670]: audit 2024-09-17T08:52:58.589213+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:59.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[22670]: cluster 2024-09-17T08:52:58.694013+0000 mgr.y (mgr.14532) 36 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:52:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[32124]: audit 2024-09-17T08:52:58.544035+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[32124]: audit 2024-09-17T08:52:58.550026+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[32124]: audit 2024-09-17T08:52:58.555600+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[32124]: audit 2024-09-17T08:52:58.559815+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:52:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[32124]: audit 2024-09-17T08:52:58.589213+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:52:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[32124]: cluster 2024-09-17T08:52:58.694013+0000 mgr.y (mgr.14532) 36 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.745Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.745Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.746Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.78 port=9094 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.747Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.778Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.778Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.782Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-17T08:52:59.854 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:52:59 smithi078 bash[58769]: ts=2024-09-17T08:52:59.782Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-17T08:53:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:59 smithi136 bash[24812]: audit 2024-09-17T08:52:58.544035+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:59 smithi136 bash[24812]: audit 2024-09-17T08:52:58.550026+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:59 smithi136 bash[24812]: audit 2024-09-17T08:52:58.555600+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:59 smithi136 bash[24812]: audit 2024-09-17T08:52:58.559815+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:59 smithi136 bash[24812]: audit 2024-09-17T08:52:58.589213+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:53:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:52:59 smithi136 bash[24812]: cluster 2024-09-17T08:52:58.694013+0000 mgr.y (mgr.14532) 36 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:00.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:00 smithi078 bash[32124]: audit 2024-09-17T08:52:59.105850+0000 mgr.y (mgr.14532) 37 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:00.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:00 smithi078 bash[22670]: audit 2024-09-17T08:52:59.105850+0000 mgr.y (mgr.14532) 37 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:00 smithi136 bash[24812]: audit 2024-09-17T08:52:59.105850+0000 mgr.y (mgr.14532) 37 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:01.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:01 smithi078 bash[22670]: cluster 2024-09-17T08:53:00.694728+0000 mgr.y (mgr.14532) 38 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:01.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:01 smithi078 bash[32124]: cluster 2024-09-17T08:53:00.694728+0000 mgr.y (mgr.14532) 38 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:01.852 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:01 smithi078 bash[58769]: ts=2024-09-17T08:53:01.748Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000522242s 2024-09-17T08:53:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:01 smithi136 bash[24812]: cluster 2024-09-17T08:53:00.694728+0000 mgr.y (mgr.14532) 38 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:02.876 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T08:53:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:02 smithi136 bash[24812]: audit 2024-09-17T08:53:01.779353+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:02 smithi078 bash[22670]: audit 2024-09-17T08:53:01.779353+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:02 smithi078 bash[32124]: audit 2024-09-17T08:53:01.779353+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:03 smithi136 bash[24812]: cluster 2024-09-17T08:53:02.695378+0000 mgr.y (mgr.14532) 39 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:03 smithi136 bash[24812]: audit 2024-09-17T08:53:03.527907+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:03 smithi136 bash[24812]: audit 2024-09-17T08:53:03.534815+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:03 smithi078 bash[22670]: cluster 2024-09-17T08:53:02.695378+0000 mgr.y (mgr.14532) 39 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:03 smithi078 bash[22670]: audit 2024-09-17T08:53:03.527907+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:03 smithi078 bash[22670]: audit 2024-09-17T08:53:03.534815+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:04.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:03 smithi078 bash[32124]: cluster 2024-09-17T08:53:02.695378+0000 mgr.y (mgr.14532) 39 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:04.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:03 smithi078 bash[32124]: audit 2024-09-17T08:53:03.527907+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:03 smithi078 bash[32124]: audit 2024-09-17T08:53:03.534815+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:04.427 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22923]: [17/Sep/2024:08:53:04] ENGINE Bus STOPPING 2024-09-17T08:53:04.723 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:04 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22923]: [17/Sep/2024:08:53:04] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T08:53:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22923]: [17/Sep/2024:08:53:04] ENGINE Bus STOPPED 2024-09-17T08:53:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22923]: [17/Sep/2024:08:53:04] ENGINE Bus STARTING 2024-09-17T08:53:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22923]: [17/Sep/2024:08:53:04] ENGINE Serving on http://:::9283 2024-09-17T08:53:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22923]: [17/Sep/2024:08:53:04] ENGINE Bus STARTED 2024-09-17T08:53:05.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:03.950765+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:03.955573+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:03.956436+0000 mon.a (mon.0) 832 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:53:05.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:03.957065+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:53:05.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:03.961660+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: cephadm 2024-09-17T08:53:03.974146+0000 mgr.y (mgr.14532) 40 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T08:53:05.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:04.086545+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:04.093419+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:04.096732+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T08:53:05.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:04 smithi136 bash[24812]: audit 2024-09-17T08:53:04.106424+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:03.950765+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:03.955573+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:03.956436+0000 mon.a (mon.0) 832 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:53:05.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:03.957065+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:03.961660+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: cephadm 2024-09-17T08:53:03.974146+0000 mgr.y (mgr.14532) 40 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:04.086545+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:04.093419+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:04.096732+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[32124]: audit 2024-09-17T08:53:04.106424+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:03.950765+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:03.955573+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:03.956436+0000 mon.a (mon.0) 832 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:53:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:03.957065+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:53:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:03.961660+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: cephadm 2024-09-17T08:53:03.974146+0000 mgr.y (mgr.14532) 40 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T08:53:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:04.086545+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:04.093419+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:04.096732+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T08:53:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:04 smithi078 bash[22670]: audit 2024-09-17T08:53:04.106424+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:06.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/3132982553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 msgr2=0x7ffa1810c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:06.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/3132982553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa1810c870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009ca0 tx=0x7ffa1002a950 comp rx=0 tx=0).stop 2024-09-17T08:53:06.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/3132982553 shutdown_connections 2024-09-17T08:53:06.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/3132982553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa1810c870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/3132982553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa18101980 0x7ffa18109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/3132982553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa18101060 0x7ffa18101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/3132982553 >> 172.21.15.136:0/3132982553 conn(0x7ffa180faa20 msgr2=0x7ffa180fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:06.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/3132982553 shutdown_connections 2024-09-17T08:53:06.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/3132982553 wait complete. 2024-09-17T08:53:06.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 Processor -- start 2024-09-17T08:53:06.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- start start 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa18101060 0x7ffa18195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa18101980 0x7ffa18195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa18198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa181995a0 con 0x7ffa18101060 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18199710 con 0x7ffa1810a400 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1ebf7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa181998d0 con 0x7ffa18101980 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa18198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa18198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:37656/0 (socket says 172.21.15.136:37656) 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 -- 172.21.15.136:0/791479747 learned_addr learned my addr 172.21.15.136:0/791479747 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-17T08:53:06.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1c993640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa18101060 0x7ffa18195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa17fff640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa18101980 0x7ffa18195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 -- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa18101980 msgr2=0x7ffa18195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa18101980 0x7ffa18195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 -- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa18101060 msgr2=0x7ffa18195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa18101060 0x7ffa18195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 -- 172.21.15.136:0/791479747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10009900 con 0x7ffa1810a400 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1c993640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa18101060 0x7ffa18195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:53:06.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.024+0000 7ffa1d194640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa18198fa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002af40 tx=0x7ffa10003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:06.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa15ffb640 1 -- 172.21.15.136:0/791479747 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1002fd10 con 0x7ffa1810a400 2024-09-17T08:53:06.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa15ffb640 1 -- 172.21.15.136:0/791479747 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7ffa1002fe70 con 0x7ffa1810a400 2024-09-17T08:53:06.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa15ffb640 1 -- 172.21.15.136:0/791479747 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10004610 con 0x7ffa1810a400 2024-09-17T08:53:06.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa18199b50 con 0x7ffa1810a400 2024-09-17T08:53:06.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa181a2330 con 0x7ffa1810a400 2024-09-17T08:53:06.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa180fe250 con 0x7ffa1810a400 2024-09-17T08:53:06.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa15ffb640 1 -- 172.21.15.136:0/791479747 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7ffa1002e050 con 0x7ffa1810a400 2024-09-17T08:53:06.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa15ffb640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ffa0806cec0 0x7ffa0806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:06.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa15ffb640 1 -- 172.21.15.136:0/791479747 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7ffa100ad870 con 0x7ffa1810a400 2024-09-17T08:53:06.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa1c993640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ffa0806cec0 0x7ffa0806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:06.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.028+0000 7ffa1c993640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ffa0806cec0 0x7ffa0806f380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0058c0 tx=0x7ffa0c005850 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:06.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.032+0000 7ffa15ffb640 1 -- 172.21.15.136:0/791479747 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffa100774a0 con 0x7ffa1810a400 2024-09-17T08:53:06.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.280+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ffa18068750 con 0x7ffa1810a400 2024-09-17T08:53:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:05 smithi136 bash[24812]: audit 2024-09-17T08:53:04.097792+0000 mgr.y (mgr.14532) 41 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T08:53:06.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:05 smithi136 bash[24812]: cephadm 2024-09-17T08:53:04.121098+0000 mgr.y (mgr.14532) 42 : cephadm [INF] Deploying daemon grafana.a on smithi136 2024-09-17T08:53:06.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:05 smithi136 bash[24812]: cluster 2024-09-17T08:53:04.696803+0000 mgr.y (mgr.14532) 43 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:06.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.292+0000 7ffa15ffb640 1 -- 172.21.15.136:0/791479747 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7ffa1002c020 con 0x7ffa1810a400 2024-09-17T08:53:06.294 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2024-09-17T08:53:06.294 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQByQ+lmUT0gERAAbxGjfjRpdHni3TrQaXAm9w== 2024-09-17T08:53:06.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ffa0806cec0 msgr2=0x7ffa0806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:06.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ffa0806cec0 0x7ffa0806f380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0058c0 tx=0x7ffa0c005850 comp rx=0 tx=0).stop 2024-09-17T08:53:06.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 msgr2=0x7ffa18198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:06.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa18198fa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002af40 tx=0x7ffa10003f90 comp rx=0 tx=0).stop 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 shutdown_connections 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ffa0806cec0 0x7ffa0806f380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1810a400 0x7ffa18198fa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa18101980 0x7ffa18195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 --2- 172.21.15.136:0/791479747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa18101060 0x7ffa18195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 >> 172.21.15.136:0/791479747 conn(0x7ffa180faa20 msgr2=0x7ffa18101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 shutdown_connections 2024-09-17T08:53:06.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-17T08:53:06.296+0000 7ffa1ebf7640 1 -- 172.21.15.136:0/791479747 wait complete. 2024-09-17T08:53:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:05 smithi078 bash[32124]: audit 2024-09-17T08:53:04.097792+0000 mgr.y (mgr.14532) 41 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T08:53:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:05 smithi078 bash[32124]: cephadm 2024-09-17T08:53:04.121098+0000 mgr.y (mgr.14532) 42 : cephadm [INF] Deploying daemon grafana.a on smithi136 2024-09-17T08:53:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:05 smithi078 bash[32124]: cluster 2024-09-17T08:53:04.696803+0000 mgr.y (mgr.14532) 43 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:05 smithi078 bash[22670]: audit 2024-09-17T08:53:04.097792+0000 mgr.y (mgr.14532) 41 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T08:53:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:05 smithi078 bash[22670]: cephadm 2024-09-17T08:53:04.121098+0000 mgr.y (mgr.14532) 42 : cephadm [INF] Deploying daemon grafana.a on smithi136 2024-09-17T08:53:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:05 smithi078 bash[22670]: cluster 2024-09-17T08:53:04.696803+0000 mgr.y (mgr.14532) 43 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:07.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:06 smithi136 bash[24812]: audit 2024-09-17T08:53:06.287012+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:53:07.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:06 smithi136 bash[24812]: audit 2024-09-17T08:53:06.288097+0000 mon.b (mon.1) 33 : audit [INF] from='client.? 172.21.15.136:0/791479747' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:53:07.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:06 smithi136 bash[24812]: audit 2024-09-17T08:53:06.297066+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T08:53:07.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:06 smithi136 bash[24812]: audit 2024-09-17T08:53:06.841981+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:07.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[32124]: audit 2024-09-17T08:53:06.287012+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:53:07.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[32124]: audit 2024-09-17T08:53:06.288097+0000 mon.b (mon.1) 33 : audit [INF] from='client.? 172.21.15.136:0/791479747' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:53:07.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[32124]: audit 2024-09-17T08:53:06.297066+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T08:53:07.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[32124]: audit 2024-09-17T08:53:06.841981+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[22670]: audit 2024-09-17T08:53:06.287012+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:53:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[22670]: audit 2024-09-17T08:53:06.288097+0000 mon.b (mon.1) 33 : audit [INF] from='client.? 172.21.15.136:0/791479747' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T08:53:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[22670]: audit 2024-09-17T08:53:06.297066+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T08:53:07.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:06 smithi078 bash[22670]: audit 2024-09-17T08:53:06.841981+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:07.569 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-17T08:53:07.569 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T08:53:07.569 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T08:53:07.595 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T08:53:07.596 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T08:53:07.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T08:53:08.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:07 smithi136 bash[24812]: cluster 2024-09-17T08:53:06.697477+0000 mgr.y (mgr.14532) 44 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:08.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:07 smithi078 bash[32124]: cluster 2024-09-17T08:53:06.697477+0000 mgr.y (mgr.14532) 44 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:08.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:07 smithi078 bash[22670]: cluster 2024-09-17T08:53:06.697477+0000 mgr.y (mgr.14532) 44 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:09.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:53:10.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:09 smithi078 bash[22670]: cluster 2024-09-17T08:53:08.698950+0000 mgr.y (mgr.14532) 45 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:09 smithi078 bash[32124]: cluster 2024-09-17T08:53:08.698950+0000 mgr.y (mgr.14532) 45 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:10.102 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:09 smithi078 bash[58769]: ts=2024-09-17T08:53:09.751Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003748268s 2024-09-17T08:53:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:09 smithi136 bash[24812]: cluster 2024-09-17T08:53:08.698950+0000 mgr.y (mgr.14532) 45 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:11.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:10 smithi136 bash[24812]: audit 2024-09-17T08:53:09.115202+0000 mgr.y (mgr.14532) 46 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:11.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:10 smithi078 bash[22670]: audit 2024-09-17T08:53:09.115202+0000 mgr.y (mgr.14532) 46 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:10 smithi078 bash[32124]: audit 2024-09-17T08:53:09.115202+0000 mgr.y (mgr.14532) 46 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:11 smithi136 bash[24812]: cluster 2024-09-17T08:53:10.699629+0000 mgr.y (mgr.14532) 47 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:12.347 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:12.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:11 smithi078 bash[22670]: cluster 2024-09-17T08:53:10.699629+0000 mgr.y (mgr.14532) 47 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:12.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:11 smithi078 bash[32124]: cluster 2024-09-17T08:53:10.699629+0000 mgr.y (mgr.14532) 47 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:14.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:13 smithi078 bash[22670]: cluster 2024-09-17T08:53:12.700339+0000 mgr.y (mgr.14532) 48 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:14.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:13 smithi078 bash[32124]: cluster 2024-09-17T08:53:12.700339+0000 mgr.y (mgr.14532) 48 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:14.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:13 smithi136 bash[24812]: cluster 2024-09-17T08:53:12.700339+0000 mgr.y (mgr.14532) 48 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- 172.21.15.78:0/371587832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb010c480 msgr2=0x7fadb010c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 --2- 172.21.15.78:0/371587832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb010c480 0x7fadb010c860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fada4009930 tx=0x7fada402a420 comp rx=0 tx=0).stop 2024-09-17T08:53:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- 172.21.15.78:0/371587832 shutdown_connections 2024-09-17T08:53:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 --2- 172.21.15.78:0/371587832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb0106d90 0x7fadb01132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 --2- 172.21.15.78:0/371587832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb01063f0 0x7fadb0106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 --2- 172.21.15.78:0/371587832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb010c480 0x7fadb010c860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- 172.21.15.78:0/371587832 >> 172.21.15.78:0/371587832 conn(0x7fadb0075e10 msgr2=0x7fadb0078230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- 172.21.15.78:0/371587832 shutdown_connections 2024-09-17T08:53:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- 172.21.15.78:0/371587832 wait complete. 2024-09-17T08:53:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 Processor -- start 2024-09-17T08:53:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- start start 2024-09-17T08:53:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb01063f0 0x7fadb019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb0106d90 0x7fadb019c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb010c480 0x7fadb01a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb01a0d30 con 0x7fadb01063f0 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb01a0ea0 con 0x7fadb010c480 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb6cac640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb01a1010 con 0x7fadb0106d90 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadaffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb0106d90 0x7fadb019c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadb4a48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb01063f0 0x7fadb019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadaffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb0106d90 0x7fadb019c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:37436/0 (socket says 172.21.15.78:37436) 2024-09-17T08:53:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.387+0000 7fadaffff640 1 -- 172.21.15.78:0/2074599476 learned_addr learned my addr 172.21.15.78:0/2074599476 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadb5249640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb010c480 0x7fadb01a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadaffff640 1 -- 172.21.15.78:0/2074599476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb010c480 msgr2=0x7fadb01a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadaffff640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb010c480 0x7fadb01a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadaffff640 1 -- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb01063f0 msgr2=0x7fadb019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadaffff640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb01063f0 0x7fadb019bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadaffff640 1 -- 172.21.15.78:0/2074599476 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c009490 con 0x7fadb0106d90 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadaffff640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb0106d90 0x7fadb019c330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00ea60 tx=0x7fad9c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadadffb640 1 -- 172.21.15.78:0/2074599476 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00cde0 con 0x7fadb0106d90 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada4009560 con 0x7fadb0106d90 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadadffb640 1 -- 172.21.15.78:0/2074599476 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fad9c004470 con 0x7fadb0106d90 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadadffb640 1 -- 172.21.15.78:0/2074599476 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c010430 con 0x7fadb0106d90 2024-09-17T08:53:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb01a89e0 con 0x7fadb0106d90 2024-09-17T08:53:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb0107b30 con 0x7fadb0106d90 2024-09-17T08:53:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadadffb640 1 -- 172.21.15.78:0/2074599476 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fad9c003f00 con 0x7fadb0106d90 2024-09-17T08:53:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadadffb640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fada006cec0 0x7fada006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadadffb640 1 -- 172.21.15.78:0/2074599476 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fad9c014070 con 0x7fadb0106d90 2024-09-17T08:53:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadb4a48640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fada006cec0 0x7fada006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.391+0000 7fadb4a48640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fada006cec0 0x7fada006f380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fada4005ec0 tx=0x7fada4005a20 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:15.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.395+0000 7fadadffb640 1 -- 172.21.15.78:0/2074599476 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad9c056b80 con 0x7fadb0106d90 2024-09-17T08:53:15.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.619+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fadb019d150 con 0x7fadb0106d90 2024-09-17T08:53:15.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.623+0000 7fadadffb640 1 -- 172.21.15.78:0/2074599476 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+173984 (secure 0 0 0) 0x7fad9c05a1a0 con 0x7fadb0106d90 2024-09-17T08:53:15.629 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fada006cec0 msgr2=0x7fada006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fada006cec0 0x7fada006f380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fada4005ec0 tx=0x7fada4005a20 comp rx=0 tx=0).stop 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb0106d90 msgr2=0x7fadb019c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb0106d90 0x7fadb019c330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00ea60 tx=0x7fad9c00ef20 comp rx=0 tx=0).stop 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 shutdown_connections 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fada006cec0 0x7fada006f380 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadb010c480 0x7fadb01a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb0106d90 0x7fadb019c330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 --2- 172.21.15.78:0/2074599476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb01063f0 0x7fadb019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 >> 172.21.15.78:0/2074599476 conn(0x7fadb0075e10 msgr2=0x7fadb00761f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 shutdown_connections 2024-09-17T08:53:15.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:15.627+0000 7fadb6cac640 1 -- 172.21.15.78:0/2074599476 wait complete. 2024-09-17T08:53:16.228 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"flags":0,"active_gid":14532,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1209266769},{"type":"v1","addr":"172.21.15.78:6801","nonce":1209266769}]},"active_addr":"172.21.15.78:6801/1209266769","active_change":"2024-09-17T08:52:36.657067+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24427,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.78:8443/","prometheus":"http://172.21.15.78:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":75,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3620397825}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1229393810}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1882210438}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1314158451}]}]} 2024-09-17T08:53:16.233 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T08:53:16.233 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T08:53:16.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T08:53:16.244 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:15 smithi078 bash[32124]: cluster 2024-09-17T08:53:14.701836+0000 mgr.y (mgr.14532) 49 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:16.244 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:15 smithi078 bash[32124]: audit 2024-09-17T08:53:15.625446+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.78:0/2074599476' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T08:53:16.244 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:15 smithi078 bash[22670]: cluster 2024-09-17T08:53:14.701836+0000 mgr.y (mgr.14532) 49 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:16.245 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:15 smithi078 bash[22670]: audit 2024-09-17T08:53:15.625446+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.78:0/2074599476' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T08:53:16.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:15 smithi136 bash[24812]: cluster 2024-09-17T08:53:14.701836+0000 mgr.y (mgr.14532) 49 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:16.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:15 smithi136 bash[24812]: audit 2024-09-17T08:53:15.625446+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.78:0/2074599476' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T08:53:18.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:17 smithi136 bash[24812]: cluster 2024-09-17T08:53:16.702511+0000 mgr.y (mgr.14532) 50 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:18.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:17 smithi078 bash[22670]: cluster 2024-09-17T08:53:16.702511+0000 mgr.y (mgr.14532) 50 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:18.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:17 smithi078 bash[32124]: cluster 2024-09-17T08:53:16.702511+0000 mgr.y (mgr.14532) 50 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:19.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:53:20.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:19 smithi136 bash[24812]: cluster 2024-09-17T08:53:18.703937+0000 mgr.y (mgr.14532) 51 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:19 smithi078 bash[22670]: cluster 2024-09-17T08:53:18.703937+0000 mgr.y (mgr.14532) 51 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:20.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:19 smithi078 bash[32124]: cluster 2024-09-17T08:53:18.703937+0000 mgr.y (mgr.14532) 51 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:20.967 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:21.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:21 smithi136 bash[24812]: audit 2024-09-17T08:53:19.123216+0000 mgr.y (mgr.14532) 52 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:21 smithi078 bash[22670]: audit 2024-09-17T08:53:19.123216+0000 mgr.y (mgr.14532) 52 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:21.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:21 smithi078 bash[32124]: audit 2024-09-17T08:53:19.123216+0000 mgr.y (mgr.14532) 52 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:22.267 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:22 smithi078 bash[22670]: cluster 2024-09-17T08:53:20.704649+0000 mgr.y (mgr.14532) 53 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:22.267 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:22 smithi078 bash[22670]: audit 2024-09-17T08:53:21.868178+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:22.267 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:22 smithi078 bash[32124]: cluster 2024-09-17T08:53:20.704649+0000 mgr.y (mgr.14532) 53 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:22.267 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:22 smithi078 bash[32124]: audit 2024-09-17T08:53:21.868178+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:22.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:22 smithi136 bash[24812]: cluster 2024-09-17T08:53:20.704649+0000 mgr.y (mgr.14532) 53 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:22.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:22 smithi136 bash[24812]: audit 2024-09-17T08:53:21.868178+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- 172.21.15.78:0/1721978525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2701005f0 msgr2=0x7fb270104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 --2- 172.21.15.78:0/1721978525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2701005f0 0x7fb270104a30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb260009890 tx=0x7fb26002a360 comp rx=0 tx=0).stop 2024-09-17T08:53:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- 172.21.15.78:0/1721978525 shutdown_connections 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 --2- 172.21.15.78:0/1721978525 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb270105160 0x7fb27010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 --2- 172.21.15.78:0/1721978525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2701005f0 0x7fb270104a30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 --2- 172.21.15.78:0/1721978525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700ffc40 0x7fb270100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- 172.21.15.78:0/1721978525 >> 172.21.15.78:0/1721978525 conn(0x7fb270074200 msgr2=0x7fb270074610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- 172.21.15.78:0/1721978525 shutdown_connections 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- 172.21.15.78:0/1721978525 wait complete. 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 Processor -- start 2024-09-17T08:53:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- start start 2024-09-17T08:53:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2700ffc40 0x7fb270195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2701005f0 0x7fb270195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb270105160 0x7fb270198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2701995f0 con 0x7fb2700ffc40 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb270199760 con 0x7fb2701005f0 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb270199920 con 0x7fb270105160 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb274cf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2700ffc40 0x7fb270195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb2754f6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb270105160 0x7fb270198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb274cf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2700ffc40 0x7fb270195760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59736/0 (socket says 172.21.15.78:59736) 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb274cf5640 1 -- 172.21.15.78:0/1249400624 learned_addr learned my addr 172.21.15.78:0/1249400624 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb267fff640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2701005f0 0x7fb270195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb2754f6640 1 -- 172.21.15.78:0/1249400624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2701005f0 msgr2=0x7fb270195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb2754f6640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2701005f0 0x7fb270195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb2754f6640 1 -- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2700ffc40 msgr2=0x7fb270195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb2754f6640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2700ffc40 0x7fb270195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb2754f6640 1 -- 172.21.15.78:0/1249400624 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268009900 con 0x7fb270105160 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb274cf5640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2700ffc40 0x7fb270195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb2754f6640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb270105160 0x7fb270198ff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb26800efc0 tx=0x7fb26800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb265ffb640 1 -- 172.21.15.78:0/1249400624 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268003970 con 0x7fb270105160 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb265ffb640 1 -- 172.21.15.78:0/1249400624 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fb268004020 con 0x7fb270105160 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb276f59640 1 -- 172.21.15.78:0/1249400624 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb260009490 con 0x7fb270105160 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.783+0000 7fb265ffb640 1 -- 172.21.15.78:0/1249400624 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800b850 con 0x7fb270105160 2024-09-17T08:53:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.787+0000 7fb276f59640 1 -- 172.21.15.78:0/1249400624 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2701a2380 con 0x7fb270105160 2024-09-17T08:53:23.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.787+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb250005040 con 0x7fb270105160 2024-09-17T08:53:23.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.787+0000 7fb265ffb640 1 -- 172.21.15.78:0/1249400624 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fb26800a040 con 0x7fb270105160 2024-09-17T08:53:23.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.787+0000 7fb265ffb640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb25806cec0 0x7fb25806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:23.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.787+0000 7fb265ffb640 1 -- 172.21.15.78:0/1249400624 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fb26808ca40 con 0x7fb270105160 2024-09-17T08:53:23.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.787+0000 7fb274cf5640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb25806cec0 0x7fb25806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:23.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.787+0000 7fb274cf5640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb25806cec0 0x7fb25806f380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00f4d0 tx=0x7fb26c00a380 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.791+0000 7fb265ffb640 1 -- 172.21.15.78:0/1249400624 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb26808ee60 con 0x7fb270105160 2024-09-17T08:53:23.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.967+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2500055c0 con 0x7fb270105160 2024-09-17T08:53:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.967+0000 7fb265ffb640 1 -- 172.21.15.78:0/1249400624 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+22999 (secure 0 0 0) 0x7fb268056670 con 0x7fb270105160 2024-09-17T08:53:23.971 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:53:23.971 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":75,"fsid":"7121dba6-74d0-11ef-bceb-c7b262605968","created":"2024-09-17T08:41:29.091359+0000","modified":"2024-09-17T08:52:36.656721+0000","last_up_change":"2024-09-17T08:51:02.190193+0000","last_in_change":"2024-09-17T08:50:36.098438+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T08:46:46.674639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-17T08:51:40.215569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-17T08:51:41.927190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-09-17T08:51:43.955364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"datapool","create_time":"2024-09-17T08:51:44.358440+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-17T08:51:46.259035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd390083-c887-4412-9871-258ea390ed44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6803","nonce":2443355414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6805","nonce":2443355414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6809","nonce":2443355414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6807","nonce":2443355414}]},"public_addr":"172.21.15.78:6803/2443355414","cluster_addr":"172.21.15.78:6805/2443355414","heartbeat_back_addr":"172.21.15.78:6809/2443355414","heartbeat_front_addr":"172.21.15.78:6807/2443355414","state":["exists","up"]},{"osd":1,"uuid":"df02033a-c192-474c-8e90-ad746ec2147c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6811","nonce":4126079653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6813","nonce":4126079653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6817","nonce":4126079653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6815","nonce":4126079653}]},"public_addr":"172.21.15.78:6811/4126079653","cluster_addr":"172.21.15.78:6813/4126079653","heartbeat_back_addr":"172.21.15.78:6817/4126079653","heartbeat_front_addr":"172.21.15.78:6815/4126079653","state":["exists","up"]},{"osd":2,"uuid":"40d1111b-74f6-4d54-a1ab-d64ba1a626d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6819","nonce":671761081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6821","nonce":671761081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6825","nonce":671761081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6823","nonce":671761081}]},"public_addr":"172.21.15.78:6819/671761081","cluster_addr":"172.21.15.78:6821/671761081","heartbeat_back_addr":"172.21.15.78:6825/671761081","heartbeat_front_addr":"172.21.15.78:6823/671761081","state":["exists","up"]},{"osd":3,"uuid":"5abaea7b-fc8a-4cea-8b72-19fda0086dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6827","nonce":2849516131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6829","nonce":2849516131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6833","nonce":2849516131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6831","nonce":2849516131}]},"public_addr":"172.21.15.78:6827/2849516131","cluster_addr":"172.21.15.78:6829/2849516131","heartbeat_back_addr":"172.21.15.78:6833/2849516131","heartbeat_front_addr":"172.21.15.78:6831/2849516131","state":["exists","up"]},{"osd":4,"uuid":"baf3a9a4-6777-4698-9a2d-92e24e144473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6801","nonce":3532303027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6803","nonce":3532303027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6807","nonce":3532303027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6805","nonce":3532303027}]},"public_addr":"172.21.15.136:6801/3532303027","cluster_addr":"172.21.15.136:6803/3532303027","heartbeat_back_addr":"172.21.15.136:6807/3532303027","heartbeat_front_addr":"172.21.15.136:6805/3532303027","state":["exists","up"]},{"osd":5,"uuid":"3d3392e2-86a8-480b-9bdd-b4fe43046626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6809","nonce":3791268694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6811","nonce":3791268694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6815","nonce":3791268694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6813","nonce":3791268694}]},"public_addr":"172.21.15.136:6809/3791268694","cluster_addr":"172.21.15.136:6811/3791268694","heartbeat_back_addr":"172.21.15.136:6815/3791268694","heartbeat_front_addr":"172.21.15.136:6813/3791268694","state":["exists","up"]},{"osd":6,"uuid":"60c90e5d-be39-43a6-bfc9-63078abe1459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6817","nonce":456908616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6819","nonce":456908616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6823","nonce":456908616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6821","nonce":456908616}]},"public_addr":"172.21.15.136:6817/456908616","cluster_addr":"172.21.15.136:6819/456908616","heartbeat_back_addr":"172.21.15.136:6823/456908616","heartbeat_front_addr":"172.21.15.136:6821/456908616","state":["exists","up"]},{"osd":7,"uuid":"1efbd419-346f-4371-9e11-ab0e006c195b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6825","nonce":339955563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6827","nonce":339955563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6831","nonce":339955563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6829","nonce":339955563}]},"public_addr":"172.21.15.136:6825/339955563","cluster_addr":"172.21.15.136:6827/339955563","heartbeat_back_addr":"172.21.15.136:6831/339955563","heartbeat_front_addr":"172.21.15.136:6829/339955563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:44:57.870041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:45:50.021659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:46:43.001282+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:47:35.822754+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:48:25.595972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:49:17.170749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:50:08.875696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:51:00.599747+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/519935217":"2024-09-18T08:52:36.656628+0000","172.21.15.78:6800/2295189925":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/2684428196":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/882986129":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/2714442386":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/1382206719":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/3522572920":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/2034125281":"2024-09-18T08:41:56.432451+0000","172.21.15.78:6801/2295189925":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/952016135":"2024-09-18T08:42:28.063929+0000","172.21.15.78:6800/2109055855":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/2393209611":"2024-09-18T08:52:36.656628+0000","172.21.15.78:6801/3976204901":"2024-09-18T08:41:56.432451+0000","172.21.15.78:6801/2109055855":"2024-09-18T08:42:28.063929+0000","172.21.15.78:6800/3976204901":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/4006917361":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/3486841101":"2024-09-18T08:52:36.656628+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T08:53:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb25806cec0 msgr2=0x7fb25806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb25806cec0 0x7fb25806f380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00f4d0 tx=0x7fb26c00a380 comp rx=0 tx=0).stop 2024-09-17T08:53:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb270105160 msgr2=0x7fb270198ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb270105160 0x7fb270198ff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb26800efc0 tx=0x7fb26800c800 comp rx=0 tx=0).stop 2024-09-17T08:53:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 shutdown_connections 2024-09-17T08:53:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb25806cec0 0x7fb25806f380 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb270105160 0x7fb270198ff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2701005f0 0x7fb270195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 --2- 172.21.15.78:0/1249400624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2700ffc40 0x7fb270195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 >> 172.21.15.78:0/1249400624 conn(0x7fb270074200 msgr2=0x7fb2700fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 shutdown_connections 2024-09-17T08:53:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:23.971+0000 7fb2577fe640 1 -- 172.21.15.78:0/1249400624 wait complete. 2024-09-17T08:53:24.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:24 smithi136 bash[24812]: cluster 2024-09-17T08:53:22.705126+0000 mgr.y (mgr.14532) 54 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:24.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:24 smithi136 bash[24812]: audit 2024-09-17T08:53:23.971627+0000 mon.c (mon.2) 23 : audit [DBG] from='client.? 172.21.15.78:0/1249400624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:53:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:24 smithi078 bash[22670]: cluster 2024-09-17T08:53:22.705126+0000 mgr.y (mgr.14532) 54 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:24 smithi078 bash[22670]: audit 2024-09-17T08:53:23.971627+0000 mon.c (mon.2) 23 : audit [DBG] from='client.? 172.21.15.78:0/1249400624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:53:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:24 smithi078 bash[32124]: cluster 2024-09-17T08:53:22.705126+0000 mgr.y (mgr.14532) 54 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:24 smithi078 bash[32124]: audit 2024-09-17T08:53:23.971627+0000 mon.c (mon.2) 23 : audit [DBG] from='client.? 172.21.15.78:0/1249400624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:53:24.635 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T08:53:24.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T08:53:25.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:25 smithi136 bash[24812]: cluster 2024-09-17T08:53:24.705984+0000 mgr.y (mgr.14532) 55 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:25.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:25 smithi078 bash[32124]: cluster 2024-09-17T08:53:24.705984+0000 mgr.y (mgr.14532) 55 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:25 smithi078 bash[22670]: cluster 2024-09-17T08:53:24.705984+0000 mgr.y (mgr.14532) 55 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:28.012 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:27 smithi136 bash[24812]: cluster 2024-09-17T08:53:26.706645+0000 mgr.y (mgr.14532) 56 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:28.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:27 smithi078 bash[22670]: cluster 2024-09-17T08:53:26.706645+0000 mgr.y (mgr.14532) 56 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:28.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:27 smithi078 bash[32124]: cluster 2024-09-17T08:53:26.706645+0000 mgr.y (mgr.14532) 56 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:29.423 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:29.519 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:53:29.791 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.791 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.792 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.792 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.792 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.792 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:29 smithi136 bash[24812]: cluster 2024-09-17T08:53:28.708092+0000 mgr.y (mgr.14532) 57 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:29.793 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.793 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:29.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:29 smithi078 bash[22670]: cluster 2024-09-17T08:53:28.708092+0000 mgr.y (mgr.14532) 57 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:29.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:29 smithi078 bash[32124]: cluster 2024-09-17T08:53:28.708092+0000 mgr.y (mgr.14532) 57 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:30.050 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.050 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.051 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.051 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.051 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.052 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.052 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.052 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:29 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T08:53:30.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:30 smithi136 systemd[1]: Started Ceph grafana.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:53:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:29.134589+0000 mgr.y (mgr.14532) 58 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:30.095810+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:30.105782+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:30.114403+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:30.122145+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:30.179391+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:53:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:30.523471+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[22670]: audit 2024-09-17T08:53:30.529911+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:29.134589+0000 mgr.y (mgr.14532) 58 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:30.095810+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:30.105782+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:30.114403+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:30.122145+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:30.179391+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:30.523471+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:30 smithi078 bash[32124]: audit 2024-09-17T08:53:30.529911+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:29.134589+0000 mgr.y (mgr.14532) 58 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:30.095810+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:30.105782+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:30.114403+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:30.122145+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:30.179391+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:30.523471+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:31.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:30 smithi136 bash[24812]: audit 2024-09-17T08:53:30.529911+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:31.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.321996Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-09-17T08:53:31.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322195178Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-09-17T08:53:31.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322217775Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-17T08:53:31.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322226463Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-17T08:53:31.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322241791Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322258053Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322270711Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322285957Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322298578Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322315626Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322327408Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322337989Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322348971Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=settings t=2024-09-17T08:53:31.322360065Z level=info msg="App mode production" 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=sqlstore t=2024-09-17T08:53:31.322444227Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=sqlstore t=2024-09-17T08:53:31.322472275Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.323822995Z level=info msg="Starting DB migrations" 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.323914057Z level=info msg="Executing migration" id="create migration_log table" 2024-09-17T08:53:31.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.392116166Z level=info msg="Executing migration" id="create user table" 2024-09-17T08:53:31.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.417183257Z level=info msg="Executing migration" id="add unique index user.login" 2024-09-17T08:53:31.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.442520027Z level=info msg="Executing migration" id="add unique index user.email" 2024-09-17T08:53:31.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.468005665Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-09-17T08:53:31.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.493560631Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-09-17T08:53:31.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.518724207Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-17T08:53:31.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.543990369Z level=info msg="Executing migration" id="create user table v2" 2024-09-17T08:53:31.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.586146017Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-17T08:53:31.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.611379694Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-17T08:53:31.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.653472985Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-17T08:53:31.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.678669352Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-17T08:53:31.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.703945198Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-17T08:53:31.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.745806863Z level=info msg="Executing migration" id="Update user table charset" 2024-09-17T08:53:31.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.787930019Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-17T08:53:31.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.829922972Z level=info msg="Executing migration" id="Add missing user data" 2024-09-17T08:53:31.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[24812]: cluster 2024-09-17T08:53:30.708512+0000 mgr.y (mgr.14532) 59 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:32.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:31 smithi078 bash[22670]: cluster 2024-09-17T08:53:30.708512+0000 mgr.y (mgr.14532) 59 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:32.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:31 smithi078 bash[32124]: cluster 2024-09-17T08:53:30.708512+0000 mgr.y (mgr.14532) 59 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:32.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.855290526Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-17T08:53:32.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.8722904Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-17T08:53:32.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.897575729Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-17T08:53:32.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.922865381Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.948158143Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:31 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:31.990237367Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.032282113Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.049080373Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.0660901Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.083055059Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.099914494Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-17T08:53:32.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.116857916Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-17T08:53:32.374 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.133907264Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-17T08:53:32.374 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.15922984Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-17T08:53:32.374 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.201097547Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-17T08:53:32.374 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.226545873Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-17T08:53:32.374 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.252050105Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-17T08:53:32.375 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.277274207Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-17T08:53:32.375 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.294248846Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-17T08:53:32.375 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.311166126Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-17T08:53:32.375 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.328196103Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-17T08:53:32.375 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.361732059Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-17T08:53:32.375 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.378682305Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- 172.21.15.78:0/323589405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102bd0 msgr2=0x7f03bc106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 --2- 172.21.15.78:0/323589405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102bd0 0x7f03bc106c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009cd0 tx=0x7f03ac02a8e0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- 172.21.15.78:0/323589405 shutdown_connections 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 --2- 172.21.15.78:0/323589405 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03bc107350 0x7f03bc10eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 --2- 172.21.15.78:0/323589405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102bd0 0x7f03bc106c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 --2- 172.21.15.78:0/323589405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03bc102220 0x7f03bc102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- 172.21.15.78:0/323589405 >> 172.21.15.78:0/323589405 conn(0x7f03bc0fdca0 msgr2=0x7f03bc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- 172.21.15.78:0/323589405 shutdown_connections 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- 172.21.15.78:0/323589405 wait complete. 2024-09-17T08:53:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 Processor -- start 2024-09-17T08:53:32.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- start start 2024-09-17T08:53:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102220 0x7f03bc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03bc102bd0 0x7f03bc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03bc107350 0x7f03bc197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc197e00 con 0x7f03bc102220 2024-09-17T08:53:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc197f70 con 0x7f03bc107350 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c2769640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc198130 con 0x7f03bc102bd0 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102220 0x7f03bc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102220 0x7f03bc19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59756/0 (socket says 172.21.15.78:59756) 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 -- 172.21.15.78:0/1526161421 learned_addr learned my addr 172.21.15.78:0/1526161421 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bb7fe640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03bc102bd0 0x7f03bc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03c0d06640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03bc107350 0x7f03bc197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 -- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03bc102bd0 msgr2=0x7f03bc19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03bc102bd0 0x7f03bc19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 -- 172.21.15.78:0/1526161421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03bc107350 msgr2=0x7f03bc197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03bc107350 0x7f03bc197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.443+0000 7f03bbfff640 1 -- 172.21.15.78:0/1526161421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4009490 con 0x7f03bc102220 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03bbfff640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102220 0x7f03bc19d680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c890 tx=0x7f03a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03b97fa640 1 -- 172.21.15.78:0/1526161421 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4004220 con 0x7f03bc102220 2024-09-17T08:53:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03b97fa640 1 -- 172.21.15.78:0/1526161421 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f03a4007e00 con 0x7f03bc102220 2024-09-17T08:53:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac009900 con 0x7f03bc102220 2024-09-17T08:53:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03b97fa640 1 -- 172.21.15.78:0/1526161421 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40047a0 con 0x7f03bc102220 2024-09-17T08:53:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc1a44e0 con 0x7f03bc102220 2024-09-17T08:53:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc103700 con 0x7f03bc102220 2024-09-17T08:53:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03b97fa640 1 -- 172.21.15.78:0/1526161421 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f03a40079b0 con 0x7f03bc102220 2024-09-17T08:53:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03b97fa640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f03a806cec0 0x7f03a806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03b97fa640 1 -- 172.21.15.78:0/1526161421 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f03a408c740 con 0x7f03bc102220 2024-09-17T08:53:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03bb7fe640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f03a806cec0 0x7f03a806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.447+0000 7f03bb7fe640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f03a806cec0 0x7f03a806f380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03ac02aed0 tx=0x7f03ac004a60 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:32.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.451+0000 7f03b97fa640 1 -- 172.21.15.78:0/1526161421 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03a4056420 con 0x7f03bc102220 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.403970152Z level=info msg="Executing migration" id="create star table" 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.445933756Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.488079361Z level=info msg="Executing migration" id="create org table v1" 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.513164685Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.538611159Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.563834397Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.605888726Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-17T08:53:32.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.631194696Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-17T08:53:32.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.627+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03bc10a590 con 0x7f03bc102220 2024-09-17T08:53:32.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03b97fa640 1 -- 172.21.15.78:0/1526161421 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+22999 (secure 0 0 0) 0x7f03a4007c60 con 0x7f03bc102220 2024-09-17T08:53:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:53:32.633 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":75,"fsid":"7121dba6-74d0-11ef-bceb-c7b262605968","created":"2024-09-17T08:41:29.091359+0000","modified":"2024-09-17T08:52:36.656721+0000","last_up_change":"2024-09-17T08:51:02.190193+0000","last_in_change":"2024-09-17T08:50:36.098438+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T08:46:46.674639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-17T08:51:40.215569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-17T08:51:41.927190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-09-17T08:51:43.955364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"datapool","create_time":"2024-09-17T08:51:44.358440+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-17T08:51:46.259035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd390083-c887-4412-9871-258ea390ed44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6803","nonce":2443355414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6805","nonce":2443355414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6809","nonce":2443355414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2443355414},{"type":"v1","addr":"172.21.15.78:6807","nonce":2443355414}]},"public_addr":"172.21.15.78:6803/2443355414","cluster_addr":"172.21.15.78:6805/2443355414","heartbeat_back_addr":"172.21.15.78:6809/2443355414","heartbeat_front_addr":"172.21.15.78:6807/2443355414","state":["exists","up"]},{"osd":1,"uuid":"df02033a-c192-474c-8e90-ad746ec2147c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6811","nonce":4126079653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6813","nonce":4126079653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6817","nonce":4126079653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":4126079653},{"type":"v1","addr":"172.21.15.78:6815","nonce":4126079653}]},"public_addr":"172.21.15.78:6811/4126079653","cluster_addr":"172.21.15.78:6813/4126079653","heartbeat_back_addr":"172.21.15.78:6817/4126079653","heartbeat_front_addr":"172.21.15.78:6815/4126079653","state":["exists","up"]},{"osd":2,"uuid":"40d1111b-74f6-4d54-a1ab-d64ba1a626d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6819","nonce":671761081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6821","nonce":671761081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6825","nonce":671761081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":671761081},{"type":"v1","addr":"172.21.15.78:6823","nonce":671761081}]},"public_addr":"172.21.15.78:6819/671761081","cluster_addr":"172.21.15.78:6821/671761081","heartbeat_back_addr":"172.21.15.78:6825/671761081","heartbeat_front_addr":"172.21.15.78:6823/671761081","state":["exists","up"]},{"osd":3,"uuid":"5abaea7b-fc8a-4cea-8b72-19fda0086dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6827","nonce":2849516131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6829","nonce":2849516131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6833","nonce":2849516131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2849516131},{"type":"v1","addr":"172.21.15.78:6831","nonce":2849516131}]},"public_addr":"172.21.15.78:6827/2849516131","cluster_addr":"172.21.15.78:6829/2849516131","heartbeat_back_addr":"172.21.15.78:6833/2849516131","heartbeat_front_addr":"172.21.15.78:6831/2849516131","state":["exists","up"]},{"osd":4,"uuid":"baf3a9a4-6777-4698-9a2d-92e24e144473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6801","nonce":3532303027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6803","nonce":3532303027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6807","nonce":3532303027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3532303027},{"type":"v1","addr":"172.21.15.136:6805","nonce":3532303027}]},"public_addr":"172.21.15.136:6801/3532303027","cluster_addr":"172.21.15.136:6803/3532303027","heartbeat_back_addr":"172.21.15.136:6807/3532303027","heartbeat_front_addr":"172.21.15.136:6805/3532303027","state":["exists","up"]},{"osd":5,"uuid":"3d3392e2-86a8-480b-9bdd-b4fe43046626","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6809","nonce":3791268694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6811","nonce":3791268694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6815","nonce":3791268694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3791268694},{"type":"v1","addr":"172.21.15.136:6813","nonce":3791268694}]},"public_addr":"172.21.15.136:6809/3791268694","cluster_addr":"172.21.15.136:6811/3791268694","heartbeat_back_addr":"172.21.15.136:6815/3791268694","heartbeat_front_addr":"172.21.15.136:6813/3791268694","state":["exists","up"]},{"osd":6,"uuid":"60c90e5d-be39-43a6-bfc9-63078abe1459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6817","nonce":456908616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6819","nonce":456908616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6823","nonce":456908616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":456908616},{"type":"v1","addr":"172.21.15.136:6821","nonce":456908616}]},"public_addr":"172.21.15.136:6817/456908616","cluster_addr":"172.21.15.136:6819/456908616","heartbeat_back_addr":"172.21.15.136:6823/456908616","heartbeat_front_addr":"172.21.15.136:6821/456908616","state":["exists","up"]},{"osd":7,"uuid":"1efbd419-346f-4371-9e11-ab0e006c195b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6825","nonce":339955563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6827","nonce":339955563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6831","nonce":339955563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":339955563},{"type":"v1","addr":"172.21.15.136:6829","nonce":339955563}]},"public_addr":"172.21.15.136:6825/339955563","cluster_addr":"172.21.15.136:6827/339955563","heartbeat_back_addr":"172.21.15.136:6831/339955563","heartbeat_front_addr":"172.21.15.136:6829/339955563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:44:57.870041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:45:50.021659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:46:43.001282+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:47:35.822754+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:48:25.595972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:49:17.170749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:50:08.875696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T08:51:00.599747+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:0/519935217":"2024-09-18T08:52:36.656628+0000","172.21.15.78:6800/2295189925":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/2684428196":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/882986129":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/2714442386":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/1382206719":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/3522572920":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/2034125281":"2024-09-18T08:41:56.432451+0000","172.21.15.78:6801/2295189925":"2024-09-18T08:52:36.656628+0000","172.21.15.78:0/952016135":"2024-09-18T08:42:28.063929+0000","172.21.15.78:6800/2109055855":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/2393209611":"2024-09-18T08:52:36.656628+0000","172.21.15.78:6801/3976204901":"2024-09-18T08:41:56.432451+0000","172.21.15.78:6801/2109055855":"2024-09-18T08:42:28.063929+0000","172.21.15.78:6800/3976204901":"2024-09-18T08:41:56.432451+0000","172.21.15.78:0/4006917361":"2024-09-18T08:42:28.063929+0000","172.21.15.78:0/3486841101":"2024-09-18T08:52:36.656628+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T08:53:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f03a806cec0 msgr2=0x7f03a806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f03a806cec0 0x7f03a806f380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03ac02aed0 tx=0x7f03ac004a60 comp rx=0 tx=0).stop 2024-09-17T08:53:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102220 msgr2=0x7f03bc19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:32.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102220 0x7f03bc19d680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c890 tx=0x7f03a400cd50 comp rx=0 tx=0).stop 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 shutdown_connections 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f03a806cec0 0x7f03a806f380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03bc107350 0x7f03bc197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03bc102bd0 0x7f03bc19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 --2- 172.21.15.78:0/1526161421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03bc102220 0x7f03bc19d680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 >> 172.21.15.78:0/1526161421 conn(0x7f03bc0fdca0 msgr2=0x7f03bc0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 shutdown_connections 2024-09-17T08:53:32.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:32.631+0000 7f03c2769640 1 -- 172.21.15.78:0/1526161421 wait complete. 2024-09-17T08:53:32.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[24812]: audit 2024-09-17T08:53:31.794223+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:32.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[24812]: audit 2024-09-17T08:53:32.633170+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.15.78:0/1526161421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:53:32.879 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.673122851Z level=info msg="Executing migration" id="Update org table charset" 2024-09-17T08:53:32.879 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.698418301Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-17T08:53:32.879 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.740355529Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-17T08:53:32.879 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.782479888Z level=info msg="Executing migration" id="create dashboard table" 2024-09-17T08:53:32.879 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.824655209Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-17T08:53:32.879 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.883329634Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-17T08:53:33.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:32 smithi078 bash[32124]: audit 2024-09-17T08:53:31.794223+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:33.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:32 smithi078 bash[32124]: audit 2024-09-17T08:53:32.633170+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.15.78:0/1526161421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:53:33.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:32 smithi078 bash[22670]: audit 2024-09-17T08:53:31.794223+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:33.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:32 smithi078 bash[22670]: audit 2024-09-17T08:53:32.633170+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.15.78:0/1526161421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T08:53:33.140 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.908631934Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-17T08:53:33.141 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.933881948Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-17T08:53:33.144 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:32 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:32.959195281Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-17T08:53:33.144 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.001059217Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-17T08:53:33.145 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.026428821Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-17T08:53:33.145 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.051677179Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-17T08:53:33.145 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.085598092Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-17T08:53:33.145 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.110863817Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-17T08:53:33.145 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.144483989Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-17T08:53:33.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T08:53:33.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T08:53:33.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T08:53:33.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T08:53:33.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T08:53:33.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T08:53:33.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-17T08:53:33.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-17T08:53:33.400 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.186509815Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-17T08:53:33.400 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.211793499Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-17T08:53:33.400 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.253794365Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-17T08:53:33.400 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.295837426Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-17T08:53:33.400 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.321042772Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-17T08:53:33.402 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.346403752Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-17T08:53:33.402 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.371452062Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-17T08:53:33.402 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.405076526Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-17T08:53:33.687 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.438863482Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-17T08:53:33.687 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.455828451Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-17T08:53:33.687 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.489573683Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-17T08:53:33.688 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.514901629Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-17T08:53:33.688 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.557056264Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-17T08:53:33.688 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.582431113Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-17T08:53:33.688 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.624394824Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-17T08:53:33.688 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.649723533Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-17T08:53:33.688 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.691732746Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-17T08:53:33.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[24812]: cluster 2024-09-17T08:53:32.708900+0000 mgr.y (mgr.14532) 60 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:33.973 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.716983677Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-17T08:53:33.973 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.75880971Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-17T08:53:33.974 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.784222821Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-17T08:53:33.974 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.826411547Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-17T08:53:33.974 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.851687935Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-17T08:53:33.974 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.893854301Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-17T08:53:33.974 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.935890072Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-17T08:53:33.974 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:33 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:33.977851789Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-17T08:53:34.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:33 smithi078 bash[32124]: cluster 2024-09-17T08:53:32.708900+0000 mgr.y (mgr.14532) 60 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:33 smithi078 bash[22670]: cluster 2024-09-17T08:53:32.708900+0000 mgr.y (mgr.14532) 60 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:34.234 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.01996552Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-17T08:53:34.234 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.045160903Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-17T08:53:34.234 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.070511551Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-17T08:53:34.235 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.095697672Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-17T08:53:34.235 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.12099708Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-17T08:53:34.235 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.146312145Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-17T08:53:34.235 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.171584811Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-17T08:53:34.235 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.213633244Z level=info msg="Executing migration" id="create data_source table" 2024-09-17T08:53:34.235 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.238895207Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-17T08:53:34.504 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.264245451Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-17T08:53:34.504 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.297878151Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.314785865Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.331753122Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.34872933Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.373960049Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.399205309Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.441102789Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.483136695Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-17T08:53:34.505 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.508623846Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.533765488Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.55909572Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.584424053Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.609652547Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.634923153Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.685527496Z level=info msg="Executing migration" id="Add uid column" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.710817992Z level=info msg="Executing migration" id="Update uid value" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.75282243Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-17T08:53:34.774 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.778129584Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-17T08:53:35.025 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.820128388Z level=info msg="Executing migration" id="create api_key table" 2024-09-17T08:53:35.026 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.845421267Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-17T08:53:35.026 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.903924976Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-17T08:53:35.026 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.94607966Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-17T08:53:35.026 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:34 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:34.988075205Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-17T08:53:35.026 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.01334047Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-17T08:53:35.026 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.030349592Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.047246031Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.064593171Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.081049319Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.098043136Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.123353295Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.148605326Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.173833887Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.199046892Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.240991299Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-17T08:53:35.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.283120531Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-17T08:53:35.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.308359209Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-17T08:53:35.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.358753355Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-17T08:53:35.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.409015016Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-17T08:53:35.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.434298896Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-17T08:53:35.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.459448253Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-17T08:53:35.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.501574129Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-17T08:53:35.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.544061368Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-17T08:53:35.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.586117181Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-17T08:53:35.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.628125743Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-17T08:53:35.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.670200664Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-17T08:53:35.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.695392499Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-17T08:53:35.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.737436159Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-17T08:53:35.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.77957796Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-17T08:53:36.068 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[24812]: cluster 2024-09-17T08:53:34.710374+0000 mgr.y (mgr.14532) 61 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:36.068 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.821555626Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-17T08:53:36.068 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:35 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:35.972477218Z level=info msg="Executing migration" id="create quota table v1" 2024-09-17T08:53:36.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:35 smithi078 bash[32124]: cluster 2024-09-17T08:53:34.710374+0000 mgr.y (mgr.14532) 61 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:35 smithi078 bash[22670]: cluster 2024-09-17T08:53:34.710374+0000 mgr.y (mgr.14532) 61 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:36.337 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.073044647Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-17T08:53:36.337 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.181999707Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-17T08:53:36.338 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.215556389Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-17T08:53:36.338 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.232578171Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-17T08:53:36.338 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.249405025Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-17T08:53:36.338 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.275020903Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-17T08:53:36.338 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.316896494Z level=info msg="Executing migration" id="create session table" 2024-09-17T08:53:36.338 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.34225572Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-17T08:53:36.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.367511017Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-17T08:53:36.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.392932219Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-17T08:53:36.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.418232816Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-17T08:53:36.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.443475075Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-17T08:53:36.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.468957289Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-17T08:53:36.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.494282982Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-17T08:53:36.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.519529403Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-17T08:53:36.600 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.561560377Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-17T08:53:36.600 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.603572037Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-17T08:53:36.860 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.628839138Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-17T08:53:36.860 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.670755677Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-17T08:53:36.860 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.712855114Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-17T08:53:36.860 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.754811971Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-17T08:53:36.860 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.78006873Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-17T08:53:36.860 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.82208419Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-17T08:53:36.860 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.864118014Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-17T08:53:37.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.889527058Z level=info msg="Executing migration" id="create alert table v1" 2024-09-17T08:53:37.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.914734164Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-17T08:53:37.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.956801611Z level=info msg="Executing migration" id="add index alert state" 2024-09-17T08:53:37.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:36 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:36.982054869Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-17T08:53:37.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.024047027Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-17T08:53:37.112 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.06602652Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-17T08:53:37.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.091359248Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-17T08:53:37.113 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.116667576Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-17T08:53:37.113 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.114 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.114 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.115 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.115 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.115 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.117 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.117 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:53:37.365 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.141898382Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-17T08:53:37.365 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.183918004Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-17T08:53:37.365 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.209150127Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-17T08:53:37.365 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.234478145Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-17T08:53:37.365 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.276502337Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-17T08:53:37.365 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.318604974Z level=info msg="Executing migration" id="Add column is_default" 2024-09-17T08:53:37.366 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.344103208Z level=info msg="Executing migration" id="Add column frequency" 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.278291+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.284130+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.650384+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.656968+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.657794+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.658456+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.665741+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: cephadm 2024-09-17T08:53:36.698586+0000 mgr.y (mgr.14532) 62 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: cephadm 2024-09-17T08:53:36.701831+0000 mgr.y (mgr.14532) 63 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi078 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: cluster 2024-09-17T08:53:36.710777+0000 mgr.y (mgr.14532) 64 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:37.366 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[24812]: audit 2024-09-17T08:53:36.893625+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:37.567 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.278291+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.284130+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.650384+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.656968+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.657794+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.658456+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.665741+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: cephadm 2024-09-17T08:53:36.698586+0000 mgr.y (mgr.14532) 62 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: cephadm 2024-09-17T08:53:36.701831+0000 mgr.y (mgr.14532) 63 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi078 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: cluster 2024-09-17T08:53:36.710777+0000 mgr.y (mgr.14532) 64 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:37.568 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[32124]: audit 2024-09-17T08:53:36.893625+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.278291+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.284130+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.650384+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.656968+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.657794+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.658456+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.665741+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: cephadm 2024-09-17T08:53:36.698586+0000 mgr.y (mgr.14532) 62 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: cephadm 2024-09-17T08:53:36.701831+0000 mgr.y (mgr.14532) 63 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi078 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: cluster 2024-09-17T08:53:36.710777+0000 mgr.y (mgr.14532) 64 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:37.569 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22670]: audit 2024-09-17T08:53:36.893625+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:37.626 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.369362961Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-17T08:53:37.626 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.394666879Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-17T08:53:37.626 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.419954131Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-17T08:53:37.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.44520605Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-17T08:53:37.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.470494065Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-17T08:53:37.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.495795787Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-17T08:53:37.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.537881773Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-17T08:53:37.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.563145369Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-17T08:53:37.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.605148845Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-17T08:53:37.627 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.630573291Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-17T08:53:37.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.655786905Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-17T08:53:37.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.697706888Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-17T08:53:37.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.739836784Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-17T08:53:37.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.781984084Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-17T08:53:37.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.82400686Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-17T08:53:37.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.849225776Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-17T08:53:37.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.891252516Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-17T08:53:38.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.916589799Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-17T08:53:38.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.958544583Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-17T08:53:38.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:37 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:37.983850051Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-17T08:53:38.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.000768204Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-17T08:53:38.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.017715185Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-17T08:53:38.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.0513813Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-17T08:53:38.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.068329466Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-17T08:53:38.158 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.085141162Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-17T08:53:38.158 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.102280105Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-17T08:53:38.158 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.136096063Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-17T08:53:38.158 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.161313872Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-17T08:53:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:53:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:53:38.417 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.186663536Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-17T08:53:38.418 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.22864788Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-17T08:53:38.418 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.253816123Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-17T08:53:38.418 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.295956341Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-17T08:53:38.418 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.321240993Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-17T08:53:38.418 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.3465239Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-17T08:53:38.418 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.380134439Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-17T08:53:38.418 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.422112324Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-17T08:53:38.678 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.447495185Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-17T08:53:38.679 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.497766356Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-17T08:53:38.679 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.523059489Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-17T08:53:38.679 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.548277779Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-17T08:53:38.679 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.57352999Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-17T08:53:38.679 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.615506357Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-17T08:53:38.679 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.640914988Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-17T08:53:38.679 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.682987325Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.724724447Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.741704766Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.758685529Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.792252866Z level=info msg="Executing migration" id="Move region to single row" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.809185226Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.826304286Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.868220339Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.893473882Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.918710303Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-17T08:53:38.940 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.944169535Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-17T08:53:39.200 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:53:39.200 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:38 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:38.9861403Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-17T08:53:39.200 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.011441273Z level=info msg="Executing migration" id="create test_data table" 2024-09-17T08:53:39.201 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.036709481Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-17T08:53:39.201 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.062043354Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-17T08:53:39.201 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.087278042Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-17T08:53:39.201 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.112600525Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-17T08:53:39.201 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.137719777Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-17T08:53:39.201 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.17977789Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-17T08:53:39.201 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.204993739Z level=info msg="Executing migration" id="create team table" 2024-09-17T08:53:39.461 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.24707691Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.27253083Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.314476311Z level=info msg="Executing migration" id="create team member table" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.339731215Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.364992636Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.390313749Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.415550438Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.440853881Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-17T08:53:39.462 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.466094178Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.491386139Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.516731875Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.541898515Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.56728064Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.609193968Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.634625622Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.697883868Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-17T08:53:39.714 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.718349599Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-17T08:53:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:39 smithi078 bash[22670]: cluster 2024-09-17T08:53:38.712210+0000 mgr.y (mgr.14532) 65 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:39.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:39 smithi078 bash[32124]: cluster 2024-09-17T08:53:38.712210+0000 mgr.y (mgr.14532) 65 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:39.966 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[24812]: cluster 2024-09-17T08:53:38.712210+0000 mgr.y (mgr.14532) 65 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:39.966 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.760534444Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-17T08:53:39.966 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.802874014Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-17T08:53:39.967 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.844855617Z level=info msg="Executing migration" id="create tag table" 2024-09-17T08:53:39.967 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.886786334Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-17T08:53:39.967 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.92878394Z level=info msg="Executing migration" id="create login attempt table" 2024-09-17T08:53:39.967 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:39 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:39.970850761Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-17T08:53:40.227 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.013013344Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.038188288Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.088600774Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.105550769Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.122498473Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.13940641Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.156306314Z level=info msg="Executing migration" id="create user auth table" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.181658082Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.206899174Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-17T08:53:40.228 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.232164369Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.257451231Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.282677094Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.307903226Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.333071373Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.35842511Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.400448601Z level=info msg="Executing migration" id="create server_lock table" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.425725985Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.467772249Z level=info msg="Executing migration" id="create user auth token table" 2024-09-17T08:53:40.497 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.501293266Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-17T08:53:40.749 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.526542554Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-17T08:53:40.749 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.551829943Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-17T08:53:40.749 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.593771728Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-17T08:53:40.749 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.644285699Z level=info msg="Executing migration" id="create cache_data table" 2024-09-17T08:53:40.749 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.669550531Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-17T08:53:40.749 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.711573498Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-17T08:53:40.749 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.75354788Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-17T08:53:40.952 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:40 smithi078 bash[22670]: audit 2024-09-17T08:53:39.143402+0000 mgr.y (mgr.14532) 66 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:40.952 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:40 smithi078 bash[32124]: audit 2024-09-17T08:53:39.143402+0000 mgr.y (mgr.14532) 66 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:41.018 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[24812]: audit 2024-09-17T08:53:39.143402+0000 mgr.y (mgr.14532) 66 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:41.018 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.795523264Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-17T08:53:41.018 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.82075462Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-17T08:53:41.018 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.846028998Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-17T08:53:41.018 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.888060595Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-17T08:53:41.018 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.930053707Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-17T08:53:41.018 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:40 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:40.997226157Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-17T08:53:41.018 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.022484367Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-17T08:53:41.278 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.06445976Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-17T08:53:41.278 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.08970387Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-17T08:53:41.278 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.123307723Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-17T08:53:41.278 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.148578729Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-17T08:53:41.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.190564843Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-17T08:53:41.279 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.240962033Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-17T08:53:41.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.282967879Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-17T08:53:41.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.324895307Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-17T08:53:41.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.350212398Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-17T08:53:41.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.375457342Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-17T08:53:41.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.417381062Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-17T08:53:41.539 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.442755137Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-17T08:53:41.540 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.493028867Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-17T08:53:41.540 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.518431928Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-17T08:53:41.540 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.543623268Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[24812]: cluster 2024-09-17T08:53:40.712633+0000 mgr.y (mgr.14532) 67 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.568909651Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.619428357Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.636283501Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.669935964Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.703562003Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.720543765Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.737370522Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-17T08:53:41.791 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.762761913Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-17T08:53:42.052 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.804776562Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-17T08:53:42.052 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.830031708Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-17T08:53:42.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.87204267Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-17T08:53:42.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.914148134Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-17T08:53:42.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.96435549Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-17T08:53:42.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:41 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:41.989614383Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-17T08:53:42.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.031511262Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-17T08:53:42.053 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.056826862Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-17T08:53:42.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:41 smithi078 bash[22670]: cluster 2024-09-17T08:53:40.712633+0000 mgr.y (mgr.14532) 67 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:42.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:41 smithi078 bash[32124]: cluster 2024-09-17T08:53:40.712633+0000 mgr.y (mgr.14532) 67 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:42.322 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.08205703Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-17T08:53:42.322 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.10732268Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-17T08:53:42.322 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.13262598Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-17T08:53:42.322 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.157792739Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-17T08:53:42.322 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.19980641Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-17T08:53:42.323 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.224992482Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-17T08:53:42.323 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.250295585Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-17T08:53:42.323 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.275639328Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-17T08:53:42.323 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.300998716Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-17T08:53:42.323 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.326198948Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-17T08:53:42.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.368303747Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-17T08:53:42.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.393551234Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-17T08:53:42.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.418818631Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-17T08:53:42.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.460753123Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-17T08:53:42.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.494578781Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-17T08:53:42.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.519886627Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-17T08:53:42.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.545062163Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-17T08:53:42.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.587119836Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-17T08:53:42.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.629026412Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-17T08:53:42.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.654322698Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-17T08:53:42.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.67952946Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-17T08:53:42.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.704916688Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-17T08:53:42.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.746827774Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-17T08:53:42.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.77216344Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-17T08:53:42.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.814238616Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-17T08:53:42.853 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.831168763Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-17T08:53:42.853 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.856476809Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-17T08:53:43.121 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.873360946Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-17T08:53:43.121 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.898674892Z level=info msg="Executing migration" id="create alert_image table" 2024-09-17T08:53:43.121 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.940612888Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-17T08:53:43.121 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:42 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:42.96582804Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-17T08:53:43.121 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.00786181Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-17T08:53:43.121 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.033075316Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-17T08:53:43.122 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.075071411Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-17T08:53:43.122 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.075388712Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-17T08:53:43.122 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.100363892Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-17T08:53:43.122 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.125619548Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-17T08:53:43.391 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.150962838Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-09-17T08:53:43.391 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.151440278Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-09-17T08:53:43.391 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.151815058Z level=info msg="alerts found to migrate" alerts=0 2024-09-17T08:53:43.391 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.176249022Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-17T08:53:43.391 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.20156663Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-17T08:53:43.392 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.22687954Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-17T08:53:43.392 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.252188501Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-17T08:53:43.392 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.277407984Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-17T08:53:43.392 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.302956583Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-17T08:53:43.392 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.3448604Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-17T08:53:43.392 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.370280312Z level=info msg="Executing migration" id="create data_keys table" 2024-09-17T08:53:43.392 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.395516627Z level=info msg="Executing migration" id="create secrets table" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.437551679Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.479525622Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.521557691Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.53857404Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.588987531Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.622667966Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.639645352Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-17T08:53:43.669 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.673270811Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[24812]: cluster 2024-09-17T08:53:42.713271+0000 mgr.y (mgr.14532) 68 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.698631404Z level=info msg="Executing migration" id="create permission table" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.740664206Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.765914498Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.808043978Z level=info msg="Executing migration" id="create role table" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.83310972Z level=info msg="Executing migration" id="add column display_name" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.875165651Z level=info msg="Executing migration" id="add column group_name" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.917135548Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-17T08:53:43.938 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.942497518Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-17T08:53:44.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:43 smithi078 bash[22670]: cluster 2024-09-17T08:53:42.713271+0000 mgr.y (mgr.14532) 68 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:44.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:43 smithi078 bash[32124]: cluster 2024-09-17T08:53:42.713271+0000 mgr.y (mgr.14532) 68 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:44.198 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.967775459Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-17T08:53:44.199 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:43 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:43.992985938Z level=info msg="Executing migration" id="create team role table" 2024-09-17T08:53:44.199 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.05999721Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-17T08:53:44.199 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.10204638Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-17T08:53:44.199 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.127379191Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-17T08:53:44.199 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.152600595Z level=info msg="Executing migration" id="create user role table" 2024-09-17T08:53:44.199 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.203187519Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.228534186Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.25373227Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.279051966Z level=info msg="Executing migration" id="create builtin role table" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.304300855Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.329475976Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.355217729Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.388529132Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.413742835Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.439057817Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-17T08:53:44.460 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.464319807Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-17T08:53:44.745 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.489550283Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.514811546Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.540048485Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.565302551Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.590611129Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.615785247Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.640909326Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.666257287Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.708197272Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-17T08:53:44.746 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.750230143Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-17T08:53:45.007 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.792089743Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-17T08:53:45.007 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.809058423Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-17T08:53:45.007 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.825983551Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-17T08:53:45.007 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.84299916Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-17T08:53:45.008 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.876614197Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-17T08:53:45.008 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.918626804Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-17T08:53:45.008 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.960767709Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-17T08:53:45.008 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:44 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:44.986030802Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-17T08:53:45.008 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.011542503Z level=info msg="Executing migration" id="add correlation config column" 2024-09-17T08:53:45.259 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.036836296Z level=info msg="Executing migration" id="create entity_events table" 2024-09-17T08:53:45.259 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.062091097Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.087349097Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.087690683Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.129281387Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.129634777Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.154572814Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.179882256Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.22183217Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-17T08:53:45.260 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.263857955Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-17T08:53:45.511 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.289055009Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-17T08:53:45.512 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.314349356Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-17T08:53:45.512 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.356233244Z level=info msg="Executing migration" id="Drop public config table" 2024-09-17T08:53:45.512 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.381652968Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-17T08:53:45.512 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.407017376Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-17T08:53:45.512 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.448948847Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-17T08:53:45.512 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.474257642Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-17T08:53:45.512 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.516189953Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-17T08:53:45.784 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.56668143Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-17T08:53:45.784 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.591947515Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-17T08:53:45.784 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.61712797Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-17T08:53:45.784 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.642485151Z level=info msg="Executing migration" id="add share column" 2024-09-17T08:53:45.784 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.667761561Z level=info msg="Executing migration" id="create default alerting folders" 2024-09-17T08:53:45.784 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.70976259Z level=info msg="Executing migration" id="create file table" 2024-09-17T08:53:45.784 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.752064897Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-17T08:53:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[24812]: cluster 2024-09-17T08:53:44.714151+0000 mgr.y (mgr.14532) 69 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:46.041 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.793880083Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-17T08:53:46.041 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.819294107Z level=info msg="Executing migration" id="create file_meta table" 2024-09-17T08:53:46.041 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.844551824Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-17T08:53:46.041 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.895071501Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-17T08:53:46.041 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.920309325Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-17T08:53:46.041 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.945503967Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-17T08:53:46.041 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.970798543Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-17T08:53:46.042 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:45 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:45.996030961Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-17T08:53:46.042 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.02120983Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-17T08:53:46.173 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:45 smithi078 bash[22670]: cluster 2024-09-17T08:53:44.714151+0000 mgr.y (mgr.14532) 69 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:46.174 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:45 smithi078 bash[32124]: cluster 2024-09-17T08:53:44.714151+0000 mgr.y (mgr.14532) 69 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:46.421 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.063117386Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-17T08:53:46.421 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.122046388Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-17T08:53:46.422 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.147253644Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-17T08:53:46.422 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.172541891Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-17T08:53:46.422 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.197825016Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-17T08:53:46.422 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.223064181Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-17T08:53:46.422 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.248350732Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-17T08:53:46.422 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.27360854Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-17T08:53:46.695 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.424782558Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-17T08:53:46.696 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.507772259Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-17T08:53:46.696 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.599622289Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-17T08:53:46.696 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.700154779Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-17T08:53:46.956 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.741995747Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-17T08:53:46.956 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.783969905Z level=info msg="Executing migration" id="create folder table" 2024-09-17T08:53:46.957 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.826071547Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-17T08:53:46.957 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.851284919Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-17T08:53:46.957 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.893292459Z level=info msg="Executing migration" id="Update folder title length" 2024-09-17T08:53:46.957 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.935308263Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-17T08:53:46.957 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=migrator t=2024-09-17T08:53:46.960592554Z level=info msg="migrations completed" performed=485 skipped=0 duration=15.636692726s 2024-09-17T08:53:47.291 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:46 smithi136 bash[52309]: logger=sqlstore t=2024-09-17T08:53:46.96235424Z level=info msg="Created default organization" 2024-09-17T08:53:47.292 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:47 smithi136 bash[52309]: logger=plugin.loader t=2024-09-17T08:53:47.106931498Z level=info msg="Plugin registered" pluginID=input 2024-09-17T08:53:47.292 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:47 smithi136 bash[52309]: logger=plugin.loader t=2024-09-17T08:53:47.138657896Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-09-17T08:53:47.292 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:47 smithi136 bash[52309]: logger=plugin.loader t=2024-09-17T08:53:47.138682848Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-09-17T08:53:47.292 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:47 smithi136 bash[52309]: logger=secrets t=2024-09-17T08:53:47.138722201Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-17T08:53:47.292 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:47 smithi136 bash[52309]: logger=query_data t=2024-09-17T08:53:47.140726746Z level=info msg="Query Service initialization" 2024-09-17T08:53:47.292 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:47 smithi136 bash[52309]: logger=live.push_http t=2024-09-17T08:53:47.144933712Z level=info msg="Live Push Gateway initialization" 2024-09-17T08:53:48.032 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:47 smithi078 bash[22670]: cluster 2024-09-17T08:53:46.714818+0000 mgr.y (mgr.14532) 70 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:48.033 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:47 smithi078 bash[32124]: cluster 2024-09-17T08:53:46.714818+0000 mgr.y (mgr.14532) 70 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:48.033 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:53:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:53:48.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:47 smithi136 bash[24812]: cluster 2024-09-17T08:53:46.714818+0000 mgr.y (mgr.14532) 70 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- 172.21.15.78:0/2009361457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90105160 msgr2=0x7f1a9010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 --2- 172.21.15.78:0/2009361457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90105160 0x7f1a9010cce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009930 tx=0x7f1a8002a420 comp rx=0 tx=0).stop 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- 172.21.15.78:0/2009361457 shutdown_connections 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 --2- 172.21.15.78:0/2009361457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90105160 0x7f1a9010cce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 --2- 172.21.15.78:0/2009361457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a901009e0 0x7f1a90104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 --2- 172.21.15.78:0/2009361457 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a90100030 0x7f1a90100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- 172.21.15.78:0/2009361457 >> 172.21.15.78:0/2009361457 conn(0x7f1a900fbad0 msgr2=0x7f1a900fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:48.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- 172.21.15.78:0/2009361457 shutdown_connections 2024-09-17T08:53:48.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- 172.21.15.78:0/2009361457 wait complete. 2024-09-17T08:53:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 Processor -- start 2024-09-17T08:53:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- start start 2024-09-17T08:53:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90100030 0x7f1a9019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a901009e0 0x7f1a9019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:48.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a90105160 0x7f1a90195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90195d00 con 0x7f1a90100030 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90195e70 con 0x7f1a90105160 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a94d3a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90196030 con 0x7f1a901009e0 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a8e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90100030 0x7f1a9019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a8e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90100030 0x7f1a9019b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53570/0 (socket says 172.21.15.78:53570) 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a8e59c640 1 -- 172.21.15.78:0/1741840866 learned_addr learned my addr 172.21.15.78:0/1741840866 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.582+0000 7f1a8dd9b640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a901009e0 0x7f1a9019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8ed9d640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a90105160 0x7f1a90195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8e59c640 1 -- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a901009e0 msgr2=0x7f1a9019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8e59c640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a901009e0 0x7f1a9019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8e59c640 1 -- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a90105160 msgr2=0x7f1a90195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8e59c640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a90105160 0x7f1a90195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8e59c640 1 -- 172.21.15.78:0/1741840866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009840 con 0x7f1a90100030 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8ed9d640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a90105160 0x7f1a90195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8e59c640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90100030 0x7f1a9019b510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d50 tx=0x7f1a8800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88003b70 con 0x7f1a90100030 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a80009560 con 0x7f1a90100030 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1a88003cd0 con 0x7f1a90100030 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88010690 con 0x7f1a90100030 2024-09-17T08:53:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a900726e0 con 0x7f1a90100030 2024-09-17T08:53:48.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a9010f5c0 con 0x7f1a90100030 2024-09-17T08:53:48.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f1a88004020 con 0x7f1a90100030 2024-09-17T08:53:48.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a7c06cec0 0x7f1a7c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f1a88014070 con 0x7f1a90100030 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8dd9b640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a7c06cec0 0x7f1a7c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] conn(0x7f1a7c076d90 0x7f1a7c079230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 --> [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a7c079900 con 0x7f1a7c076d90 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a8808f770 con 0x7f1a90100030 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8ed9d640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] conn(0x7f1a7c076d90 0x7f1a7c079230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.586+0000 7f1a8dd9b640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a7c06cec0 0x7f1a7c06f380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a90106970 tx=0x7f1a78010040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.590+0000 7f1a8ed9d640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] conn(0x7f1a7c076d90 0x7f1a7c079230 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:48.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.590+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== osd.5 v2:172.21.15.136:6808/3791268694 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1a7c079900 con 0x7f1a7c076d90 2024-09-17T08:53:48.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.602+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 --> [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a90101510 con 0x7f1a7c076d90 2024-09-17T08:53:48.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a877fe640 1 -- 172.21.15.78:0/1741840866 <== osd.5 v2:172.21.15.136:6808/3791268694 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1a90101510 con 0x7f1a7c076d90 2024-09-17T08:53:48.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] conn(0x7f1a7c076d90 msgr2=0x7f1a7c079230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:48.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.136:6808/3791268694,v1:172.21.15.136:6809/3791268694] conn(0x7f1a7c076d90 0x7f1a7c079230 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:48.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a7c06cec0 msgr2=0x7f1a7c06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:48.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a7c06cec0 0x7f1a7c06f380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a90106970 tx=0x7f1a78010040 comp rx=0 tx=0).stop 2024-09-17T08:53:48.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90100030 msgr2=0x7f1a9019b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:48.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 --2- 172.21.15.78:0/1741840866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a90100030 0x7f1a9019b510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d50 tx=0x7f1a8800c6a0 comp rx=0 tx=0).stop 2024-09-17T08:53:48.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a8ed9d640 1 -- 172.21.15.78:0/1741840866 reap_dead start 2024-09-17T08:53:48.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 shutdown_connections 2024-09-17T08:53:48.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 >> 172.21.15.78:0/1741840866 conn(0x7f1a900fbad0 msgr2=0x7f1a900fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:48.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 shutdown_connections 2024-09-17T08:53:48.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:48.606+0000 7f1a94d3a640 1 -- 172.21.15.78:0/1741840866 wait complete. 2024-09-17T08:53:48.676 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=infra.usagestats.collector t=2024-09-17T08:53:48.422539027Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-17T08:53:48.676 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=provisioning.datasources t=2024-09-17T08:53:48.478524607Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-17T08:53:48.676 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=provisioning.datasources t=2024-09-17T08:53:48.573431265Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=provisioning.alerting t=2024-09-17T08:53:48.679786258Z level=info msg="starting to provision alerting" 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=provisioning.alerting t=2024-09-17T08:53:48.679844337Z level=info msg="finished to provision alerting" 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=ngalert.state.manager t=2024-09-17T08:53:48.680036427Z level=info msg="Warming state cache for startup" 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=grafanaStorageLogger t=2024-09-17T08:53:48.680576066Z level=info msg="storage starting" 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=http.server t=2024-09-17T08:53:48.685920327Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=ngalert.state.manager t=2024-09-17T08:53:48.734374024Z level=info msg="State cache has been initialized" states=0 duration=54.337542ms 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=ngalert.multiorg.alertmanager t=2024-09-17T08:53:48.73444424Z level=info msg="starting MultiOrg Alertmanager" 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=ticker t=2024-09-17T08:53:48.734480612Z level=info msg=starting first_tick=2024-09-17T08:53:50Z 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:48 smithi136 bash[52309]: logger=sqlstore.transactions t=2024-09-17T08:53:48.869577624Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-17T08:53:49.015 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:49 smithi136 bash[52309]: logger=sqlstore.transactions t=2024-09-17T08:53:49.019103264Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-17T08:53:49.291 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:53:49.291 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:49 smithi136 bash[52309]: logger=sqlstore.transactions t=2024-09-17T08:53:49.030358812Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-17T08:53:49.291 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:49 smithi136 bash[52309]: logger=sqlstore.transactions t=2024-09-17T08:53:49.041577582Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-09-17T08:53:49.291 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 08:53:49 smithi136 bash[52309]: logger=sqlstore.transactions t=2024-09-17T08:53:49.052668488Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=3 code="database is locked" 2024-09-17T08:53:50.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:49 smithi136 bash[24812]: cluster 2024-09-17T08:53:48.716160+0000 mgr.y (mgr.14532) 71 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:49 smithi078 bash[22670]: cluster 2024-09-17T08:53:48.716160+0000 mgr.y (mgr.14532) 71 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:50.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:49 smithi078 bash[32124]: cluster 2024-09-17T08:53:48.716160+0000 mgr.y (mgr.14532) 71 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:53:51.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:50 smithi078 bash[22670]: audit 2024-09-17T08:53:49.151196+0000 mgr.y (mgr.14532) 72 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:51.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:50 smithi078 bash[32124]: audit 2024-09-17T08:53:49.151196+0000 mgr.y (mgr.14532) 72 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:51.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:50 smithi136 bash[24812]: audit 2024-09-17T08:53:49.151196+0000 mgr.y (mgr.14532) 72 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:53:51.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.802+0000 7fa772c5d640 1 -- 172.21.15.78:0/2539205843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101960 msgr2=0x7fa76c109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:51.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.802+0000 7fa772c5d640 1 --2- 172.21.15.78:0/2539205843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101960 0x7fa76c109e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa758009900 tx=0x7fa75802a480 comp rx=0 tx=0).stop 2024-09-17T08:53:51.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- 172.21.15.78:0/2539205843 shutdown_connections 2024-09-17T08:53:51.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 --2- 172.21.15.78:0/2539205843 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa76c10a3e0 0x7fa76c10c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:51.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 --2- 172.21.15.78:0/2539205843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101960 0x7fa76c109e50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:51.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 --2- 172.21.15.78:0/2539205843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c101040 0x7fa76c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:51.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- 172.21.15.78:0/2539205843 >> 172.21.15.78:0/2539205843 conn(0x7fa76c0faa20 msgr2=0x7fa76c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:51.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- 172.21.15.78:0/2539205843 shutdown_connections 2024-09-17T08:53:51.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- 172.21.15.78:0/2539205843 wait complete. 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 Processor -- start 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- start start 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101040 0x7fa76c0feca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa76c10a3e0 0x7fa76c0ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c0ff720 0x7fa76c1a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1a41f0 con 0x7fa76c101040 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1a4360 con 0x7fa76c0ff720 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1a4520 con 0x7fa76c10a3e0 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101040 0x7fa76c0feca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa76c10a3e0 0x7fa76c0ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:51.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa76c10a3e0 0x7fa76c0ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55840/0 (socket says 172.21.15.78:55840) 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101040 0x7fa76c0feca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53584/0 (socket says 172.21.15.78:53584) 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa76bfff640 1 -- 172.21.15.78:0/1831180764 learned_addr learned my addr 172.21.15.78:0/1831180764 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7711fa640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c0ff720 0x7fa76c1a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 -- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa76c10a3e0 msgr2=0x7fa76c0ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa76c10a3e0 0x7fa76c0ff1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 -- 172.21.15.78:0/1831180764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c0ff720 msgr2=0x7fa76c1a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa76c0ff720 0x7fa76c1a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 -- 172.21.15.78:0/1831180764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758009560 con 0x7fa76c101040 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa7709f9640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101040 0x7fa76c0feca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa76000b3f0 tx=0x7fa76000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760011830 con 0x7fa76c101040 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa760011de0 con 0x7fa76c101040 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c1a4800 con 0x7fa76c101040 2024-09-17T08:53:51.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760010ca0 con 0x7fa76c101040 2024-09-17T08:53:51.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c1a4d50 con 0x7fa76c101040 2024-09-17T08:53:51.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.806+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa76c10f610 con 0x7fa76c101040 2024-09-17T08:53:51.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fa760010380 con 0x7fa76c101040 2024-09-17T08:53:51.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa769ffb640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa75c06cec0 0x7fa75c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:51.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fa76008c4f0 con 0x7fa76c101040 2024-09-17T08:53:51.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa76bfff640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa75c06cec0 0x7fa75c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:51.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa769ffb640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] conn(0x7fa75c076e10 0x7fa75c0792b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:51.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 --> [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa75c079980 con 0x7fa75c076e10 2024-09-17T08:53:51.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa76008ebb0 con 0x7fa76c101040 2024-09-17T08:53:51.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa7711fa640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] conn(0x7fa75c076e10 0x7fa75c0792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:51.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa76bfff640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa75c06cec0 0x7fa75c06f380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa76c100420 tx=0x7fa758005d50 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:51.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa7711fa640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] conn(0x7fa75c076e10 0x7fa75c0792b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:51.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.810+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== osd.0 v2:172.21.15.78:6802/2443355414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa75c079980 con 0x7fa75c076e10 2024-09-17T08:53:51.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.822+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 --> [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa76c068770 con 0x7fa75c076e10 2024-09-17T08:53:51.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa769ffb640 1 -- 172.21.15.78:0/1831180764 <== osd.0 v2:172.21.15.78:6802/2443355414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa76c068770 con 0x7fa75c076e10 2024-09-17T08:53:51.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] conn(0x7fa75c076e10 msgr2=0x7fa75c0792b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6802/2443355414,v1:172.21.15.78:6803/2443355414] conn(0x7fa75c076e10 0x7fa75c0792b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa75c06cec0 msgr2=0x7fa75c06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa75c06cec0 0x7fa75c06f380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa76c100420 tx=0x7fa758005d50 comp rx=0 tx=0).stop 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101040 msgr2=0x7fa76c0feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 --2- 172.21.15.78:0/1831180764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c101040 0x7fa76c0feca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa76000b3f0 tx=0x7fa76000b8b0 comp rx=0 tx=0).stop 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa7711fa640 1 -- 172.21.15.78:0/1831180764 reap_dead start 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 shutdown_connections 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 >> 172.21.15.78:0/1831180764 conn(0x7fa76c0faa20 msgr2=0x7fa76c10bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 shutdown_connections 2024-09-17T08:53:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:51.826+0000 7fa772c5d640 1 -- 172.21.15.78:0/1831180764 wait complete. 2024-09-17T08:53:51.919 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:51 smithi078 bash[32124]: cluster 2024-09-17T08:53:50.716818+0000 mgr.y (mgr.14532) 73 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:51.919 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:51 smithi078 bash[22670]: cluster 2024-09-17T08:53:50.716818+0000 mgr.y (mgr.14532) 73 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:52.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:51 smithi136 bash[24812]: cluster 2024-09-17T08:53:50.716818+0000 mgr.y (mgr.14532) 73 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:53:52.659 INFO:teuthology.orchestra.run.smithi078.stdout:167503724601 2024-09-17T08:53:52.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T08:53:53.005 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:52 smithi078 bash[22670]: audit 2024-09-17T08:53:51.918824+0000 mon.a (mon.0) 860 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:53.005 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:52 smithi078 bash[32124]: audit 2024-09-17T08:53:51.918824+0000 mon.a (mon.0) 860 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:53.102 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:53 smithi078 systemd[1]: Stopping Ceph alertmanager.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T08:53:53.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:52 smithi136 bash[24812]: audit 2024-09-17T08:53:51.918824+0000 mon.a (mon.0) 860 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:53:53.853 INFO:teuthology.orchestra.run.smithi078.stdout:34359738476 2024-09-17T08:53:53.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T08:53:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/384602058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedcc1018b0 msgr2=0x7fedcc109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 --2- 172.21.15.78:0/384602058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedcc1018b0 0x7fedcc109da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009860 tx=0x7fedc002a3f0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/384602058 shutdown_connections 2024-09-17T08:53:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 --2- 172.21.15.78:0/384602058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedcc10a3c0 0x7fedcc10c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 --2- 172.21.15.78:0/384602058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedcc1018b0 0x7fedcc109da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 --2- 172.21.15.78:0/384602058 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedcc100f90 0x7fedcc101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/384602058 >> 172.21.15.78:0/384602058 conn(0x7fedcc0faa10 msgr2=0x7fedcc0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/384602058 shutdown_connections 2024-09-17T08:53:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/384602058 wait complete. 2024-09-17T08:53:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 Processor -- start 2024-09-17T08:53:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- start start 2024-09-17T08:53:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedcc100f90 0x7fedcc19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedcc1018b0 0x7fedcc19dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedcc10a3c0 0x7fedcc1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc197ef0 con 0x7fedcc10a3c0 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc198060 con 0x7fedcc1018b0 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc198220 con 0x7fedcc100f90 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedcc10a3c0 0x7fedcc1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedcc10a3c0 0x7fedcc1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39812/0 (socket says 172.21.15.78:39812) 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 -- 172.21.15.78:0/850209477 learned_addr learned my addr 172.21.15.78:0/850209477 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedcbfff640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedcc100f90 0x7fedcc19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedcb7fe640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedcc1018b0 0x7fedcc19dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 -- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedcc100f90 msgr2=0x7fedcc19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedcc100f90 0x7fedcc19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 -- 172.21.15.78:0/850209477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedcc1018b0 msgr2=0x7fedcc19dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedcc1018b0 0x7fedcc19dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 -- 172.21.15.78:0/850209477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009840 con 0x7fedcc10a3c0 2024-09-17T08:53:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedcbfff640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedcc100f90 0x7fedcc19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:53:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd0953640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedcc10a3c0 0x7fedcc1977f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fedc400efd0 tx=0x7fedc400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4009b40 con 0x7fedcc10a3c0 2024-09-17T08:53:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fedc4004020 con 0x7fedcc10a3c0 2024-09-17T08:53:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc0009490 con 0x7fedcc10a3c0 2024-09-17T08:53:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4010690 con 0x7fedcc10a3c0 2024-09-17T08:53:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1a4520 con 0x7fedcc10a3c0 2024-09-17T08:53:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:53.998+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fedcc10f530 con 0x7fedcc10a3c0 2024-09-17T08:53:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fedc4003b70 con 0x7fedcc10a3c0 2024-09-17T08:53:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedc97fa640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fedb406cec0 0x7fedb406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fedc4014070 con 0x7fedcc10a3c0 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedcbfff640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fedb406cec0 0x7fedb406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedc97fa640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] conn(0x7fedb4076d90 0x7fedb4079230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 --> [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedb4079900 con 0x7fedb4076d90 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedc408f5e0 con 0x7fedcc10a3c0 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedcb7fe640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] conn(0x7fedb4076d90 0x7fedb4079230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedcbfff640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fedb406cec0 0x7fedb406f380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0058c0 tx=0x7fedbc005850 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedcb7fe640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] conn(0x7fedb4076d90 0x7fedb4079230 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.002+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== osd.3 v2:172.21.15.78:6826/2849516131 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fedb4079900 con 0x7fedb4076d90 2024-09-17T08:53:54.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 --> [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fedcc069030 con 0x7fedb4076d90 2024-09-17T08:53:54.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedc97fa640 1 -- 172.21.15.78:0/850209477 <== osd.3 v2:172.21.15.78:6826/2849516131 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fedcc069030 con 0x7fedb4076d90 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] conn(0x7fedb4076d90 msgr2=0x7fedb4079230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6826/2849516131,v1:172.21.15.78:6827/2849516131] conn(0x7fedb4076d90 0x7fedb4079230 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fedb406cec0 msgr2=0x7fedb406f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fedb406cec0 0x7fedb406f380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0058c0 tx=0x7fedbc005850 comp rx=0 tx=0).stop 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedcc10a3c0 msgr2=0x7fedcc1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 --2- 172.21.15.78:0/850209477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedcc10a3c0 0x7fedcc1977f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fedc400efd0 tx=0x7fedc400c6a0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd0953640 1 -- 172.21.15.78:0/850209477 reap_dead start 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 shutdown_connections 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 >> 172.21.15.78:0/850209477 conn(0x7fedcc0faa10 msgr2=0x7fedcc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 shutdown_connections 2024-09-17T08:53:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.018+0000 7fedd23b6640 1 -- 172.21.15.78:0/850209477 wait complete. 2024-09-17T08:53:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- 172.21.15.78:0/342904533 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40fef40 msgr2=0x7f6af40ff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 --2- 172.21.15.78:0/342904533 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40fef40 0x7f6af40ff320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009900 tx=0x7f6ae402a410 comp rx=0 tx=0).stop 2024-09-17T08:53:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- 172.21.15.78:0/342904533 shutdown_connections 2024-09-17T08:53:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 --2- 172.21.15.78:0/342904533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6af4104070 0x7f6af410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 --2- 172.21.15.78:0/342904533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af40ff8f0 0x7f6af4103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 --2- 172.21.15.78:0/342904533 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40fef40 0x7f6af40ff320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- 172.21.15.78:0/342904533 >> 172.21.15.78:0/342904533 conn(0x7f6af40faa20 msgr2=0x7f6af40fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- 172.21.15.78:0/342904533 shutdown_connections 2024-09-17T08:53:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- 172.21.15.78:0/342904533 wait complete. 2024-09-17T08:53:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 Processor -- start 2024-09-17T08:53:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- start start 2024-09-17T08:53:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af40fef40 0x7f6af4195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40ff8f0 0x7f6af4195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6af4104070 0x7f6af4199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4199600 con 0x7f6af4104070 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4199770 con 0x7f6af40fef40 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4199930 con 0x7f6af40ff8f0 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6aebfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40ff8f0 0x7f6af4195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6aebfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40ff8f0 0x7f6af4195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:48300/0 (socket says 172.21.15.78:48300) 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6aebfff640 1 -- 172.21.15.78:0/3448795338 learned_addr learned my addr 172.21.15.78:0/3448795338 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6af4104070 0x7f6af4199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af2d9d640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af40fef40 0x7f6af4195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af359e640 1 -- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40ff8f0 msgr2=0x7f6af4195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af359e640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40ff8f0 0x7f6af4195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af359e640 1 -- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af40fef40 msgr2=0x7f6af4195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af359e640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af40fef40 0x7f6af4195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af359e640 1 -- 172.21.15.78:0/3448795338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009560 con 0x7f6af4104070 2024-09-17T08:53:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6aebfff640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6af40ff8f0 0x7f6af4195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:53:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af359e640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6af4104070 0x7f6af4199000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00da10 tx=0x7f6aec00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.068 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:53 smithi078 bash[32124]: cluster 2024-09-17T08:53:52.717355+0000 mgr.y (mgr.14532) 74 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:54.068 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:53 smithi078 bash[22670]: cluster 2024-09-17T08:53:52.717355+0000 mgr.y (mgr.14532) 74 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec00bd70 con 0x7f6af4104070 2024-09-17T08:53:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f6aec003dc0 con 0x7f6af4104070 2024-09-17T08:53:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec010460 con 0x7f6af4104070 2024-09-17T08:53:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af4199c10 con 0x7f6af4104070 2024-09-17T08:53:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.062+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af41a2560 con 0x7f6af4104070 2024-09-17T08:53:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6af410e490 con 0x7f6af4104070 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f6aec003970 con 0x7f6af4104070 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af0d99640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f6ae006cec0 0x7f6ae006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f6aec08cd00 con 0x7f6af4104070 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af2d9d640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f6ae006cec0 0x7f6ae006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af0d99640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] conn(0x7f6ae0076e10 0x7f6ae00792b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 --> [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ae0079980 con 0x7f6ae0076e10 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aec08f3c0 con 0x7f6af4104070 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6af2d9d640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f6ae006cec0 0x7f6ae006f380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000c00 tx=0x7f6ae4005a40 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6aebfff640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] conn(0x7f6ae0076e10 0x7f6ae00792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.066+0000 7f6aebfff640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] conn(0x7f6ae0076e10 0x7f6ae00792b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.070+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== osd.4 v2:172.21.15.136:6800/3532303027 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6ae0079980 con 0x7f6ae0076e10 2024-09-17T08:53:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.082+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 --> [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6af4100420 con 0x7f6ae0076e10 2024-09-17T08:53:54.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.082+0000 7f6af0d99640 1 -- 172.21.15.78:0/3448795338 <== osd.4 v2:172.21.15.136:6800/3532303027 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6af4100420 con 0x7f6ae0076e10 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] conn(0x7f6ae0076e10 msgr2=0x7f6ae00792b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.136:6800/3532303027,v1:172.21.15.136:6801/3532303027] conn(0x7f6ae0076e10 0x7f6ae00792b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f6ae006cec0 msgr2=0x7f6ae006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f6ae006cec0 0x7f6ae006f380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000c00 tx=0x7f6ae4005a40 comp rx=0 tx=0).stop 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6af4104070 msgr2=0x7f6af4199000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 --2- 172.21.15.78:0/3448795338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6af4104070 0x7f6af4199000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00da10 tx=0x7f6aec00ded0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af359e640 1 -- 172.21.15.78:0/3448795338 reap_dead start 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 shutdown_connections 2024-09-17T08:53:54.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 >> 172.21.15.78:0/3448795338 conn(0x7f6af40faa20 msgr2=0x7f6af4068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 shutdown_connections 2024-09-17T08:53:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.086+0000 7f6af9013640 1 -- 172.21.15.78:0/3448795338 wait complete. 2024-09-17T08:53:54.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:53 smithi136 bash[24812]: cluster 2024-09-17T08:53:52.717355+0000 mgr.y (mgr.14532) 74 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:53:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 -- 172.21.15.78:0/784518092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40ff8f0 msgr2=0x7fb3a4103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 --2- 172.21.15.78:0/784518092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40ff8f0 0x7fb3a4103940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009900 tx=0x7fb38c02a410 comp rx=0 tx=0).stop 2024-09-17T08:53:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 -- 172.21.15.78:0/784518092 shutdown_connections 2024-09-17T08:53:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 --2- 172.21.15.78:0/784518092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a4104070 0x7fb3a410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 --2- 172.21.15.78:0/784518092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40ff8f0 0x7fb3a4103940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 --2- 172.21.15.78:0/784518092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3a40fef40 0x7fb3a40ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 -- 172.21.15.78:0/784518092 >> 172.21.15.78:0/784518092 conn(0x7fb3a40faa20 msgr2=0x7fb3a40fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 -- 172.21.15.78:0/784518092 shutdown_connections 2024-09-17T08:53:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 -- 172.21.15.78:0/784518092 wait complete. 2024-09-17T08:53:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 Processor -- start 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.574+0000 7fb3a943e640 1 -- start start 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40fef40 0x7fb3a40fb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3a40ff8f0 0x7fb3a40fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a4104070 0x7fb3a40fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41a3b30 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41a3ca0 con 0x7fb3a4104070 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41a3e60 con 0x7fb3a40fef40 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a2ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40fef40 0x7fb3a40fb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3a40ff8f0 0x7fb3a40fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a2ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40fef40 0x7fb3a40fb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:48318/0 (socket says 172.21.15.78:48318) 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a2ffd640 1 -- 172.21.15.78:0/2924516623 learned_addr learned my addr 172.21.15.78:0/2924516623 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3a40ff8f0 0x7fb3a40fb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39826/0 (socket says 172.21.15.78:39826) 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 -- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40fef40 msgr2=0x7fb3a40fb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40fef40 0x7fb3a40fb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 -- 172.21.15.78:0/2924516623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a4104070 msgr2=0x7fb3a40fbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a37fe640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a4104070 0x7fb3a40fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a4104070 0x7fb3a40fbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 -- 172.21.15.78:0/2924516623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394009490 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a2ffd640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3a40fef40 0x7fb3a40fb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a37fe640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a4104070 0x7fb3a40fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a27fc640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3a40ff8f0 0x7fb3a40fb6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb38c005ab0 tx=0x7fb38c032b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0048d0 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fb38c004ee0 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c009560 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c003850 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a41a4440 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3a410e4d0 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fb38c005230 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb39006cec0 0x7fb39006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fb38c0ada80 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a2ffd640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb39006cec0 0x7fb39006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] conn(0x7fb390076e10 0x7fb3900792b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 --> [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb390079980 con 0x7fb390076e10 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb38c0aded0 con 0x7fb3a40ff8f0 2024-09-17T08:53:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.578+0000 7fb3a37fe640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] conn(0x7fb390076e10 0x7fb3900792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:54.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.582+0000 7fb3a2ffd640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb39006cec0 0x7fb39006f380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb394011690 tx=0x7fb394005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.582+0000 7fb3a37fe640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] conn(0x7fb390076e10 0x7fb3900792b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:54.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.582+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== osd.2 v2:172.21.15.78:6818/671761081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb390079980 con 0x7fb390076e10 2024-09-17T08:53:54.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 --> [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3a4068880 con 0x7fb390076e10 2024-09-17T08:53:54.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb39bfff640 1 -- 172.21.15.78:0/2924516623 <== osd.2 v2:172.21.15.78:6818/671761081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3a4068880 con 0x7fb390076e10 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] conn(0x7fb390076e10 msgr2=0x7fb3900792b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6818/671761081,v1:172.21.15.78:6819/671761081] conn(0x7fb390076e10 0x7fb3900792b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb39006cec0 msgr2=0x7fb39006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb39006cec0 0x7fb39006f380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb394011690 tx=0x7fb394005f90 comp rx=0 tx=0).stop 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3a40ff8f0 msgr2=0x7fb3a40fb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 --2- 172.21.15.78:0/2924516623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3a40ff8f0 0x7fb3a40fb6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb38c005ab0 tx=0x7fb38c032b50 comp rx=0 tx=0).stop 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a37fe640 1 -- 172.21.15.78:0/2924516623 reap_dead start 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 shutdown_connections 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 >> 172.21.15.78:0/2924516623 conn(0x7fb3a40faa20 msgr2=0x7fb3a4067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 shutdown_connections 2024-09-17T08:53:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:54.594+0000 7fb3a943e640 1 -- 172.21.15.78:0/2924516623 wait complete. 2024-09-17T08:53:54.846 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:54 smithi078 bash[58769]: ts=2024-09-17T08:53:54.409Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-17T08:53:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/671222939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600feb30 msgr2=0x7f40600fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 --2- 172.21.15.78:0/671222939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600feb30 0x7f40600fef10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4050009900 tx=0x7f405002a400 comp rx=0 tx=0).stop 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/671222939 shutdown_connections 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 --2- 172.21.15.78:0/671222939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40601063e0 0x7f406010cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 --2- 172.21.15.78:0/671222939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40600ff4e0 0x7f4060105ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 --2- 172.21.15.78:0/671222939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600feb30 0x7f40600fef10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/671222939 >> 172.21.15.78:0/671222939 conn(0x7f4060074200 msgr2=0x7f4060074610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/671222939 shutdown_connections 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/671222939 wait complete. 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 Processor -- start 2024-09-17T08:53:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- start start 2024-09-17T08:53:55.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40600feb30 0x7f4060195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600ff4e0 0x7f4060195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40601063e0 0x7f4060198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601995d0 con 0x7f40601063e0 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060199740 con 0x7f40600feb30 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4060199900 con 0x7f40600ff4e0 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4057fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600ff4e0 0x7f4060195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4057fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600ff4e0 0x7f4060195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:48332/0 (socket says 172.21.15.78:48332) 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4057fff640 1 -- 172.21.15.78:0/3289384273 learned_addr learned my addr 172.21.15.78:0/3289384273 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405f59e640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40601063e0 0x7f4060198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405ed9d640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40600feb30 0x7f4060195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405f59e640 1 -- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600ff4e0 msgr2=0x7f4060195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405f59e640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600ff4e0 0x7f4060195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405f59e640 1 -- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40600feb30 msgr2=0x7f4060195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405f59e640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40600feb30 0x7f4060195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405f59e640 1 -- 172.21.15.78:0/3289384273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050009560 con 0x7f40601063e0 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4057fff640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40600ff4e0 0x7f4060195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405ed9d640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40600feb30 0x7f4060195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405f59e640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40601063e0 0x7f4060198fd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4058009fd0 tx=0x7f405800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800ce20 con 0x7f40601063e0 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4058005020 con 0x7f40601063e0 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058010690 con 0x7f40601063e0 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4060199be0 con 0x7f40601063e0 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40601a2530 con 0x7f40601063e0 2024-09-17T08:53:55.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.058+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f406010f5a0 con 0x7f40601063e0 2024-09-17T08:53:55.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f4058004a40 con 0x7f40601063e0 2024-09-17T08:53:55.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405cd99640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f404c06cec0 0x7f404c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f4058014070 con 0x7f40601063e0 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405ed9d640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f404c06cec0 0x7f404c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405cd99640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] conn(0x7f404c076e10 0x7f404c0792b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 --> [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f404c079980 con 0x7f404c076e10 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f405808f5e0 con 0x7f40601063e0 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f405ed9d640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f404c06cec0 0x7f404c06f380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4050005ab0 tx=0x7f4050005a20 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f4057fff640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] conn(0x7f404c076e10 0x7f404c0792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.062+0000 7f4057fff640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] conn(0x7f404c076e10 0x7f404c0792b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:55.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.066+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== osd.7 v2:172.21.15.136:6824/339955563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f404c079980 con 0x7f404c076e10 2024-09-17T08:53:55.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 --> [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40600680d0 con 0x7f404c076e10 2024-09-17T08:53:55.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f405cd99640 1 -- 172.21.15.78:0/3289384273 <== osd.7 v2:172.21.15.136:6824/339955563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f40600680d0 con 0x7f404c076e10 2024-09-17T08:53:55.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] conn(0x7f404c076e10 msgr2=0x7f404c0792b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.136:6824/339955563,v1:172.21.15.136:6825/339955563] conn(0x7f404c076e10 0x7f404c0792b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f404c06cec0 msgr2=0x7f404c06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f404c06cec0 0x7f404c06f380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4050005ab0 tx=0x7f4050005a20 comp rx=0 tx=0).stop 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40601063e0 msgr2=0x7f4060198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 --2- 172.21.15.78:0/3289384273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40601063e0 0x7f4060198fd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4058009fd0 tx=0x7f405800ef10 comp rx=0 tx=0).stop 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f405f59e640 1 -- 172.21.15.78:0/3289384273 reap_dead start 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 shutdown_connections 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 >> 172.21.15.78:0/3289384273 conn(0x7f4060074200 msgr2=0x7f4060103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 shutdown_connections 2024-09-17T08:53:55.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.078+0000 7f4065057640 1 -- 172.21.15.78:0/3289384273 wait complete. 2024-09-17T08:53:55.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/716154893 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c107360 msgr2=0x7f029c10eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 --2- 172.21.15.78:0/716154893 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c107360 0x7f029c10eee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0294009ca0 tx=0x7f029402a8c0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/716154893 shutdown_connections 2024-09-17T08:53:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 --2- 172.21.15.78:0/716154893 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c107360 0x7f029c10eee0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 --2- 172.21.15.78:0/716154893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c102be0 0x7f029c106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 --2- 172.21.15.78:0/716154893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f029c102230 0x7f029c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/716154893 >> 172.21.15.78:0/716154893 conn(0x7f029c0fdcb0 msgr2=0x7f029c1000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/716154893 shutdown_connections 2024-09-17T08:53:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/716154893 wait complete. 2024-09-17T08:53:55.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 Processor -- start 2024-09-17T08:53:55.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- start start 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c102230 0x7f029c0749c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f029c102be0 0x7f029c074f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c107360 0x7f029c075440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1a7f00 con 0x7f029c102be0 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1a8040 con 0x7f029c107360 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1a8200 con 0x7f029c102230 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c102230 0x7f029c0749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c102230 0x7f029c0749c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:48352/0 (socket says 172.21.15.78:48352) 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 -- 172.21.15.78:0/2337192434 learned_addr learned my addr 172.21.15.78:0/2337192434 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029b59e640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c107360 0x7f029c075440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 -- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c107360 msgr2=0x7f029c075440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c107360 0x7f029c075440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 -- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f029c102be0 msgr2=0x7f029c074f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f029c102be0 0x7f029c074f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 -- 172.21.15.78:0/2337192434 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284009490 con 0x7f029c102230 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f029ad9d640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c102230 0x7f029c0749c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f028400ea60 tx=0x7f028400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028400cde0 con 0x7f029c102230 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0284004470 con 0x7f029c102230 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0294009900 con 0x7f029c102230 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284010430 con 0x7f029c102230 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c1a88a0 con 0x7f029c102230 2024-09-17T08:53:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.978+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f029c111810 con 0x7f029c102230 2024-09-17T08:53:55.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f0284003f00 con 0x7f029c102230 2024-09-17T08:53:55.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f0293fff640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f028806cec0 0x7f028806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f0284014070 con 0x7f029c102230 2024-09-17T08:53:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f029a59c640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f028806cec0 0x7f028806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f0293fff640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] conn(0x7f0288076e10 0x7f02880792b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 --> [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0288079980 con 0x7f0288076e10 2024-09-17T08:53:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f028408d5a0 con 0x7f029c102230 2024-09-17T08:53:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f029b59e640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] conn(0x7f0288076e10 0x7f02880792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f029a59c640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f028806cec0 0x7f028806f380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f028c005d80 tx=0x7f028c005c90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.982+0000 7f029b59e640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] conn(0x7f0288076e10 0x7f02880792b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.986+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== osd.6 v2:172.21.15.136:6816/456908616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0288079980 con 0x7f0288076e10 2024-09-17T08:53:56.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 --> [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f029c060b30 con 0x7f0288076e10 2024-09-17T08:53:56.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f0293fff640 1 -- 172.21.15.78:0/2337192434 <== osd.6 v2:172.21.15.136:6816/456908616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f029c060b30 con 0x7f0288076e10 2024-09-17T08:53:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] conn(0x7f0288076e10 msgr2=0x7f02880792b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.136:6816/456908616,v1:172.21.15.136:6817/456908616] conn(0x7f0288076e10 0x7f02880792b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f028806cec0 msgr2=0x7f028806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f028806cec0 0x7f028806f380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f028c005d80 tx=0x7f028c005c90 comp rx=0 tx=0).stop 2024-09-17T08:53:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c102230 msgr2=0x7f029c0749c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 --2- 172.21.15.78:0/2337192434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f029c102230 0x7f029c0749c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f028400ea60 tx=0x7f028400ef20 comp rx=0 tx=0).stop 2024-09-17T08:53:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f029b59e640 1 -- 172.21.15.78:0/2337192434 reap_dead start 2024-09-17T08:53:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 shutdown_connections 2024-09-17T08:53:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:55.998+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 >> 172.21.15.78:0/2337192434 conn(0x7f029c0fdcb0 msgr2=0x7f029c0fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.002+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 shutdown_connections 2024-09-17T08:53:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.002+0000 7f02a107c640 1 -- 172.21.15.78:0/2337192434 wait complete. 2024-09-17T08:53:56.145 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:55 smithi078 bash[22670]: cluster 2024-09-17T08:53:54.718773+0000 mgr.y (mgr.14532) 75 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T08:53:56.145 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:55 smithi078 bash[32124]: cluster 2024-09-17T08:53:54.718773+0000 mgr.y (mgr.14532) 75 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T08:53:56.187 INFO:teuthology.orchestra.run.smithi078.stdout:111669149774 2024-09-17T08:53:56.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T08:53:56.250 INFO:teuthology.orchestra.run.smithi078.stdout:133143986242 2024-09-17T08:53:56.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T08:53:56.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:55 smithi136 bash[24812]: cluster 2024-09-17T08:53:54.718773+0000 mgr.y (mgr.14532) 75 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T08:53:56.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- 172.21.15.78:0/1514645613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f416410a3d0 msgr2=0x7f416410c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 --2- 172.21.15.78:0/1514645613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f416410a3d0 0x7f416410c870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f415c009ca0 tx=0x7f415c02a950 comp rx=0 tx=0).stop 2024-09-17T08:53:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- 172.21.15.78:0/1514645613 shutdown_connections 2024-09-17T08:53:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 --2- 172.21.15.78:0/1514645613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f416410a3d0 0x7f416410c870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 --2- 172.21.15.78:0/1514645613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41641018c0 0x7f4164109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 --2- 172.21.15.78:0/1514645613 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4164100fa0 0x7f4164101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- 172.21.15.78:0/1514645613 >> 172.21.15.78:0/1514645613 conn(0x7f41640faa20 msgr2=0x7f41640fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- 172.21.15.78:0/1514645613 shutdown_connections 2024-09-17T08:53:56.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- 172.21.15.78:0/1514645613 wait complete. 2024-09-17T08:53:56.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 Processor -- start 2024-09-17T08:53:56.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- start start 2024-09-17T08:53:56.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164100fa0 0x7f416419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:56.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41641018c0 0x7f416419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:56.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f416410a3d0 0x7f41641955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4164195c30 con 0x7f4164100fa0 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4164195da0 con 0x7f41641018c0 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416bd9c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4164195f60 con 0x7f416410a3d0 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164100fa0 0x7f416419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f416a339640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f416410a3d0 0x7f41641955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164100fa0 0x7f416419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39908/0 (socket says 172.21.15.78:39908) 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 -- 172.21.15.78:0/1859947163 learned_addr learned my addr 172.21.15.78:0/1859947163 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 -- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f416410a3d0 msgr2=0x7f41641955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f416410a3d0 0x7f41641955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 -- 172.21.15.78:0/1859947163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41641018c0 msgr2=0x7f416419ba30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41641018c0 0x7f416419ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.358+0000 7f4169b38640 1 -- 172.21.15.78:0/1859947163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c009900 con 0x7f4164100fa0 2024-09-17T08:53:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f4169b38640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164100fa0 0x7f416419b4f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f415400e9f0 tx=0x7f415400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154009720 con 0x7f4164100fa0 2024-09-17T08:53:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f415400cd80 con 0x7f4164100fa0 2024-09-17T08:53:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4164196240 con 0x7f4164100fa0 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154004e40 con 0x7f4164100fa0 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41641a24e0 con 0x7f4164100fa0 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f41540104b0 con 0x7f4164100fa0 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f416410f580 con 0x7f4164100fa0 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f415006cdb0 0x7f415006f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f4154014070 con 0x7f4164100fa0 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f4169337640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f415006cdb0 0x7f415006f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] conn(0x7f4150076b90 0x7f4150079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:53:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 --> [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4150079700 con 0x7f4150076b90 2024-09-17T08:53:56.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41540963b0 con 0x7f4164100fa0 2024-09-17T08:53:56.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f416a339640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] conn(0x7f4150076b90 0x7f4150079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:53:56.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.362+0000 7f4169337640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f415006cdb0 0x7f415006f270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4164196a50 tx=0x7f4160007b20 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:56.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.366+0000 7f416a339640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] conn(0x7f4150076b90 0x7f4150079030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:53:56.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.366+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== osd.1 v2:172.21.15.78:6810/4126079653 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4150079700 con 0x7f4150076b90 2024-09-17T08:53:56.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 --> [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4164068810 con 0x7f4150076b90 2024-09-17T08:53:56.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f415affd640 1 -- 172.21.15.78:0/1859947163 <== osd.1 v2:172.21.15.78:6810/4126079653 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4164068810 con 0x7f4150076b90 2024-09-17T08:53:56.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] conn(0x7f4150076b90 msgr2=0x7f4150079030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6810/4126079653,v1:172.21.15.78:6811/4126079653] conn(0x7f4150076b90 0x7f4150079030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f415006cdb0 msgr2=0x7f415006f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f415006cdb0 0x7f415006f270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4164196a50 tx=0x7f4160007b20 comp rx=0 tx=0).stop 2024-09-17T08:53:56.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164100fa0 msgr2=0x7f416419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:53:56.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 --2- 172.21.15.78:0/1859947163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164100fa0 0x7f416419b4f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f415400e9f0 tx=0x7f415400edf0 comp rx=0 tx=0).stop 2024-09-17T08:53:56.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416a339640 1 -- 172.21.15.78:0/1859947163 reap_dead start 2024-09-17T08:53:56.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 shutdown_connections 2024-09-17T08:53:56.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.378+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 >> 172.21.15.78:0/1859947163 conn(0x7f41640faa20 msgr2=0x7f4164101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:53:56.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.382+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 shutdown_connections 2024-09-17T08:53:56.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:53:56.382+0000 7f416bd9c640 1 -- 172.21.15.78:0/1859947163 wait complete. 2024-09-17T08:53:57.056 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:56 smithi078 bash[61548]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-alertmanager-a 2024-09-17T08:53:57.891 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:57 smithi078 bash[32124]: cluster 2024-09-17T08:53:56.719436+0000 mgr.y (mgr.14532) 76 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-17T08:53:57.892 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:57 smithi078 bash[22670]: cluster 2024-09-17T08:53:56.719436+0000 mgr.y (mgr.14532) 76 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-17T08:53:57.925 INFO:teuthology.orchestra.run.smithi078.stdout:236223201316 2024-09-17T08:53:57.926 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-17T08:53:57.959 INFO:teuthology.orchestra.run.smithi078.stdout:77309411417 2024-09-17T08:53:57.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T08:53:58.151 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:53:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:53:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:53:58.151 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:57 smithi078 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-17T08:53:58.151 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:57 smithi078 systemd[1]: Stopped Ceph alertmanager.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:53:58.151 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:57 smithi078 systemd[1]: Started Ceph alertmanager.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:53:58.152 INFO:teuthology.orchestra.run.smithi078.stdout:55834574947 2024-09-17T08:53:58.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T08:53:58.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:57 smithi136 bash[24812]: cluster 2024-09-17T08:53:56.719436+0000 mgr.y (mgr.14532) 76 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-17T08:53:58.843 INFO:teuthology.orchestra.run.smithi078.stdout:201863462959 2024-09-17T08:53:58.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-17T08:53:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:58 smithi078 bash[22670]: audit 2024-09-17T08:53:57.941669+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:58 smithi078 bash[22670]: audit 2024-09-17T08:53:57.947903+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:58 smithi078 bash[22670]: cephadm 2024-09-17T08:53:57.949620+0000 mgr.y (mgr.14532) 77 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T08:53:59.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:58 smithi078 bash[32124]: audit 2024-09-17T08:53:57.941669+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:59.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:58 smithi078 bash[32124]: audit 2024-09-17T08:53:57.947903+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:59.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:58 smithi078 bash[32124]: cephadm 2024-09-17T08:53:57.949620+0000 mgr.y (mgr.14532) 77 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T08:53:59.291 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:53:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:53:59.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:58 smithi136 bash[24812]: audit 2024-09-17T08:53:57.941669+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:59.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:58 smithi136 bash[24812]: audit 2024-09-17T08:53:57.947903+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:53:59.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:58 smithi136 bash[24812]: cephadm 2024-09-17T08:53:57.949620+0000 mgr.y (mgr.14532) 77 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T08:53:59.602 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.394Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-17T08:53:59.602 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.394Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-17T08:53:59.602 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.397Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.78 port=9094 2024-09-17T08:53:59.602 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.397Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-17T08:53:59.602 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.426Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T08:53:59.602 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.427Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T08:53:59.603 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.430Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-17T08:53:59.603 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[62002]: ts=2024-09-17T08:53:59.430Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-17T08:54:00.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:59 smithi136 bash[24812]: cephadm 2024-09-17T08:53:58.194955+0000 mgr.y (mgr.14532) 78 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi136 2024-09-17T08:54:00.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:53:59 smithi136 bash[24812]: cluster 2024-09-17T08:53:58.720636+0000 mgr.y (mgr.14532) 79 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:00.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[22670]: cephadm 2024-09-17T08:53:58.194955+0000 mgr.y (mgr.14532) 78 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi136 2024-09-17T08:54:00.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[22670]: cluster 2024-09-17T08:53:58.720636+0000 mgr.y (mgr.14532) 79 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[32124]: cephadm 2024-09-17T08:53:58.194955+0000 mgr.y (mgr.14532) 78 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi136 2024-09-17T08:54:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:53:59 smithi078 bash[32124]: cluster 2024-09-17T08:53:58.720636+0000 mgr.y (mgr.14532) 79 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:01.247 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:00 smithi136 bash[24812]: audit 2024-09-17T08:53:59.162651+0000 mgr.y (mgr.14532) 80 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:01.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:00 smithi078 bash[22670]: audit 2024-09-17T08:53:59.162651+0000 mgr.y (mgr.14532) 80 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:00 smithi078 bash[32124]: audit 2024-09-17T08:53:59.162651+0000 mgr.y (mgr.14532) 80 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:01.730 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:01.731 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:01.731 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:01.852 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:54:01 smithi078 bash[62002]: ts=2024-09-17T08:54:01.398Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00080259s 2024-09-17T08:54:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:01 smithi136 bash[24812]: cluster 2024-09-17T08:54:00.721376+0000 mgr.y (mgr.14532) 81 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:01 smithi078 bash[22670]: cluster 2024-09-17T08:54:00.721376+0000 mgr.y (mgr.14532) 81 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:02.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:01 smithi078 bash[32124]: cluster 2024-09-17T08:54:00.721376+0000 mgr.y (mgr.14532) 81 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:02.357 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 systemd[1]: Stopping Ceph prometheus.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T08:54:02.357 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T08:54:02.357 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-17T08:54:02.357 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.186Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.187Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.187Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.187Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-17T08:54:02.358 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[50523]: ts=2024-09-17T08:54:02.187Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-17T08:54:02.772 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[52959]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T08:54:03.041 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 bash[53018]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T08:54:03.041 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-17T08:54:03.041 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 systemd[1]: Stopped Ceph prometheus.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:54:03.041 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:02 smithi136 systemd[1]: Started Ceph prometheus.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T08:54:03.191 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:02 smithi078 bash[22923]: [17/Sep/2024:08:54:02] ENGINE Bus STOPPING 2024-09-17T08:54:03.593 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T08:54:03.593 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STOPPED 2024-09-17T08:54:03.593 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STARTING 2024-09-17T08:54:03.593 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Serving on http://:::9283 2024-09-17T08:54:03.593 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STARTED 2024-09-17T08:54:03.593 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STOPPING 2024-09-17T08:54:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:03.851 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T08:54:03.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STOPPED 2024-09-17T08:54:03.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STARTING 2024-09-17T08:54:03.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: cluster 2024-09-17T08:54:02.722162+0000 mgr.y (mgr.14532) 82 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:03.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.828239+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.838967+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.843964+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.844759+0000 mgr.y (mgr.14532) 83 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.846187+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.846659+0000 mgr.y (mgr.14532) 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.857475+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.868215+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.868861+0000 mgr.y (mgr.14532) 85 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.872713+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.873219+0000 mgr.y (mgr.14532) 86 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.883489+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.894882+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.895441+0000 mgr.y (mgr.14532) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T08:54:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.898757+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.899252+0000 mgr.y (mgr.14532) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.907616+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22670]: audit 2024-09-17T08:54:02.981230+0000 mon.a (mon.0) 874 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: cluster 2024-09-17T08:54:02.722162+0000 mgr.y (mgr.14532) 82 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.828239+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.838967+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.843964+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.844759+0000 mgr.y (mgr.14532) 83 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.846187+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.846659+0000 mgr.y (mgr.14532) 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T08:54:03.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.857475+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.868215+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.868861+0000 mgr.y (mgr.14532) 85 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.872713+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.873219+0000 mgr.y (mgr.14532) 86 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.883489+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.894882+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.895441+0000 mgr.y (mgr.14532) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.898757+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.899252+0000 mgr.y (mgr.14532) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.907616+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:03.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[32124]: audit 2024-09-17T08:54:02.981230+0000 mon.a (mon.0) 874 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: cluster 2024-09-17T08:54:02.722162+0000 mgr.y (mgr.14532) 82 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.828239+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.838967+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.843964+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.844759+0000 mgr.y (mgr.14532) 83 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.846187+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.846659+0000 mgr.y (mgr.14532) 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.857475+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.868215+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.868861+0000 mgr.y (mgr.14532) 85 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.872713+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.873219+0000 mgr.y (mgr.14532) 86 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.883489+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.894882+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.895441+0000 mgr.y (mgr.14532) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.898757+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.899252+0000 mgr.y (mgr.14532) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.907616+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[24812]: audit 2024-09-17T08:54:02.981230+0000 mon.a (mon.0) 874 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:54:04.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.924Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-17T08:54:04.293 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.924Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.924Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi136 (none))" 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.925Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.925Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.926Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.927Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.928Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.929Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.930Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.930Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.889µs 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.930Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.930Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.931Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.931Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=26.688µs wal_replay_duration=868.27µs wbl_replay_duration=143ns total_replay_duration=915.774µs 2024-09-17T08:54:04.294 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.933Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T08:54:04.295 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.933Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-17T08:54:04.295 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.933Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T08:54:04.295 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.958Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=25.104346ms db_storage=938ns remote_storage=1.372µs web_handler=414ns query_engine=895ns scrape=263.838µs scrape_sd=108.343µs notify=12.344µs notify_sd=20.193µs rules=24.206181ms tracing=6.956µs 2024-09-17T08:54:04.295 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.958Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-17T08:54:04.295 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 08:54:03 smithi136 bash[53045]: ts=2024-09-17T08:54:03.958Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-17T08:54:04.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Serving on http://:::9283 2024-09-17T08:54:04.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STARTED 2024-09-17T08:54:04.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:03 smithi078 bash[22923]: [17/Sep/2024:08:54:03] ENGINE Bus STOPPING 2024-09-17T08:54:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:04 smithi078 bash[22923]: [17/Sep/2024:08:54:04] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T08:54:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:04 smithi078 bash[22923]: [17/Sep/2024:08:54:04] ENGINE Bus STOPPED 2024-09-17T08:54:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:04 smithi078 bash[22923]: [17/Sep/2024:08:54:04] ENGINE Bus STARTING 2024-09-17T08:54:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:04 smithi078 bash[22923]: [17/Sep/2024:08:54:04] ENGINE Serving on http://:::9283 2024-09-17T08:54:04.852 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:04 smithi078 bash[22923]: [17/Sep/2024:08:54:04] ENGINE Bus STARTED 2024-09-17T08:54:06.082 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:05 smithi078 bash[32124]: cluster 2024-09-17T08:54:04.723719+0000 mgr.y (mgr.14532) 89 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:06.082 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:05 smithi078 bash[22670]: cluster 2024-09-17T08:54:04.723719+0000 mgr.y (mgr.14532) 89 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:06.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:05 smithi136 bash[24812]: cluster 2024-09-17T08:54:04.723719+0000 mgr.y (mgr.14532) 89 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:07 smithi078 bash[22670]: cluster 2024-09-17T08:54:06.724385+0000 mgr.y (mgr.14532) 90 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T08:54:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:07 smithi078 bash[22670]: audit 2024-09-17T08:54:06.931949+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:08.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:07 smithi078 bash[32124]: cluster 2024-09-17T08:54:06.724385+0000 mgr.y (mgr.14532) 90 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T08:54:08.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:07 smithi078 bash[32124]: audit 2024-09-17T08:54:06.931949+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:07 smithi136 bash[24812]: cluster 2024-09-17T08:54:06.724385+0000 mgr.y (mgr.14532) 90 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T08:54:08.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:07 smithi136 bash[24812]: audit 2024-09-17T08:54:06.931949+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:09.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:54:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:54:09.686 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 08:54:09 smithi078 bash[62002]: ts=2024-09-17T08:54:09.400Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00243755s 2024-09-17T08:54:10.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:09 smithi136 bash[24812]: cluster 2024-09-17T08:54:08.725190+0000 mgr.y (mgr.14532) 91 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:10.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:09 smithi136 bash[24812]: audit 2024-09-17T08:54:08.749997+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:10.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:09 smithi136 bash[24812]: audit 2024-09-17T08:54:08.758215+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:09 smithi078 bash[32124]: cluster 2024-09-17T08:54:08.725190+0000 mgr.y (mgr.14532) 91 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:09 smithi078 bash[32124]: audit 2024-09-17T08:54:08.749997+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:09 smithi078 bash[32124]: audit 2024-09-17T08:54:08.758215+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:09 smithi078 bash[22670]: cluster 2024-09-17T08:54:08.725190+0000 mgr.y (mgr.14532) 91 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:09 smithi078 bash[22670]: audit 2024-09-17T08:54:08.749997+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:09 smithi078 bash[22670]: audit 2024-09-17T08:54:08.758215+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:11.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:10 smithi136 bash[24812]: audit 2024-09-17T08:54:09.170939+0000 mgr.y (mgr.14532) 92 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:11.128 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:10 smithi078 bash[22670]: audit 2024-09-17T08:54:09.170939+0000 mgr.y (mgr.14532) 92 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:11.128 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:10 smithi078 bash[32124]: audit 2024-09-17T08:54:09.170939+0000 mgr.y (mgr.14532) 92 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:12.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:11 smithi136 bash[24812]: cluster 2024-09-17T08:54:10.725791+0000 mgr.y (mgr.14532) 93 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:12.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:11 smithi078 bash[32124]: cluster 2024-09-17T08:54:10.725791+0000 mgr.y (mgr.14532) 93 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:11 smithi078 bash[22670]: cluster 2024-09-17T08:54:10.725791+0000 mgr.y (mgr.14532) 93 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/1230660238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 msgr2=0x7feb3010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 --2- 172.21.15.78:0/1230660238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 0x7feb3010cce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feb28009cd0 tx=0x7feb2802a8e0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/1230660238 shutdown_connections 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 --2- 172.21.15.78:0/1230660238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 0x7feb3010cce0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 --2- 172.21.15.78:0/1230660238 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb301009e0 0x7feb30104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 --2- 172.21.15.78:0/1230660238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb30100030 0x7feb30100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/1230660238 >> 172.21.15.78:0/1230660238 conn(0x7feb300fbad0 msgr2=0x7feb300fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/1230660238 shutdown_connections 2024-09-17T08:54:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/1230660238 wait complete. 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 Processor -- start 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- start start 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb30100030 0x7feb300727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb301009e0 0x7feb30072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 0x7feb30073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb301a3b70 con 0x7feb30105160 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb301a3ce0 con 0x7feb30100030 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb301a3ea0 con 0x7feb301009e0 2024-09-17T08:54:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb301009e0 0x7feb30072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb301009e0 0x7feb30072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:38708/0 (socket says 172.21.15.78:38708) 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 -- 172.21.15.78:0/146311857 learned_addr learned my addr 172.21.15.78:0/146311857 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2f59e640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 0x7feb30073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2ed9d640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb30100030 0x7feb300727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 -- 172.21.15.78:0/146311857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb30100030 msgr2=0x7feb300727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb30100030 0x7feb300727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 -- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 msgr2=0x7feb30073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 0x7feb30073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 -- 172.21.15.78:0/146311857 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20009490 con 0x7feb301009e0 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2f59e640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 0x7feb30073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb2e59c640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb301009e0 0x7feb30072cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb2400b4a0 tx=0x7feb2400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb17fff640 1 -- 172.21.15.78:0/146311857 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24010610 con 0x7feb301009e0 2024-09-17T08:54:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb17fff640 1 -- 172.21.15.78:0/146311857 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7feb24010bc0 con 0x7feb301009e0 2024-09-17T08:54:12.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb28009900 con 0x7feb301009e0 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb17fff640 1 -- 172.21.15.78:0/146311857 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24017bb0 con 0x7feb301009e0 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb301a44f0 con 0x7feb301009e0 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.278+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb30101510 con 0x7feb301009e0 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.282+0000 7feb17fff640 1 -- 172.21.15.78:0/146311857 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7feb24017d10 con 0x7feb301009e0 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.282+0000 7feb17fff640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb1806cec0 0x7feb1806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.282+0000 7feb17fff640 1 -- 172.21.15.78:0/146311857 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7feb2408c430 con 0x7feb301009e0 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.282+0000 7feb2ed9d640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb1806cec0 0x7feb1806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.282+0000 7feb2ed9d640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb1806cec0 0x7feb1806f380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb20009cf0 tx=0x7feb20005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:12.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.286+0000 7feb17fff640 1 -- 172.21.15.78:0/146311857 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb24056090 con 0x7feb301009e0 2024-09-17T08:54:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- 172.21.15.78:0/2356719523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 msgr2=0x7f671c101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 --2- 172.21.15.78:0/2356719523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c101380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6718009900 tx=0x7f671802a480 comp rx=0 tx=0).stop 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- 172.21.15.78:0/2356719523 shutdown_connections 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 --2- 172.21.15.78:0/2356719523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c10a3d0 0x7f671c10c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 --2- 172.21.15.78:0/2356719523 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f671c1018c0 0x7f671c109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 --2- 172.21.15.78:0/2356719523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c101380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- 172.21.15.78:0/2356719523 >> 172.21.15.78:0/2356719523 conn(0x7f671c0faa20 msgr2=0x7f671c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- 172.21.15.78:0/2356719523 shutdown_connections 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- 172.21.15.78:0/2356719523 wait complete. 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 Processor -- start 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- start start 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c1018c0 0x7f671c195c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f671c10a3d0 0x7f671c198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c1995d0 con 0x7f671c100fa0 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c199740 con 0x7f671c1018c0 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f67243bc640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c199900 con 0x7f671c10a3d0 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c195740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34214/0 (socket says 172.21.15.78:34214) 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 -- 172.21.15.78:0/1639809046 learned_addr learned my addr 172.21.15.78:0/1639809046 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722959640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f671c10a3d0 0x7f671c198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6721957640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c1018c0 0x7f671c195c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 -- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f671c10a3d0 msgr2=0x7f671c198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f671c10a3d0 0x7f671c198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 -- 172.21.15.78:0/1639809046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c1018c0 msgr2=0x7f671c195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c1018c0 0x7f671c195c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.458+0000 7f6722158640 1 -- 172.21.15.78:0/1639809046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009490 con 0x7f671c100fa0 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f6722158640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c195740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6718006010 tx=0x7f6718004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67137fe640 1 -- 172.21.15.78:0/1639809046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718004ff0 con 0x7f671c100fa0 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67137fe640 1 -- 172.21.15.78:0/1639809046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f67180055a0 con 0x7f671c100fa0 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6718009560 con 0x7f671c100fa0 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67137fe640 1 -- 172.21.15.78:0/1639809046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718003de0 con 0x7f671c100fa0 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c199e00 con 0x7f671c100fa0 2024-09-17T08:54:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c068810 con 0x7f671c100fa0 2024-09-17T08:54:12.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67137fe640 1 -- 172.21.15.78:0/1639809046 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f6718048070 con 0x7f671c100fa0 2024-09-17T08:54:12.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67137fe640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f670806cec0 0x7f670806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f67137fe640 1 -- 172.21.15.78:0/1639809046 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f67180ad130 con 0x7f671c100fa0 2024-09-17T08:54:12.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f6721957640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f670806cec0 0x7f670806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.462+0000 7f6721957640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f670806cec0 0x7f670806f380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f671c196cf0 tx=0x7f670c005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:12.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.466+0000 7f67137fe640 1 -- 172.21.15.78:0/1639809046 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6718076e10 con 0x7f671c100fa0 2024-09-17T08:54:12.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.474+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feb30073ce0 con 0x7feb301009e0 2024-09-17T08:54:12.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.474+0000 7feb17fff640 1 -- 172.21.15.78:0/146311857 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb240596b0 con 0x7feb301009e0 2024-09-17T08:54:12.477 INFO:teuthology.orchestra.run.smithi078.stdout:34359738480 2024-09-17T08:54:12.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb1806cec0 msgr2=0x7feb1806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb1806cec0 0x7feb1806f380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb20009cf0 tx=0x7feb20005f90 comp rx=0 tx=0).stop 2024-09-17T08:54:12.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb301009e0 msgr2=0x7feb30072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb301009e0 0x7feb30072cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb2400b4a0 tx=0x7feb2400b960 comp rx=0 tx=0).stop 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 shutdown_connections 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7feb1806cec0 0x7feb1806f380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb30105160 0x7feb30073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb301009e0 0x7feb30072cf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 --2- 172.21.15.78:0/146311857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb30100030 0x7feb300727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 >> 172.21.15.78:0/146311857 conn(0x7feb300fbad0 msgr2=0x7feb300fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 shutdown_connections 2024-09-17T08:54:12.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.478+0000 7feb35014640 1 -- 172.21.15.78:0/146311857 wait complete. 2024-09-17T08:54:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.642+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f671c105440 con 0x7f671c100fa0 2024-09-17T08:54:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.642+0000 7f67137fe640 1 -- 172.21.15.78:0/1639809046 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f671807a430 con 0x7f671c100fa0 2024-09-17T08:54:12.645 INFO:teuthology.orchestra.run.smithi078.stdout:236223201319 2024-09-17T08:54:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.642+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f670806cec0 msgr2=0x7f670806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.642+0000 7f67243bc640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f670806cec0 0x7f670806f380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f671c196cf0 tx=0x7f670c005f90 comp rx=0 tx=0).stop 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 msgr2=0x7f671c195740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c195740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6718006010 tx=0x7f6718004d30 comp rx=0 tx=0).stop 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 shutdown_connections 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f670806cec0 0x7f670806f380 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f671c10a3d0 0x7f671c198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c1018c0 0x7f671c195c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 --2- 172.21.15.78:0/1639809046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f671c100fa0 0x7f671c195740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 >> 172.21.15.78:0/1639809046 conn(0x7f671c0faa20 msgr2=0x7f671c0fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 shutdown_connections 2024-09-17T08:54:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.646+0000 7f67243bc640 1 -- 172.21.15.78:0/1639809046 wait complete. 2024-09-17T08:54:12.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/3426140514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 msgr2=0x7f144c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 --2- 172.21.15.78:0/3426140514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 0x7f144c104a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1448009890 tx=0x7f144802a360 comp rx=0 tx=0).stop 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/3426140514 shutdown_connections 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 --2- 172.21.15.78:0/3426140514 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 0x7f144c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 --2- 172.21.15.78:0/3426140514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 0x7f144c104a30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 --2- 172.21.15.78:0/3426140514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f144c100030 0x7f144c100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/3426140514 >> 172.21.15.78:0/3426140514 conn(0x7f144c0fbad0 msgr2=0x7f144c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/3426140514 shutdown_connections 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/3426140514 wait complete. 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 Processor -- start 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- start start 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f144c100030 0x7f144c19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 0x7f144c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 0x7f144c1956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c195d10 con 0x7f144c1009e0 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c195e80 con 0x7f144c100030 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c196040 con 0x7f144c105160 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 0x7f144c1956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 0x7f144c1956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39786/0 (socket says 172.21.15.78:39786) 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 -- 172.21.15.78:0/1454253374 learned_addr learned my addr 172.21.15.78:0/1454253374 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1451238640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 0x7f144c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1451a39640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f144c100030 0x7f144c19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 -- 172.21.15.78:0/1454253374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f144c100030 msgr2=0x7f144c19b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f144c100030 0x7f144c19b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 -- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 msgr2=0x7f144c19bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 0x7f144c19bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 -- 172.21.15.78:0/1454253374 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448009490 con 0x7f144c105160 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1451238640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 0x7f144c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f145223a640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 0x7f144c1956c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1444009fd0 tx=0x7f144400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1442ffd640 1 -- 172.21.15.78:0/1454253374 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444009b50 con 0x7f144c105160 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144c196320 con 0x7f144c105160 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1442ffd640 1 -- 172.21.15.78:0/1454253374 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1444003970 con 0x7f144c105160 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1442ffd640 1 -- 172.21.15.78:0/1454253374 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444004590 con 0x7f144c105160 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144c1a25c0 con 0x7f144c105160 2024-09-17T08:54:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144c101510 con 0x7f144c105160 2024-09-17T08:54:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1442ffd640 1 -- 172.21.15.78:0/1454253374 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f144400a040 con 0x7f144c105160 2024-09-17T08:54:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1442ffd640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f143806cec0 0x7f143806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1442ffd640 1 -- 172.21.15.78:0/1454253374 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f144408caa0 con 0x7f144c105160 2024-09-17T08:54:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1451a39640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f143806cec0 0x7f143806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.898+0000 7f1451a39640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f143806cec0 0x7f143806f380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f143c00a810 tx=0x7f143c008040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:12.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:12.902+0000 7f1442ffd640 1 -- 172.21.15.78:0/1454253374 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1444056650 con 0x7f144c105160 2024-09-17T08:54:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:12 smithi136 bash[24812]: audit 2024-09-17T08:54:12.480450+0000 mon.c (mon.2) 24 : audit [DBG] from='client.? 172.21.15.78:0/146311857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T08:54:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:12 smithi136 bash[24812]: audit 2024-09-17T08:54:12.648296+0000 mon.a (mon.0) 878 : audit [DBG] from='client.? 172.21.15.78:0/1639809046' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-17T08:54:13.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.074+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f144c196bd0 con 0x7f144c105160 2024-09-17T08:54:13.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.074+0000 7f1442ffd640 1 -- 172.21.15.78:0/1454253374 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1444059c70 con 0x7f144c105160 2024-09-17T08:54:13.077 INFO:teuthology.orchestra.run.smithi078.stdout:133143986245 2024-09-17T08:54:13.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.074+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f143806cec0 msgr2=0x7f143806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:13.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.074+0000 7f1453c9d640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f143806cec0 0x7f143806f380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f143c00a810 tx=0x7f143c008040 comp rx=0 tx=0).stop 2024-09-17T08:54:13.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.074+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 msgr2=0x7f144c1956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:13.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.074+0000 7f1453c9d640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 0x7f144c1956c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1444009fd0 tx=0x7f144400c800 comp rx=0 tx=0).stop 2024-09-17T08:54:13.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 shutdown_connections 2024-09-17T08:54:13.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f143806cec0 0x7f143806f380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:13.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f144c105160 0x7f144c1956c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:13.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f144c1009e0 0x7f144c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:13.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 --2- 172.21.15.78:0/1454253374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f144c100030 0x7f144c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:13.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 >> 172.21.15.78:0/1454253374 conn(0x7f144c0fbad0 msgr2=0x7f144c0fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:13.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 shutdown_connections 2024-09-17T08:54:13.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:13.078+0000 7f1453c9d640 1 -- 172.21.15.78:0/1454253374 wait complete. 2024-09-17T08:54:13.099 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:12 smithi078 bash[22670]: audit 2024-09-17T08:54:12.480450+0000 mon.c (mon.2) 24 : audit [DBG] from='client.? 172.21.15.78:0/146311857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T08:54:13.099 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:12 smithi078 bash[22670]: audit 2024-09-17T08:54:12.648296+0000 mon.a (mon.0) 878 : audit [DBG] from='client.? 172.21.15.78:0/1639809046' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-17T08:54:13.099 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:12 smithi078 bash[32124]: audit 2024-09-17T08:54:12.480450+0000 mon.c (mon.2) 24 : audit [DBG] from='client.? 172.21.15.78:0/146311857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T08:54:13.099 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:12 smithi078 bash[32124]: audit 2024-09-17T08:54:12.648296+0000 mon.a (mon.0) 878 : audit [DBG] from='client.? 172.21.15.78:0/1639809046' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-17T08:54:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:13 smithi078 bash[32124]: cluster 2024-09-17T08:54:12.726205+0000 mgr.y (mgr.14532) 94 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:13 smithi078 bash[32124]: audit 2024-09-17T08:54:13.079789+0000 mon.c (mon.2) 25 : audit [DBG] from='client.? 172.21.15.78:0/1454253374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T08:54:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:13 smithi078 bash[22670]: cluster 2024-09-17T08:54:12.726205+0000 mgr.y (mgr.14532) 94 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:13 smithi078 bash[22670]: audit 2024-09-17T08:54:13.079789+0000 mon.c (mon.2) 25 : audit [DBG] from='client.? 172.21.15.78:0/1454253374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T08:54:14.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:13 smithi136 bash[24812]: cluster 2024-09-17T08:54:12.726205+0000 mgr.y (mgr.14532) 94 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:14.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:13 smithi136 bash[24812]: audit 2024-09-17T08:54:13.079789+0000 mon.c (mon.2) 25 : audit [DBG] from='client.? 172.21.15.78:0/1454253374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T08:54:14.824 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738476 got 34359738480 for osd.0 2024-09-17T08:54:14.825 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:16.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:15 smithi136 bash[24812]: cluster 2024-09-17T08:54:14.727568+0000 mgr.y (mgr.14532) 95 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:16.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:15 smithi078 bash[22670]: cluster 2024-09-17T08:54:14.727568+0000 mgr.y (mgr.14532) 95 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:16.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:15 smithi078 bash[32124]: cluster 2024-09-17T08:54:14.727568+0000 mgr.y (mgr.14532) 95 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:16.133 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201316 got 236223201319 for osd.7 2024-09-17T08:54:16.133 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:16.148 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986242 got 133143986245 for osd.4 2024-09-17T08:54:16.148 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:16.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- 172.21.15.78:0/1523422058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c01018c0 msgr2=0x7f34c0109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 --2- 172.21.15.78:0/1523422058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c01018c0 0x7f34c0109db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009900 tx=0x7f34b402a480 comp rx=0 tx=0).stop 2024-09-17T08:54:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- 172.21.15.78:0/1523422058 shutdown_connections 2024-09-17T08:54:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 --2- 172.21.15.78:0/1523422058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34c010a3d0 0x7f34c010c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 --2- 172.21.15.78:0/1523422058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c01018c0 0x7f34c0109db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 --2- 172.21.15.78:0/1523422058 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c0100fa0 0x7f34c0101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- 172.21.15.78:0/1523422058 >> 172.21.15.78:0/1523422058 conn(0x7f34c00faa20 msgr2=0x7f34c00fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- 172.21.15.78:0/1523422058 shutdown_connections 2024-09-17T08:54:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- 172.21.15.78:0/1523422058 wait complete. 2024-09-17T08:54:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 Processor -- start 2024-09-17T08:54:16.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- start start 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c0100fa0 0x7f34c0195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c01018c0 0x7f34c0195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34c010a3d0 0x7f34c0198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c01995e0 con 0x7f34c0100fa0 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0199750 con 0x7f34c010a3d0 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0199910 con 0x7f34c01018c0 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c01018c0 0x7f34c0195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c0100fa0 0x7f34c0195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c0100fa0 0x7f34c0195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48474/0 (socket says 172.21.15.78:48474) 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c01018c0 0x7f34c0195c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39806/0 (socket says 172.21.15.78:39806) 2024-09-17T08:54:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bffff640 1 -- 172.21.15.78:0/2269499391 learned_addr learned my addr 172.21.15.78:0/2269499391 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c4cf9640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34c010a3d0 0x7f34c0198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 -- 172.21.15.78:0/2269499391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34c010a3d0 msgr2=0x7f34c0198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34c010a3d0 0x7f34c0198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 -- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c0100fa0 msgr2=0x7f34c0195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c0100fa0 0x7f34c0195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 -- 172.21.15.78:0/2269499391 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b0009490 con 0x7f34c01018c0 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bffff640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c0100fa0 0x7f34c0195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bf7fe640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c01018c0 0x7f34c0195c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34b4005ab0 tx=0x7f34b4032b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bd7fa640 1 -- 172.21.15.78:0/2269499391 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b40048c0 con 0x7f34c01018c0 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b4009560 con 0x7f34c01018c0 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bd7fa640 1 -- 172.21.15.78:0/2269499391 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f34b4004ef0 con 0x7f34c01018c0 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34bd7fa640 1 -- 172.21.15.78:0/2269499391 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4003850 con 0x7f34c01018c0 2024-09-17T08:54:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.270+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c01a2370 con 0x7f34c01018c0 2024-09-17T08:54:16.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.274+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c010b790 con 0x7f34c01018c0 2024-09-17T08:54:16.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.274+0000 7f34bd7fa640 1 -- 172.21.15.78:0/2269499391 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f34b40039b0 con 0x7f34c01018c0 2024-09-17T08:54:16.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.274+0000 7f34bd7fa640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f34a806cec0 0x7f34a806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.274+0000 7f34bd7fa640 1 -- 172.21.15.78:0/2269499391 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f34b40ad340 con 0x7f34c01018c0 2024-09-17T08:54:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.274+0000 7f34bffff640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f34a806cec0 0x7f34a806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.274+0000 7f34bffff640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f34a806cec0 0x7f34a806f380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f34b0011690 tx=0x7f34b0005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.278+0000 7f34bd7fa640 1 -- 172.21.15.78:0/2269499391 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f34b4076fa0 con 0x7f34c01018c0 2024-09-17T08:54:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- 172.21.15.78:0/3573121972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0fef40 msgr2=0x7ff50c0ff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 --2- 172.21.15.78:0/3573121972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0fef40 0x7ff50c0ff320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff508009900 tx=0x7ff50802a410 comp rx=0 tx=0).stop 2024-09-17T08:54:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- 172.21.15.78:0/3573121972 shutdown_connections 2024-09-17T08:54:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 --2- 172.21.15.78:0/3573121972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c104070 0x7ff50c10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 --2- 172.21.15.78:0/3573121972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c0ff8f0 0x7ff50c103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 --2- 172.21.15.78:0/3573121972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0fef40 0x7ff50c0ff320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- 172.21.15.78:0/3573121972 >> 172.21.15.78:0/3573121972 conn(0x7ff50c0faa20 msgr2=0x7ff50c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- 172.21.15.78:0/3573121972 shutdown_connections 2024-09-17T08:54:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- 172.21.15.78:0/3573121972 wait complete. 2024-09-17T08:54:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 Processor -- start 2024-09-17T08:54:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- start start 2024-09-17T08:54:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c0fef40 0x7ff50c1965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0ff8f0 0x7ff50c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c104070 0x7ff50c1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c197390 con 0x7ff50c0fef40 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c1a1b60 con 0x7ff50c104070 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff514487640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c1a1ca0 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff512223640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c0fef40 0x7ff50c1965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff511a22640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0ff8f0 0x7ff50c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff512223640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c0fef40 0x7ff50c1965a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48498/0 (socket says 172.21.15.78:48498) 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff512223640 1 -- 172.21.15.78:0/332040920 learned_addr learned my addr 172.21.15.78:0/332040920 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff512a24640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c104070 0x7ff50c1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff511a22640 1 -- 172.21.15.78:0/332040920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c104070 msgr2=0x7ff50c1a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff511a22640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c104070 0x7ff50c1a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff511a22640 1 -- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c0fef40 msgr2=0x7ff50c1965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff511a22640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c0fef40 0x7ff50c1965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff511a22640 1 -- 172.21.15.78:0/332040920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508009560 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff512223640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c0fef40 0x7ff50c1965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:54:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff511a22640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0ff8f0 0x7ff50c196ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00b3f0 tx=0x7ff4fc00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff5037fe640 1 -- 172.21.15.78:0/332040920 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc011830 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.378+0000 7ff5037fe640 1 -- 172.21.15.78:0/332040920 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7ff4fc011de0 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c1a1f50 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff5037fe640 1 -- 172.21.15.78:0/332040920 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc010ca0 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c1a23c0 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c100420 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff5037fe640 1 -- 172.21.15.78:0/332040920 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7ff4fc010380 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff5037fe640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff4f806cec0 0x7ff4f806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff5037fe640 1 -- 172.21.15.78:0/332040920 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7ff4fc08c590 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff512223640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff4f806cec0 0x7ff4f806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.382+0000 7ff512223640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff4f806cec0 0x7ff4f806f380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff508000c00 tx=0x7ff508005a20 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.390+0000 7ff5037fe640 1 -- 172.21.15.78:0/332040920 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff4fc056140 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.474+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34c01013b0 con 0x7f34c01018c0 2024-09-17T08:54:16.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.474+0000 7f34bd7fa640 1 -- 172.21.15.78:0/2269499391 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34b407a5c0 con 0x7f34c01018c0 2024-09-17T08:54:16.475 INFO:teuthology.orchestra.run.smithi078.stdout:111669149778 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f34a806cec0 msgr2=0x7f34a806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f34a806cec0 0x7f34a806f380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f34b0011690 tx=0x7f34b0005f90 comp rx=0 tx=0).stop 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c01018c0 msgr2=0x7f34c0195c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c01018c0 0x7f34c0195c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34b4005ab0 tx=0x7f34b4032b50 comp rx=0 tx=0).stop 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 shutdown_connections 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f34a806cec0 0x7f34a806f380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34c010a3d0 0x7f34c0198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34c01018c0 0x7f34c0195c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 --2- 172.21.15.78:0/2269499391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34c0100fa0 0x7f34c0195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 >> 172.21.15.78:0/2269499391 conn(0x7f34c00faa20 msgr2=0x7f34c00fb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 shutdown_connections 2024-09-17T08:54:16.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.478+0000 7f34c675c640 1 -- 172.21.15.78:0/2269499391 wait complete. 2024-09-17T08:54:16.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- 172.21.15.78:0/3454941797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101980 msgr2=0x7ff904109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/3454941797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101980 0x7ff904109e70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009900 tx=0x7ff8f402a480 comp rx=0 tx=0).stop 2024-09-17T08:54:16.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- 172.21.15.78:0/3454941797 shutdown_connections 2024-09-17T08:54:16.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/3454941797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff90410a400 0x7ff90410c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/3454941797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101980 0x7ff904109e70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/3454941797 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101060 0x7ff904101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- 172.21.15.78:0/3454941797 >> 172.21.15.78:0/3454941797 conn(0x7ff9040faa20 msgr2=0x7ff9040fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- 172.21.15.78:0/3454941797 shutdown_connections 2024-09-17T08:54:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- 172.21.15.78:0/3454941797 wait complete. 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 Processor -- start 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- start start 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101060 0x7ff90419b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101980 0x7ff90419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff90410a400 0x7ff904195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff904195c50 con 0x7ff904101060 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff904195dc0 con 0x7ff90410a400 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff904195f80 con 0x7ff904101980 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101980 0x7ff90419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101980 0x7ff90419ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39862/0 (socket says 172.21.15.78:39862) 2024-09-17T08:54:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 -- 172.21.15.78:0/2905958242 learned_addr learned my addr 172.21.15.78:0/2905958242 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909a97640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101060 0x7ff90419b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90a298640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff90410a400 0x7ff904195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 -- 172.21.15.78:0/2905958242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff90410a400 msgr2=0x7ff904195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff90410a400 0x7ff904195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 -- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101060 msgr2=0x7ff90419b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101060 0x7ff90419b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 -- 172.21.15.78:0/2905958242 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900009490 con 0x7ff904101980 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909a97640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101060 0x7ff90419b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff909296640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101980 0x7ff90419ba50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4005ab0 tx=0x7ff8f4032bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff8faffd640 1 -- 172.21.15.78:0/2905958242 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40046c0 con 0x7ff904101980 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff8faffd640 1 -- 172.21.15.78:0/2905958242 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7ff8f4004c70 con 0x7ff904101980 2024-09-17T08:54:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f4009560 con 0x7ff904101980 2024-09-17T08:54:16.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff8faffd640 1 -- 172.21.15.78:0/2905958242 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40035f0 con 0x7ff904101980 2024-09-17T08:54:16.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.522+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9041a2330 con 0x7ff904101980 2024-09-17T08:54:16.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.526+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff904068750 con 0x7ff904101980 2024-09-17T08:54:16.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.526+0000 7ff8faffd640 1 -- 172.21.15.78:0/2905958242 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7ff8f4004ef0 con 0x7ff904101980 2024-09-17T08:54:16.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.526+0000 7ff8faffd640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff8f006cec0 0x7ff8f006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.526+0000 7ff8faffd640 1 -- 172.21.15.78:0/2905958242 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7ff8f40ad560 con 0x7ff904101980 2024-09-17T08:54:16.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.526+0000 7ff909a97640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff8f006cec0 0x7ff8f006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.526+0000 7ff909a97640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff8f006cec0 0x7ff8f006f380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff900011630 tx=0x7ff900005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.530+0000 7ff8faffd640 1 -- 172.21.15.78:0/2905958242 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff8f4077240 con 0x7ff904101980 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/989638357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 msgr2=0x7f4f28101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/989638357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 0x7f4f28101420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009900 tx=0x7f4f1c02a480 comp rx=0 tx=0).stop 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/989638357 shutdown_connections 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/989638357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 0x7f4f2810c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/989638357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28101960 0x7f4f28109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/989638357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 0x7f4f28101420 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/989638357 >> 172.21.15.78:0/989638357 conn(0x7f4f280faa20 msgr2=0x7f4f280fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/989638357 shutdown_connections 2024-09-17T08:54:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/989638357 wait complete. 2024-09-17T08:54:16.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 Processor -- start 2024-09-17T08:54:16.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- start start 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 0x7f4f2819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28101960 0x7f4f2819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 0x7f4f28197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28197e00 con 0x7f4f28101040 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28197f70 con 0x7f4f28101960 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2ed4e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28198130 con 0x7f4f2810a3e0 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2d2eb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 0x7f4f28197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2caea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 0x7f4f2819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2d2eb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 0x7f4f28197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39882/0 (socket says 172.21.15.78:39882) 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.554+0000 7f4f2d2eb640 1 -- 172.21.15.78:0/1711760120 learned_addr learned my addr 172.21.15.78:0/1711760120 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f27fff640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28101960 0x7f4f2819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2caea640 1 -- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 msgr2=0x7f4f28197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2caea640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 0x7f4f28197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2caea640 1 -- 172.21.15.78:0/1711760120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28101960 msgr2=0x7f4f2819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2caea640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28101960 0x7f4f2819dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2caea640 1 -- 172.21.15.78:0/1711760120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c009560 con 0x7f4f28101040 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f27fff640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28101960 0x7f4f2819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2d2eb640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 0x7f4f28197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2caea640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 0x7f4f2819d6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005ab0 tx=0x7f4f1c032ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f25ffb640 1 -- 172.21.15.78:0/1711760120 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c004980 con 0x7f4f28101040 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f281983b0 con 0x7f4f28101040 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f25ffb640 1 -- 172.21.15.78:0/1711760120 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4f1c004ae0 con 0x7f4f28101040 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f25ffb640 1 -- 172.21.15.78:0/1711760120 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c005690 con 0x7f4f28101040 2024-09-17T08:54:16.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f281a4750 con 0x7f4f28101040 2024-09-17T08:54:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f28068770 con 0x7f4f28101040 2024-09-17T08:54:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f25ffb640 1 -- 172.21.15.78:0/1711760120 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f4f1c004ef0 con 0x7f4f28101040 2024-09-17T08:54:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f25ffb640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f4f1806cec0 0x7f4f1806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f25ffb640 1 -- 172.21.15.78:0/1711760120 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f4f1c0ad160 con 0x7f4f28101040 2024-09-17T08:54:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f27fff640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f4f1806cec0 0x7f4f1806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.558+0000 7f4f27fff640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f4f1806cec0 0x7f4f1806f380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f28198f80 tx=0x7f4f14005d30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.570+0000 7f4f25ffb640 1 -- 172.21.15.78:0/1711760120 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4f1c076d60 con 0x7f4f28101040 2024-09-17T08:54:16.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.586+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff50c068560 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.586+0000 7ff5037fe640 1 -- 172.21.15.78:0/332040920 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4fc059760 con 0x7ff50c0ff8f0 2024-09-17T08:54:16.587 INFO:teuthology.orchestra.run.smithi078.stdout:167503724606 2024-09-17T08:54:16.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff4f806cec0 msgr2=0x7ff4f806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff4f806cec0 0x7ff4f806f380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff508000c00 tx=0x7ff508005a20 comp rx=0 tx=0).stop 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0ff8f0 msgr2=0x7ff50c196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0ff8f0 0x7ff50c196ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00b3f0 tx=0x7ff4fc00b8b0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 shutdown_connections 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff4f806cec0 0x7ff4f806f380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c104070 0x7ff50c1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff50c0ff8f0 0x7ff50c196ae0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 --2- 172.21.15.78:0/332040920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff50c0fef40 0x7ff50c1965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 >> 172.21.15.78:0/332040920 conn(0x7ff50c0faa20 msgr2=0x7ff50c0fb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 shutdown_connections 2024-09-17T08:54:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.590+0000 7ff514487640 1 -- 172.21.15.78:0/332040920 wait complete. 2024-09-17T08:54:16.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.726+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff904196b10 con 0x7ff904101980 2024-09-17T08:54:16.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.726+0000 7ff8faffd640 1 -- 172.21.15.78:0/2905958242 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8f407a860 con 0x7ff904101980 2024-09-17T08:54:16.727 INFO:teuthology.orchestra.run.smithi078.stdout:201863462963 2024-09-17T08:54:16.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.730+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff8f006cec0 msgr2=0x7ff8f006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.730+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff8f006cec0 0x7ff8f006f380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff900011630 tx=0x7ff900005f90 comp rx=0 tx=0).stop 2024-09-17T08:54:16.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.730+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101980 msgr2=0x7ff90419ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.730+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101980 0x7ff90419ba50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4005ab0 tx=0x7ff8f4032bc0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 shutdown_connections 2024-09-17T08:54:16.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff8f006cec0 0x7ff8f006f380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff90410a400 0x7ff904195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff904101980 0x7ff90419ba50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 --2- 172.21.15.78:0/2905958242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff904101060 0x7ff90419b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 >> 172.21.15.78:0/2905958242 conn(0x7ff9040faa20 msgr2=0x7ff90410bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 shutdown_connections 2024-09-17T08:54:16.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.734+0000 7ff90bcfb640 1 -- 172.21.15.78:0/2905958242 wait complete. 2024-09-17T08:54:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- 172.21.15.78:0/2955421559 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da00fe540 msgr2=0x7f9da00fe920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 --2- 172.21.15.78:0/2955421559 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da00fe540 0x7f9da00fe920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009900 tx=0x7f9d9402a410 comp rx=0 tx=0).stop 2024-09-17T08:54:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- 172.21.15.78:0/2955421559 shutdown_connections 2024-09-17T08:54:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 --2- 172.21.15.78:0/2955421559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da01051a0 0x7f9da010cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 --2- 172.21.15.78:0/2955421559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da00feef0 0x7f9da0104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 --2- 172.21.15.78:0/2955421559 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da00fe540 0x7f9da00fe920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- 172.21.15.78:0/2955421559 >> 172.21.15.78:0/2955421559 conn(0x7f9da0075430 msgr2=0x7f9da00fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- 172.21.15.78:0/2955421559 shutdown_connections 2024-09-17T08:54:16.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- 172.21.15.78:0/2955421559 wait complete. 2024-09-17T08:54:16.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 Processor -- start 2024-09-17T08:54:16.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- start start 2024-09-17T08:54:16.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00fe540 0x7f9da019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da00feef0 0x7f9da019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da01051a0 0x7f9da0197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0197f00 con 0x7f9da00fe540 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0198070 con 0x7f9da00feef0 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0198230 con 0x7f9da01051a0 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da49a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00fe540 0x7f9da019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da01051a0 0x7f9da0197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da01051a0 0x7f9da0197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39902/0 (socket says 172.21.15.78:39902) 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da49a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00fe540 0x7f9da019d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48554/0 (socket says 172.21.15.78:48554) 2024-09-17T08:54:16.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 -- 172.21.15.78:0/473857843 learned_addr learned my addr 172.21.15.78:0/473857843 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:16.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da00feef0 0x7f9da019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 -- 172.21.15.78:0/473857843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da00feef0 msgr2=0x7f9da019dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da00feef0 0x7f9da019dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 -- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00fe540 msgr2=0x7f9da019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00fe540 0x7f9da019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 -- 172.21.15.78:0/473857843 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94009560 con 0x7f9da01051a0 2024-09-17T08:54:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da00feef0 0x7f9da019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T08:54:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da51a4640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da01051a0 0x7f9da0197800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800eb10 tx=0x7f9d9800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9d9dffb640 1 -- 172.21.15.78:0/473857843 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98004b20 con 0x7f9da01051a0 2024-09-17T08:54:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da0198510 con 0x7f9da01051a0 2024-09-17T08:54:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9d9dffb640 1 -- 172.21.15.78:0/473857843 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f9d98004c80 con 0x7f9da01051a0 2024-09-17T08:54:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.742+0000 7f9d9dffb640 1 -- 172.21.15.78:0/473857843 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98010430 con 0x7f9da01051a0 2024-09-17T08:54:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.746+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0069ed0 con 0x7f9da01051a0 2024-09-17T08:54:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.746+0000 7f9d9dffb640 1 -- 172.21.15.78:0/473857843 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f9d98010590 con 0x7f9da01051a0 2024-09-17T08:54:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.746+0000 7f9d9dffb640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9d9007ded0 0x7f9d90080390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.746+0000 7f9d9dffb640 1 -- 172.21.15.78:0/473857843 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f9d98014070 con 0x7f9da01051a0 2024-09-17T08:54:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.746+0000 7f9da49a3640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9d9007ded0 0x7f9d90080390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.746+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0101600 con 0x7f9da01051a0 2024-09-17T08:54:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.746+0000 7f9da49a3640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9d9007ded0 0x7f9d90080390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d94005ab0 tx=0x7f9d94005a20 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:16.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.750+0000 7f9d9dffb640 1 -- 172.21.15.78:0/473857843 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9d98057390 con 0x7f9da01051a0 2024-09-17T08:54:16.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.766+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f28198d30 con 0x7f4f28101040 2024-09-17T08:54:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.766+0000 7f4f25ffb640 1 -- 172.21.15.78:0/1711760120 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f1c07a380 con 0x7f4f28101040 2024-09-17T08:54:16.767 INFO:teuthology.orchestra.run.smithi078.stdout:77309411421 2024-09-17T08:54:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f4f1806cec0 msgr2=0x7f4f1806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f4f1806cec0 0x7f4f1806f380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f28198f80 tx=0x7f4f14005d30 comp rx=0 tx=0).stop 2024-09-17T08:54:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 msgr2=0x7f4f2819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 0x7f4f2819d6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005ab0 tx=0x7f4f1c032ec0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 shutdown_connections 2024-09-17T08:54:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f4f1806cec0 0x7f4f1806f380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f2810a3e0 0x7f4f28197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28101960 0x7f4f2819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 --2- 172.21.15.78:0/1711760120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28101040 0x7f4f2819d6b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.770+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 >> 172.21.15.78:0/1711760120 conn(0x7f4f280faa20 msgr2=0x7f4f280ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.774+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 shutdown_connections 2024-09-17T08:54:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.774+0000 7f4f2ed4e640 1 -- 172.21.15.78:0/1711760120 wait complete. 2024-09-17T08:54:16.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.938+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9da0198d10 con 0x7f9da01051a0 2024-09-17T08:54:16.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9d9dffb640 1 -- 172.21.15.78:0/473857843 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d9805a9b0 con 0x7f9da01051a0 2024-09-17T08:54:16.939 INFO:teuthology.orchestra.run.smithi078.stdout:55834574951 2024-09-17T08:54:16.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9d9007ded0 msgr2=0x7f9d90080390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9d9007ded0 0x7f9d90080390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d94005ab0 tx=0x7f9d94005a20 comp rx=0 tx=0).stop 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da01051a0 msgr2=0x7f9da0197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da01051a0 0x7f9da0197800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800eb10 tx=0x7f9d9800c2d0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 shutdown_connections 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9d9007ded0 0x7f9d90080390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9da01051a0 0x7f9da0197800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da00feef0 0x7f9da019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 --2- 172.21.15.78:0/473857843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00fe540 0x7f9da019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 >> 172.21.15.78:0/473857843 conn(0x7f9da0075430 msgr2=0x7f9da0103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 shutdown_connections 2024-09-17T08:54:16.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:16.942+0000 7f9da6c07640 1 -- 172.21.15.78:0/473857843 wait complete. 2024-09-17T08:54:17.000 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[22670]: audit 2024-09-17T08:54:16.477575+0000 mon.c (mon.2) 26 : audit [DBG] from='client.? 172.21.15.78:0/2269499391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T08:54:17.001 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[22670]: audit 2024-09-17T08:54:16.590257+0000 mon.c (mon.2) 27 : audit [DBG] from='client.? 172.21.15.78:0/332040920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T08:54:17.001 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[22670]: audit 2024-09-17T08:54:16.730048+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.78:0/2905958242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-17T08:54:17.001 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[22670]: audit 2024-09-17T08:54:16.770342+0000 mon.a (mon.0) 879 : audit [DBG] from='client.? 172.21.15.78:0/1711760120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T08:54:17.001 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[32124]: audit 2024-09-17T08:54:16.477575+0000 mon.c (mon.2) 26 : audit [DBG] from='client.? 172.21.15.78:0/2269499391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T08:54:17.001 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[32124]: audit 2024-09-17T08:54:16.590257+0000 mon.c (mon.2) 27 : audit [DBG] from='client.? 172.21.15.78:0/332040920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T08:54:17.001 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[32124]: audit 2024-09-17T08:54:16.730048+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.78:0/2905958242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-17T08:54:17.001 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:16 smithi078 bash[32124]: audit 2024-09-17T08:54:16.770342+0000 mon.a (mon.0) 879 : audit [DBG] from='client.? 172.21.15.78:0/1711760120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T08:54:17.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:16 smithi136 bash[24812]: audit 2024-09-17T08:54:16.477575+0000 mon.c (mon.2) 26 : audit [DBG] from='client.? 172.21.15.78:0/2269499391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T08:54:17.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:16 smithi136 bash[24812]: audit 2024-09-17T08:54:16.590257+0000 mon.c (mon.2) 27 : audit [DBG] from='client.? 172.21.15.78:0/332040920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T08:54:17.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:16 smithi136 bash[24812]: audit 2024-09-17T08:54:16.730048+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.78:0/2905958242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-17T08:54:17.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:16 smithi136 bash[24812]: audit 2024-09-17T08:54:16.770342+0000 mon.a (mon.0) 879 : audit [DBG] from='client.? 172.21.15.78:0/1711760120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T08:54:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22670]: cluster 2024-09-17T08:54:16.728061+0000 mgr.y (mgr.14532) 96 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22670]: audit 2024-09-17T08:54:16.942679+0000 mon.c (mon.2) 29 : audit [DBG] from='client.? 172.21.15.78:0/473857843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T08:54:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22670]: audit 2024-09-17T08:54:17.104493+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22670]: audit 2024-09-17T08:54:17.111293+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22670]: audit 2024-09-17T08:54:17.505628+0000 mon.a (mon.0) 882 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:54:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22670]: audit 2024-09-17T08:54:17.506864+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:54:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22670]: audit 2024-09-17T08:54:17.515920+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[32124]: cluster 2024-09-17T08:54:16.728061+0000 mgr.y (mgr.14532) 96 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[32124]: audit 2024-09-17T08:54:16.942679+0000 mon.c (mon.2) 29 : audit [DBG] from='client.? 172.21.15.78:0/473857843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T08:54:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[32124]: audit 2024-09-17T08:54:17.104493+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[32124]: audit 2024-09-17T08:54:17.111293+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[32124]: audit 2024-09-17T08:54:17.505628+0000 mon.a (mon.0) 882 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:54:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[32124]: audit 2024-09-17T08:54:17.506864+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:54:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[32124]: audit 2024-09-17T08:54:17.515920+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:18.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:17 smithi136 bash[24812]: cluster 2024-09-17T08:54:16.728061+0000 mgr.y (mgr.14532) 96 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:18.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:17 smithi136 bash[24812]: audit 2024-09-17T08:54:16.942679+0000 mon.c (mon.2) 29 : audit [DBG] from='client.? 172.21.15.78:0/473857843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T08:54:18.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:17 smithi136 bash[24812]: audit 2024-09-17T08:54:17.104493+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:18.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:17 smithi136 bash[24812]: audit 2024-09-17T08:54:17.111293+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:18.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:17 smithi136 bash[24812]: audit 2024-09-17T08:54:17.505628+0000 mon.a (mon.0) 882 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:54:18.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:17 smithi136 bash[24812]: audit 2024-09-17T08:54:17.506864+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:54:18.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:17 smithi136 bash[24812]: audit 2024-09-17T08:54:17.515920+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:54:18.222 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:54:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:54:18.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149774 got 111669149778 for osd.3 2024-09-17T08:54:18.224 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:18.681 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462959 got 201863462963 for osd.6 2024-09-17T08:54:18.681 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:19.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724601 got 167503724606 for osd.5 2024-09-17T08:54:19.375 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:19.383 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411417 got 77309411421 for osd.2 2024-09-17T08:54:19.383 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:19.512 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574947 got 55834574951 for osd.1 2024-09-17T08:54:19.512 DEBUG:teuthology.parallel:result is None 2024-09-17T08:54:19.513 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T08:54:19.513 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T08:54:19.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:54:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:54:20.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:19 smithi136 bash[24812]: cluster 2024-09-17T08:54:18.729423+0000 mgr.y (mgr.14532) 97 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:20.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:19 smithi078 bash[22670]: cluster 2024-09-17T08:54:18.729423+0000 mgr.y (mgr.14532) 97 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:20.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:19 smithi078 bash[32124]: cluster 2024-09-17T08:54:18.729423+0000 mgr.y (mgr.14532) 97 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:21.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:20 smithi078 bash[22670]: audit 2024-09-17T08:54:19.182234+0000 mgr.y (mgr.14532) 98 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:21.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:20 smithi078 bash[32124]: audit 2024-09-17T08:54:19.182234+0000 mgr.y (mgr.14532) 98 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:21.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:20 smithi136 bash[24812]: audit 2024-09-17T08:54:19.182234+0000 mgr.y (mgr.14532) 98 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:21 smithi078 bash[22670]: cluster 2024-09-17T08:54:20.730128+0000 mgr.y (mgr.14532) 99 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:22.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:21 smithi078 bash[32124]: cluster 2024-09-17T08:54:20.730128+0000 mgr.y (mgr.14532) 99 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:22.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:21 smithi136 bash[24812]: cluster 2024-09-17T08:54:20.730128+0000 mgr.y (mgr.14532) 99 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:23.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:22 smithi078 bash[32124]: audit 2024-09-17T08:54:21.959785+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:23.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:22 smithi078 bash[22670]: audit 2024-09-17T08:54:21.959785+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:23.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:22 smithi136 bash[24812]: audit 2024-09-17T08:54:21.959785+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:24.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:23 smithi078 bash[32124]: cluster 2024-09-17T08:54:22.730900+0000 mgr.y (mgr.14532) 100 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:24.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:23 smithi078 bash[22670]: cluster 2024-09-17T08:54:22.730900+0000 mgr.y (mgr.14532) 100 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:24.260 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:24.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:23 smithi136 bash[24812]: cluster 2024-09-17T08:54:22.730900+0000 mgr.y (mgr.14532) 100 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:26.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:25 smithi078 bash[22670]: cluster 2024-09-17T08:54:24.732518+0000 mgr.y (mgr.14532) 101 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:26.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:25 smithi078 bash[32124]: cluster 2024-09-17T08:54:24.732518+0000 mgr.y (mgr.14532) 101 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:26.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:25 smithi136 bash[24812]: cluster 2024-09-17T08:54:24.732518+0000 mgr.y (mgr.14532) 101 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:27.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- 172.21.15.78:0/2324551333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa7010c620 msgr2=0x7faa7010ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 --2- 172.21.15.78:0/2324551333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa7010c620 0x7faa7010ea70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa68009ca0 tx=0x7faa6802a950 comp rx=0 tx=0).stop 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- 172.21.15.78:0/2324551333 shutdown_connections 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 --2- 172.21.15.78:0/2324551333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa7010c620 0x7faa7010ea70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 --2- 172.21.15.78:0/2324551333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70073200 0x7faa7010c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 --2- 172.21.15.78:0/2324551333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa700728e0 0x7faa70072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- 172.21.15.78:0/2324551333 >> 172.21.15.78:0/2324551333 conn(0x7faa700fbb20 msgr2=0x7faa700fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- 172.21.15.78:0/2324551333 shutdown_connections 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- 172.21.15.78:0/2324551333 wait complete. 2024-09-17T08:54:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 Processor -- start 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- start start 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa700728e0 0x7faa7019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70073200 0x7faa7019dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7010c620 0x7faa701977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa70197ee0 con 0x7faa7010c620 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa70198050 con 0x7faa70073200 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa70198210 con 0x7faa700728e0 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6effd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa700728e0 0x7faa7019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7010c620 0x7faa701977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:27.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7010c620 0x7faa701977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41548/0 (socket says 172.21.15.78:41548) 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 -- 172.21.15.78:0/3047597837 learned_addr learned my addr 172.21.15.78:0/3047597837 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6e7fc640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70073200 0x7faa7019dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 -- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa700728e0 msgr2=0x7faa7019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa700728e0 0x7faa7019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 -- 172.21.15.78:0/3047597837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70073200 msgr2=0x7faa7019dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70073200 0x7faa7019dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 -- 172.21.15.78:0/3047597837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa68009900 con 0x7faa7010c620 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6e7fc640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70073200 0x7faa7019dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa6f7fe640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7010c620 0x7faa701977e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faa6802af40 tx=0x7faa68003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa57fff640 1 -- 172.21.15.78:0/3047597837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6802fd10 con 0x7faa7010c620 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa70198490 con 0x7faa7010c620 2024-09-17T08:54:27.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa57fff640 1 -- 172.21.15.78:0/3047597837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7faa6802fe70 con 0x7faa7010c620 2024-09-17T08:54:27.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa701a46e0 con 0x7faa7010c620 2024-09-17T08:54:27.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.154+0000 7faa57fff640 1 -- 172.21.15.78:0/3047597837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa68004550 con 0x7faa7010c620 2024-09-17T08:54:27.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.158+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c005040 con 0x7faa7010c620 2024-09-17T08:54:27.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.158+0000 7faa57fff640 1 -- 172.21.15.78:0/3047597837 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7faa6802e050 con 0x7faa7010c620 2024-09-17T08:54:27.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.158+0000 7faa57fff640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7faa5806cec0 0x7faa5806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:27.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.158+0000 7faa57fff640 1 -- 172.21.15.78:0/3047597837 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7faa680ad670 con 0x7faa7010c620 2024-09-17T08:54:27.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.158+0000 7faa6effd640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7faa5806cec0 0x7faa5806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:27.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.158+0000 7faa6effd640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7faa5806cec0 0x7faa5806f380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa64009bd0 tx=0x7faa64005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:27.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.162+0000 7faa57fff640 1 -- 172.21.15.78:0/3047597837 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faa68077390 con 0x7faa7010c620 2024-09-17T08:54:27.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.326+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 --> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa5c000bc0 con 0x7faa5806cec0 2024-09-17T08:54:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.362+0000 7faa57fff640 1 -- 172.21.15.78:0/3047597837 <== mgr.14532 v2:172.21.15.78:6800/1209266769 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+382134 (secure 0 0 0) 0x7faa5c000bc0 con 0x7faa5806cec0 2024-09-17T08:54:27.369 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:54:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T08:54:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7faa5806cec0 msgr2=0x7faa5806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7faa5806cec0 0x7faa5806f380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa64009bd0 tx=0x7faa64005f90 comp rx=0 tx=0).stop 2024-09-17T08:54:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7010c620 msgr2=0x7faa701977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7010c620 0x7faa701977e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faa6802af40 tx=0x7faa68003d40 comp rx=0 tx=0).stop 2024-09-17T08:54:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 shutdown_connections 2024-09-17T08:54:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7faa5806cec0 0x7faa5806f380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7010c620 0x7faa701977e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70073200 0x7faa7019dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 --2- 172.21.15.78:0/3047597837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa700728e0 0x7faa7019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 >> 172.21.15.78:0/3047597837 conn(0x7faa700fbb20 msgr2=0x7faa70104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 shutdown_connections 2024-09-17T08:54:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:27.366+0000 7faa75541640 1 -- 172.21.15.78:0/3047597837 wait complete. 2024-09-17T08:54:27.985 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-17T08:54:26.732779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596246,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":1071,"num_read_kb":917,"num_write":609,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":624,"ondisk_log_size":624,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":236748,"kb_used_data":8308,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749724468,"statfs":{"total":767960285184,"available":767717855232,"internally_reserved":0,"allocated":8507392,"data_stored":4618363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006385"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667815+0000","last_change":"2024-09-17T08:51:47.988669+0000","last_active":"2024-09-17T08:52:36.667815+0000","last_peered":"2024-09-17T08:52:36.667815+0000","last_clean":"2024-09-17T08:52:36.667815+0000","last_became_active":"2024-09-17T08:51:47.987836+0000","last_became_peered":"2024-09-17T08:51:47.987836+0000","last_unstale":"2024-09-17T08:52:36.667815+0000","last_undegraded":"2024-09-17T08:52:36.667815+0000","last_fullsized":"2024-09-17T08:52:36.667815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:22:46.513084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666431+0000","last_change":"2024-09-17T08:51:41.477585+0000","last_active":"2024-09-17T08:52:36.666431+0000","last_peered":"2024-09-17T08:52:36.666431+0000","last_clean":"2024-09-17T08:52:36.666431+0000","last_became_active":"2024-09-17T08:51:41.477032+0000","last_became_peered":"2024-09-17T08:51:41.477032+0000","last_unstale":"2024-09-17T08:52:36.666431+0000","last_undegraded":"2024-09-17T08:52:36.666431+0000","last_fullsized":"2024-09-17T08:52:36.666431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:09.445075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"68'10","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668562+0000","last_change":"2024-09-17T08:51:43.550898+0000","last_active":"2024-09-17T08:52:36.668562+0000","last_peered":"2024-09-17T08:52:36.668562+0000","last_clean":"2024-09-17T08:52:36.668562+0000","last_became_active":"2024-09-17T08:51:43.550302+0000","last_became_peered":"2024-09-17T08:51:43.550302+0000","last_unstale":"2024-09-17T08:52:36.668562+0000","last_undegraded":"2024-09-17T08:52:36.668562+0000","last_fullsized":"2024-09-17T08:52:36.668562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:17.654233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668059+0000","last_change":"2024-09-17T08:51:45.506337+0000","last_active":"2024-09-17T08:52:36.668059+0000","last_peered":"2024-09-17T08:52:36.668059+0000","last_clean":"2024-09-17T08:52:36.668059+0000","last_became_active":"2024-09-17T08:51:45.505514+0000","last_became_peered":"2024-09-17T08:51:45.505514+0000","last_unstale":"2024-09-17T08:52:36.668059+0000","last_undegraded":"2024-09-17T08:52:36.668059+0000","last_fullsized":"2024-09-17T08:52:36.668059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:19.966036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669088+0000","last_change":"2024-09-17T08:51:41.460439+0000","last_active":"2024-09-17T08:52:36.669088+0000","last_peered":"2024-09-17T08:52:36.669088+0000","last_clean":"2024-09-17T08:52:36.669088+0000","last_became_active":"2024-09-17T08:51:41.459977+0000","last_became_peered":"2024-09-17T08:51:41.459977+0000","last_unstale":"2024-09-17T08:52:36.669088+0000","last_undegraded":"2024-09-17T08:52:36.669088+0000","last_fullsized":"2024-09-17T08:52:36.669088+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:37.072223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"68'11","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665954+0000","last_change":"2024-09-17T08:51:43.552480+0000","last_active":"2024-09-17T08:52:36.665954+0000","last_peered":"2024-09-17T08:52:36.665954+0000","last_clean":"2024-09-17T08:52:36.665954+0000","last_became_active":"2024-09-17T08:51:43.551617+0000","last_became_peered":"2024-09-17T08:51:43.551617+0000","last_unstale":"2024-09-17T08:52:36.665954+0000","last_undegraded":"2024-09-17T08:52:36.665954+0000","last_fullsized":"2024-09-17T08:52:36.665954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:30.235900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667669+0000","last_change":"2024-09-17T08:51:45.523836+0000","last_active":"2024-09-17T08:52:36.667669+0000","last_peered":"2024-09-17T08:52:36.667669+0000","last_clean":"2024-09-17T08:52:36.667669+0000","last_became_active":"2024-09-17T08:51:45.522807+0000","last_became_peered":"2024-09-17T08:51:45.522807+0000","last_unstale":"2024-09-17T08:52:36.667669+0000","last_undegraded":"2024-09-17T08:52:36.667669+0000","last_fullsized":"2024-09-17T08:52:36.667669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:47.716999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669358+0000","last_change":"2024-09-17T08:51:47.728297+0000","last_active":"2024-09-17T08:52:36.669358+0000","last_peered":"2024-09-17T08:52:36.669358+0000","last_clean":"2024-09-17T08:52:36.669358+0000","last_became_active":"2024-09-17T08:51:47.727532+0000","last_became_peered":"2024-09-17T08:51:47.727532+0000","last_unstale":"2024-09-17T08:52:36.669358+0000","last_undegraded":"2024-09-17T08:52:36.669358+0000","last_fullsized":"2024-09-17T08:52:36.669358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:31:05.430603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794648+0000","last_change":"2024-09-17T08:51:41.473651+0000","last_active":"2024-09-17T08:52:36.794648+0000","last_peered":"2024-09-17T08:52:36.794648+0000","last_clean":"2024-09-17T08:52:36.794648+0000","last_became_active":"2024-09-17T08:51:41.472449+0000","last_became_peered":"2024-09-17T08:51:41.472449+0000","last_unstale":"2024-09-17T08:52:36.794648+0000","last_undegraded":"2024-09-17T08:52:36.794648+0000","last_fullsized":"2024-09-17T08:52:36.794648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:15.929460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"68'15","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858425+0000","last_change":"2024-09-17T08:51:43.505903+0000","last_active":"2024-09-17T08:52:37.858425+0000","last_peered":"2024-09-17T08:52:37.858425+0000","last_clean":"2024-09-17T08:52:37.858425+0000","last_became_active":"2024-09-17T08:51:43.505176+0000","last_became_peered":"2024-09-17T08:51:43.505176+0000","last_unstale":"2024-09-17T08:52:37.858425+0000","last_undegraded":"2024-09-17T08:52:37.858425+0000","last_fullsized":"2024-09-17T08:52:37.858425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:44.131360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668350+0000","last_change":"2024-09-17T08:51:45.515099+0000","last_active":"2024-09-17T08:52:36.668350+0000","last_peered":"2024-09-17T08:52:36.668350+0000","last_clean":"2024-09-17T08:52:36.668350+0000","last_became_active":"2024-09-17T08:51:45.513728+0000","last_became_peered":"2024-09-17T08:51:45.513728+0000","last_unstale":"2024-09-17T08:52:36.668350+0000","last_undegraded":"2024-09-17T08:52:36.668350+0000","last_fullsized":"2024-09-17T08:52:36.668350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:10.585508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858029+0000","last_change":"2024-09-17T08:51:47.734730+0000","last_active":"2024-09-17T08:52:37.858029+0000","last_peered":"2024-09-17T08:52:37.858029+0000","last_clean":"2024-09-17T08:52:37.858029+0000","last_became_active":"2024-09-17T08:51:47.733895+0000","last_became_peered":"2024-09-17T08:51:47.733895+0000","last_unstale":"2024-09-17T08:52:37.858029+0000","last_undegraded":"2024-09-17T08:52:37.858029+0000","last_fullsized":"2024-09-17T08:52:37.858029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:44.588976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'1","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794616+0000","last_change":"2024-09-17T08:51:41.474730+0000","last_active":"2024-09-17T08:52:36.794616+0000","last_peered":"2024-09-17T08:52:36.794616+0000","last_clean":"2024-09-17T08:52:36.794616+0000","last_became_active":"2024-09-17T08:51:41.473964+0000","last_became_peered":"2024-09-17T08:51:41.473964+0000","last_unstale":"2024-09-17T08:52:36.794616+0000","last_undegraded":"2024-09-17T08:52:36.794616+0000","last_fullsized":"2024-09-17T08:52:36.794616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:02.448064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"68'12","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858701+0000","last_change":"2024-09-17T08:51:43.507593+0000","last_active":"2024-09-17T08:52:37.858701+0000","last_peered":"2024-09-17T08:52:37.858701+0000","last_clean":"2024-09-17T08:52:37.858701+0000","last_became_active":"2024-09-17T08:51:43.507050+0000","last_became_peered":"2024-09-17T08:51:43.507050+0000","last_unstale":"2024-09-17T08:52:37.858701+0000","last_undegraded":"2024-09-17T08:52:37.858701+0000","last_fullsized":"2024-09-17T08:52:37.858701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:02.107121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669929+0000","last_change":"2024-09-17T08:51:45.513457+0000","last_active":"2024-09-17T08:52:36.669929+0000","last_peered":"2024-09-17T08:52:36.669929+0000","last_clean":"2024-09-17T08:52:36.669929+0000","last_became_active":"2024-09-17T08:51:45.511422+0000","last_became_peered":"2024-09-17T08:51:45.511422+0000","last_unstale":"2024-09-17T08:52:36.669929+0000","last_undegraded":"2024-09-17T08:52:36.669929+0000","last_fullsized":"2024-09-17T08:52:36.669929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:34.942212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664750+0000","last_change":"2024-09-17T08:51:47.740946+0000","last_active":"2024-09-17T08:52:36.664750+0000","last_peered":"2024-09-17T08:52:36.664750+0000","last_clean":"2024-09-17T08:52:36.664750+0000","last_became_active":"2024-09-17T08:51:47.740338+0000","last_became_peered":"2024-09-17T08:51:47.740338+0000","last_unstale":"2024-09-17T08:52:36.664750+0000","last_undegraded":"2024-09-17T08:52:36.664750+0000","last_fullsized":"2024-09-17T08:52:36.664750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:26:28.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"68'19","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779342+0000","last_change":"2024-09-17T08:51:43.503205+0000","last_active":"2024-09-17T08:52:36.779342+0000","last_peered":"2024-09-17T08:52:36.779342+0000","last_clean":"2024-09-17T08:52:36.779342+0000","last_became_active":"2024-09-17T08:51:43.502248+0000","last_became_peered":"2024-09-17T08:51:43.502248+0000","last_unstale":"2024-09-17T08:52:36.779342+0000","last_undegraded":"2024-09-17T08:52:36.779342+0000","last_fullsized":"2024-09-17T08:52:36.779342+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:28.928553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794413+0000","last_change":"2024-09-17T08:51:41.480634+0000","last_active":"2024-09-17T08:52:36.794413+0000","last_peered":"2024-09-17T08:52:36.794413+0000","last_clean":"2024-09-17T08:52:36.794413+0000","last_became_active":"2024-09-17T08:51:41.480278+0000","last_became_peered":"2024-09-17T08:51:41.480278+0000","last_unstale":"2024-09-17T08:52:36.794413+0000","last_undegraded":"2024-09-17T08:52:36.794413+0000","last_fullsized":"2024-09-17T08:52:36.794413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:27:16.561972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"68'11","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.922431+0000","last_change":"2024-09-17T08:51:45.511019+0000","last_active":"2024-09-17T08:54:14.922431+0000","last_peered":"2024-09-17T08:54:14.922431+0000","last_clean":"2024-09-17T08:54:14.922431+0000","last_became_active":"2024-09-17T08:51:45.509407+0000","last_became_peered":"2024-09-17T08:51:45.509407+0000","last_unstale":"2024-09-17T08:54:14.922431+0000","last_undegraded":"2024-09-17T08:54:14.922431+0000","last_fullsized":"2024-09-17T08:54:14.922431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:15.856267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287878+0000","last_change":"2024-09-17T08:51:47.737575+0000","last_active":"2024-09-17T08:52:37.287878+0000","last_peered":"2024-09-17T08:52:37.287878+0000","last_clean":"2024-09-17T08:52:37.287878+0000","last_became_active":"2024-09-17T08:51:47.737209+0000","last_became_peered":"2024-09-17T08:51:47.737209+0000","last_unstale":"2024-09-17T08:52:37.287878+0000","last_undegraded":"2024-09-17T08:52:37.287878+0000","last_fullsized":"2024-09-17T08:52:37.287878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:06.352101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668081+0000","last_change":"2024-09-17T08:51:43.497916+0000","last_active":"2024-09-17T08:52:36.668081+0000","last_peered":"2024-09-17T08:52:36.668081+0000","last_clean":"2024-09-17T08:52:36.668081+0000","last_became_active":"2024-09-17T08:51:43.497128+0000","last_became_peered":"2024-09-17T08:51:43.497128+0000","last_unstale":"2024-09-17T08:52:36.668081+0000","last_undegraded":"2024-09-17T08:52:36.668081+0000","last_fullsized":"2024-09-17T08:52:36.668081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:22.196101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142671+0000","last_change":"2024-09-17T08:52:29.253902+0000","last_active":"2024-09-17T08:52:37.142671+0000","last_peered":"2024-09-17T08:52:37.142671+0000","last_clean":"2024-09-17T08:52:37.142671+0000","last_became_active":"2024-09-17T08:52:29.252912+0000","last_became_peered":"2024-09-17T08:52:29.252912+0000","last_unstale":"2024-09-17T08:52:37.142671+0000","last_undegraded":"2024-09-17T08:52:37.142671+0000","last_fullsized":"2024-09-17T08:52:37.142671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:41.882955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668353+0000","last_change":"2024-09-17T08:51:45.511251+0000","last_active":"2024-09-17T08:52:36.668353+0000","last_peered":"2024-09-17T08:52:36.668353+0000","last_clean":"2024-09-17T08:52:36.668353+0000","last_became_active":"2024-09-17T08:51:45.510479+0000","last_became_peered":"2024-09-17T08:51:45.510479+0000","last_unstale":"2024-09-17T08:52:36.668353+0000","last_undegraded":"2024-09-17T08:52:36.668353+0000","last_fullsized":"2024-09-17T08:52:36.668353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:31.453038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669823+0000","last_change":"2024-09-17T08:51:47.730951+0000","last_active":"2024-09-17T08:52:36.669823+0000","last_peered":"2024-09-17T08:52:36.669823+0000","last_clean":"2024-09-17T08:52:36.669823+0000","last_became_active":"2024-09-17T08:51:47.730080+0000","last_became_peered":"2024-09-17T08:51:47.730080+0000","last_unstale":"2024-09-17T08:52:36.669823+0000","last_undegraded":"2024-09-17T08:52:36.669823+0000","last_fullsized":"2024-09-17T08:52:36.669823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:13.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"68'15","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666812+0000","last_change":"2024-09-17T08:51:43.492865+0000","last_active":"2024-09-17T08:52:36.666812+0000","last_peered":"2024-09-17T08:52:36.666812+0000","last_clean":"2024-09-17T08:52:36.666812+0000","last_became_active":"2024-09-17T08:51:43.492068+0000","last_became_peered":"2024-09-17T08:51:43.492068+0000","last_unstale":"2024-09-17T08:52:36.666812+0000","last_undegraded":"2024-09-17T08:52:36.666812+0000","last_fullsized":"2024-09-17T08:52:36.666812+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:42:41.574972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142394+0000","last_change":"2024-09-17T08:51:41.463556+0000","last_active":"2024-09-17T08:52:37.142394+0000","last_peered":"2024-09-17T08:52:37.142394+0000","last_clean":"2024-09-17T08:52:37.142394+0000","last_became_active":"2024-09-17T08:51:41.463204+0000","last_became_peered":"2024-09-17T08:51:41.463204+0000","last_unstale":"2024-09-17T08:52:37.142394+0000","last_undegraded":"2024-09-17T08:52:37.142394+0000","last_fullsized":"2024-09-17T08:52:37.142394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:40:43.382126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142858+0000","last_change":"2024-09-17T08:51:45.511725+0000","last_active":"2024-09-17T08:52:37.142858+0000","last_peered":"2024-09-17T08:52:37.142858+0000","last_clean":"2024-09-17T08:52:37.142858+0000","last_became_active":"2024-09-17T08:51:45.511076+0000","last_became_peered":"2024-09-17T08:51:45.511076+0000","last_unstale":"2024-09-17T08:52:37.142858+0000","last_undegraded":"2024-09-17T08:52:37.142858+0000","last_fullsized":"2024-09-17T08:52:37.142858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:59.488255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858426+0000","last_change":"2024-09-17T08:51:47.735767+0000","last_active":"2024-09-17T08:52:37.858426+0000","last_peered":"2024-09-17T08:52:37.858426+0000","last_clean":"2024-09-17T08:52:37.858426+0000","last_became_active":"2024-09-17T08:51:47.734765+0000","last_became_peered":"2024-09-17T08:51:47.734765+0000","last_unstale":"2024-09-17T08:52:37.858426+0000","last_undegraded":"2024-09-17T08:52:37.858426+0000","last_fullsized":"2024-09-17T08:52:37.858426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:45.396948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"68'12","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668747+0000","last_change":"2024-09-17T08:51:43.551435+0000","last_active":"2024-09-17T08:52:36.668747+0000","last_peered":"2024-09-17T08:52:36.668747+0000","last_clean":"2024-09-17T08:52:36.668747+0000","last_became_active":"2024-09-17T08:51:43.551082+0000","last_became_peered":"2024-09-17T08:51:43.551082+0000","last_unstale":"2024-09-17T08:52:36.668747+0000","last_undegraded":"2024-09-17T08:52:36.668747+0000","last_fullsized":"2024-09-17T08:52:36.668747+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:01.086134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793768+0000","last_change":"2024-09-17T08:51:41.474620+0000","last_active":"2024-09-17T08:52:36.793768+0000","last_peered":"2024-09-17T08:52:36.793768+0000","last_clean":"2024-09-17T08:52:36.793768+0000","last_became_active":"2024-09-17T08:51:41.472430+0000","last_became_peered":"2024-09-17T08:51:41.472430+0000","last_unstale":"2024-09-17T08:52:36.793768+0000","last_undegraded":"2024-09-17T08:52:36.793768+0000","last_fullsized":"2024-09-17T08:52:36.793768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:05:56.514064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"68'11","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.922379+0000","last_change":"2024-09-17T08:51:45.521777+0000","last_active":"2024-09-17T08:54:14.922379+0000","last_peered":"2024-09-17T08:54:14.922379+0000","last_clean":"2024-09-17T08:54:14.922379+0000","last_became_active":"2024-09-17T08:51:45.521104+0000","last_became_peered":"2024-09-17T08:51:45.521104+0000","last_unstale":"2024-09-17T08:54:14.922379+0000","last_undegraded":"2024-09-17T08:54:14.922379+0000","last_fullsized":"2024-09-17T08:54:14.922379+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:20.463257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667249+0000","last_change":"2024-09-17T08:51:47.982151+0000","last_active":"2024-09-17T08:52:36.667249+0000","last_peered":"2024-09-17T08:52:36.667249+0000","last_clean":"2024-09-17T08:52:36.667249+0000","last_became_active":"2024-09-17T08:51:47.981311+0000","last_became_peered":"2024-09-17T08:51:47.981311+0000","last_unstale":"2024-09-17T08:52:36.667249+0000","last_undegraded":"2024-09-17T08:52:36.667249+0000","last_fullsized":"2024-09-17T08:52:36.667249+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:04.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"68'12","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665561+0000","last_change":"2024-09-17T08:51:43.502292+0000","last_active":"2024-09-17T08:52:36.665561+0000","last_peered":"2024-09-17T08:52:36.665561+0000","last_clean":"2024-09-17T08:52:36.665561+0000","last_became_active":"2024-09-17T08:51:43.501147+0000","last_became_peered":"2024-09-17T08:51:43.501147+0000","last_unstale":"2024-09-17T08:52:36.665561+0000","last_undegraded":"2024-09-17T08:52:36.665561+0000","last_fullsized":"2024-09-17T08:52:36.665561+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:42:19.092688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779501+0000","last_change":"2024-09-17T08:51:41.462284+0000","last_active":"2024-09-17T08:52:36.779501+0000","last_peered":"2024-09-17T08:52:36.779501+0000","last_clean":"2024-09-17T08:52:36.779501+0000","last_became_active":"2024-09-17T08:51:41.460181+0000","last_became_peered":"2024-09-17T08:51:41.460181+0000","last_unstale":"2024-09-17T08:52:36.779501+0000","last_undegraded":"2024-09-17T08:52:36.779501+0000","last_fullsized":"2024-09-17T08:52:36.779501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:15.274747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668323+0000","last_change":"2024-09-17T08:51:45.494756+0000","last_active":"2024-09-17T08:52:36.668323+0000","last_peered":"2024-09-17T08:52:36.668323+0000","last_clean":"2024-09-17T08:52:36.668323+0000","last_became_active":"2024-09-17T08:51:45.493959+0000","last_became_peered":"2024-09-17T08:51:45.493959+0000","last_unstale":"2024-09-17T08:52:36.668323+0000","last_undegraded":"2024-09-17T08:52:36.668323+0000","last_fullsized":"2024-09-17T08:52:36.668323+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:21.975168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"72'5","reported_seq":168,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:21.331220+0000","last_change":"2024-09-17T08:51:55.303011+0000","last_active":"2024-09-17T08:54:21.331220+0000","last_peered":"2024-09-17T08:54:21.331220+0000","last_clean":"2024-09-17T08:54:21.331220+0000","last_became_active":"2024-09-17T08:51:45.517414+0000","last_became_peered":"2024-09-17T08:51:45.517414+0000","last_unstale":"2024-09-17T08:54:21.331220+0000","last_undegraded":"2024-09-17T08:54:21.331220+0000","last_fullsized":"2024-09-17T08:54:21.331220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:00.420583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071769999999999,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793989+0000","last_change":"2024-09-17T08:51:47.990146+0000","last_active":"2024-09-17T08:52:36.793989+0000","last_peered":"2024-09-17T08:52:36.793989+0000","last_clean":"2024-09-17T08:52:36.793989+0000","last_became_active":"2024-09-17T08:51:47.989349+0000","last_became_peered":"2024-09-17T08:51:47.989349+0000","last_unstale":"2024-09-17T08:52:36.793989+0000","last_undegraded":"2024-09-17T08:52:36.793989+0000","last_fullsized":"2024-09-17T08:52:36.793989+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:50.843883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"68'13","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669960+0000","last_change":"2024-09-17T08:51:43.491731+0000","last_active":"2024-09-17T08:52:36.669960+0000","last_peered":"2024-09-17T08:52:36.669960+0000","last_clean":"2024-09-17T08:52:36.669960+0000","last_became_active":"2024-09-17T08:51:43.490012+0000","last_became_peered":"2024-09-17T08:51:43.490012+0000","last_unstale":"2024-09-17T08:52:36.669960+0000","last_undegraded":"2024-09-17T08:52:36.669960+0000","last_fullsized":"2024-09-17T08:52:36.669960+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:29.977920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142967+0000","last_change":"2024-09-17T08:51:41.458787+0000","last_active":"2024-09-17T08:52:37.142967+0000","last_peered":"2024-09-17T08:52:37.142967+0000","last_clean":"2024-09-17T08:52:37.142967+0000","last_became_active":"2024-09-17T08:51:41.458359+0000","last_became_peered":"2024-09-17T08:51:41.458359+0000","last_unstale":"2024-09-17T08:52:37.142967+0000","last_undegraded":"2024-09-17T08:52:37.142967+0000","last_fullsized":"2024-09-17T08:52:37.142967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:41:55.223097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"68'11","reported_seq":63,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.920090+0000","last_change":"2024-09-17T08:51:45.680106+0000","last_active":"2024-09-17T08:54:14.920090+0000","last_peered":"2024-09-17T08:54:14.920090+0000","last_clean":"2024-09-17T08:54:14.920090+0000","last_became_active":"2024-09-17T08:51:45.679238+0000","last_became_peered":"2024-09-17T08:51:45.679238+0000","last_unstale":"2024-09-17T08:54:14.920090+0000","last_undegraded":"2024-09-17T08:54:14.920090+0000","last_fullsized":"2024-09-17T08:54:14.920090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:33:40.794924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"69'1","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669242+0000","last_change":"2024-09-17T08:51:55.351163+0000","last_active":"2024-09-17T08:52:36.669242+0000","last_peered":"2024-09-17T08:52:36.669242+0000","last_clean":"2024-09-17T08:52:36.669242+0000","last_became_active":"2024-09-17T08:51:45.682795+0000","last_became_peered":"2024-09-17T08:51:45.682795+0000","last_unstale":"2024-09-17T08:52:36.669242+0000","last_undegraded":"2024-09-17T08:52:36.669242+0000","last_fullsized":"2024-09-17T08:52:36.669242+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:21.803688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078411799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669715+0000","last_change":"2024-09-17T08:51:47.733945+0000","last_active":"2024-09-17T08:52:36.669715+0000","last_peered":"2024-09-17T08:52:36.669715+0000","last_clean":"2024-09-17T08:52:36.669715+0000","last_became_active":"2024-09-17T08:51:47.733107+0000","last_became_peered":"2024-09-17T08:51:47.733107+0000","last_unstale":"2024-09-17T08:52:36.669715+0000","last_undegraded":"2024-09-17T08:52:36.669715+0000","last_fullsized":"2024-09-17T08:52:36.669715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:50:32.437663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"68'30","reported_seq":104,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.920304+0000","last_change":"2024-09-17T08:51:43.549386+0000","last_active":"2024-09-17T08:54:14.920304+0000","last_peered":"2024-09-17T08:54:14.920304+0000","last_clean":"2024-09-17T08:54:14.920304+0000","last_became_active":"2024-09-17T08:51:43.548771+0000","last_became_peered":"2024-09-17T08:51:43.548771+0000","last_unstale":"2024-09-17T08:54:14.920304+0000","last_undegraded":"2024-09-17T08:54:14.920304+0000","last_fullsized":"2024-09-17T08:54:14.920304+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:13:26.469717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794599+0000","last_change":"2024-09-17T08:51:41.475949+0000","last_active":"2024-09-17T08:52:36.794599+0000","last_peered":"2024-09-17T08:52:36.794599+0000","last_clean":"2024-09-17T08:52:36.794599+0000","last_became_active":"2024-09-17T08:51:41.473499+0000","last_became_peered":"2024-09-17T08:51:41.473499+0000","last_unstale":"2024-09-17T08:52:36.794599+0000","last_undegraded":"2024-09-17T08:52:36.794599+0000","last_fullsized":"2024-09-17T08:52:36.794599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:42.667190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"68'11","reported_seq":63,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.920090+0000","last_change":"2024-09-17T08:51:45.680786+0000","last_active":"2024-09-17T08:54:14.920090+0000","last_peered":"2024-09-17T08:54:14.920090+0000","last_clean":"2024-09-17T08:54:14.920090+0000","last_became_active":"2024-09-17T08:51:45.679966+0000","last_became_peered":"2024-09-17T08:51:45.679966+0000","last_unstale":"2024-09-17T08:54:14.920090+0000","last_undegraded":"2024-09-17T08:54:14.920090+0000","last_fullsized":"2024-09-17T08:54:14.920090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:32:23.054666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"71'2","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779024+0000","last_change":"2024-09-17T08:51:55.313222+0000","last_active":"2024-09-17T08:52:36.779024+0000","last_peered":"2024-09-17T08:52:36.779024+0000","last_clean":"2024-09-17T08:52:36.779024+0000","last_became_active":"2024-09-17T08:51:45.492846+0000","last_became_peered":"2024-09-17T08:51:45.492846+0000","last_unstale":"2024-09-17T08:52:36.779024+0000","last_undegraded":"2024-09-17T08:52:36.779024+0000","last_fullsized":"2024-09-17T08:52:36.779024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:30.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026464560000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142201+0000","last_change":"2024-09-17T08:51:47.981508+0000","last_active":"2024-09-17T08:52:37.142201+0000","last_peered":"2024-09-17T08:52:37.142201+0000","last_clean":"2024-09-17T08:52:37.142201+0000","last_became_active":"2024-09-17T08:51:47.980686+0000","last_became_peered":"2024-09-17T08:51:47.980686+0000","last_unstale":"2024-09-17T08:52:37.142201+0000","last_undegraded":"2024-09-17T08:52:37.142201+0000","last_fullsized":"2024-09-17T08:52:37.142201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:11.609319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"68'14","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858700+0000","last_change":"2024-09-17T08:51:43.550396+0000","last_active":"2024-09-17T08:52:37.858700+0000","last_peered":"2024-09-17T08:52:37.858700+0000","last_clean":"2024-09-17T08:52:37.858700+0000","last_became_active":"2024-09-17T08:51:43.550025+0000","last_became_peered":"2024-09-17T08:51:43.550025+0000","last_unstale":"2024-09-17T08:52:37.858700+0000","last_undegraded":"2024-09-17T08:52:37.858700+0000","last_fullsized":"2024-09-17T08:52:37.858700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:06.656598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142818+0000","last_change":"2024-09-17T08:51:41.466102+0000","last_active":"2024-09-17T08:52:37.142818+0000","last_peered":"2024-09-17T08:52:37.142818+0000","last_clean":"2024-09-17T08:52:37.142818+0000","last_became_active":"2024-09-17T08:51:41.465236+0000","last_became_peered":"2024-09-17T08:51:41.465236+0000","last_unstale":"2024-09-17T08:52:37.142818+0000","last_undegraded":"2024-09-17T08:52:37.142818+0000","last_fullsized":"2024-09-17T08:52:37.142818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:48.787417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142326+0000","last_change":"2024-09-17T08:51:45.507374+0000","last_active":"2024-09-17T08:52:37.142326+0000","last_peered":"2024-09-17T08:52:37.142326+0000","last_clean":"2024-09-17T08:52:37.142326+0000","last_became_active":"2024-09-17T08:51:45.505661+0000","last_became_peered":"2024-09-17T08:51:45.505661+0000","last_unstale":"2024-09-17T08:52:37.142326+0000","last_undegraded":"2024-09-17T08:52:37.142326+0000","last_fullsized":"2024-09-17T08:52:37.142326+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:18.785660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664871+0000","last_change":"2024-09-17T08:51:47.733610+0000","last_active":"2024-09-17T08:52:36.664871+0000","last_peered":"2024-09-17T08:52:36.664871+0000","last_clean":"2024-09-17T08:52:36.664871+0000","last_became_active":"2024-09-17T08:51:47.733064+0000","last_became_peered":"2024-09-17T08:51:47.733064+0000","last_unstale":"2024-09-17T08:52:36.664871+0000","last_undegraded":"2024-09-17T08:52:36.664871+0000","last_fullsized":"2024-09-17T08:52:36.664871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:16.884545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"68'19","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669263+0000","last_change":"2024-09-17T08:51:43.515100+0000","last_active":"2024-09-17T08:52:36.669263+0000","last_peered":"2024-09-17T08:52:36.669263+0000","last_clean":"2024-09-17T08:52:36.669263+0000","last_became_active":"2024-09-17T08:51:43.512871+0000","last_became_peered":"2024-09-17T08:51:43.512871+0000","last_unstale":"2024-09-17T08:52:36.669263+0000","last_undegraded":"2024-09-17T08:52:36.669263+0000","last_fullsized":"2024-09-17T08:52:36.669263+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:27.196985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857380+0000","last_change":"2024-09-17T08:51:41.476712+0000","last_active":"2024-09-17T08:52:37.857380+0000","last_peered":"2024-09-17T08:52:37.857380+0000","last_clean":"2024-09-17T08:52:37.857380+0000","last_became_active":"2024-09-17T08:51:41.471124+0000","last_became_peered":"2024-09-17T08:51:41.471124+0000","last_unstale":"2024-09-17T08:52:37.857380+0000","last_undegraded":"2024-09-17T08:52:37.857380+0000","last_fullsized":"2024-09-17T08:52:37.857380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:36.316469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142675+0000","last_change":"2024-09-17T08:51:45.512245+0000","last_active":"2024-09-17T08:52:37.142675+0000","last_peered":"2024-09-17T08:52:37.142675+0000","last_clean":"2024-09-17T08:52:37.142675+0000","last_became_active":"2024-09-17T08:51:45.511418+0000","last_became_peered":"2024-09-17T08:51:45.511418+0000","last_unstale":"2024-09-17T08:52:37.142675+0000","last_undegraded":"2024-09-17T08:52:37.142675+0000","last_fullsized":"2024-09-17T08:52:37.142675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:40.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667321+0000","last_change":"2024-09-17T08:51:47.733849+0000","last_active":"2024-09-17T08:52:36.667321+0000","last_peered":"2024-09-17T08:52:36.667321+0000","last_clean":"2024-09-17T08:52:36.667321+0000","last_became_active":"2024-09-17T08:51:47.731661+0000","last_became_peered":"2024-09-17T08:51:47.731661+0000","last_unstale":"2024-09-17T08:52:36.667321+0000","last_undegraded":"2024-09-17T08:52:36.667321+0000","last_fullsized":"2024-09-17T08:52:36.667321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:03.773723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"68'18","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142236+0000","last_change":"2024-09-17T08:51:43.553886+0000","last_active":"2024-09-17T08:52:37.142236+0000","last_peered":"2024-09-17T08:52:37.142236+0000","last_clean":"2024-09-17T08:52:37.142236+0000","last_became_active":"2024-09-17T08:51:43.553150+0000","last_became_peered":"2024-09-17T08:51:43.553150+0000","last_unstale":"2024-09-17T08:52:37.142236+0000","last_undegraded":"2024-09-17T08:52:37.142236+0000","last_fullsized":"2024-09-17T08:52:37.142236+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:53.142625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287336+0000","last_change":"2024-09-17T08:51:41.464715+0000","last_active":"2024-09-17T08:52:37.287336+0000","last_peered":"2024-09-17T08:52:37.287336+0000","last_clean":"2024-09-17T08:52:37.287336+0000","last_became_active":"2024-09-17T08:51:41.464320+0000","last_became_peered":"2024-09-17T08:51:41.464320+0000","last_unstale":"2024-09-17T08:52:37.287336+0000","last_undegraded":"2024-09-17T08:52:37.287336+0000","last_fullsized":"2024-09-17T08:52:37.287336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:45.825985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142908+0000","last_change":"2024-09-17T08:51:45.506842+0000","last_active":"2024-09-17T08:52:37.142908+0000","last_peered":"2024-09-17T08:52:37.142908+0000","last_clean":"2024-09-17T08:52:37.142908+0000","last_became_active":"2024-09-17T08:51:45.506014+0000","last_became_peered":"2024-09-17T08:51:45.506014+0000","last_unstale":"2024-09-17T08:52:37.142908+0000","last_undegraded":"2024-09-17T08:52:37.142908+0000","last_fullsized":"2024-09-17T08:52:37.142908+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:35.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794301+0000","last_change":"2024-09-17T08:51:47.984346+0000","last_active":"2024-09-17T08:52:36.794301+0000","last_peered":"2024-09-17T08:52:36.794301+0000","last_clean":"2024-09-17T08:52:36.794301+0000","last_became_active":"2024-09-17T08:51:47.982959+0000","last_became_peered":"2024-09-17T08:51:47.982959+0000","last_unstale":"2024-09-17T08:52:36.794301+0000","last_undegraded":"2024-09-17T08:52:36.794301+0000","last_fullsized":"2024-09-17T08:52:36.794301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:37.613009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"68'14","reported_seq":44,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664504+0000","last_change":"2024-09-17T08:51:43.499533+0000","last_active":"2024-09-17T08:52:36.664504+0000","last_peered":"2024-09-17T08:52:36.664504+0000","last_clean":"2024-09-17T08:52:36.664504+0000","last_became_active":"2024-09-17T08:51:43.498691+0000","last_became_peered":"2024-09-17T08:51:43.498691+0000","last_unstale":"2024-09-17T08:52:36.664504+0000","last_undegraded":"2024-09-17T08:52:36.664504+0000","last_fullsized":"2024-09-17T08:52:36.664504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:15:34.018222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793827+0000","last_change":"2024-09-17T08:51:41.475110+0000","last_active":"2024-09-17T08:52:36.793827+0000","last_peered":"2024-09-17T08:52:36.793827+0000","last_clean":"2024-09-17T08:52:36.793827+0000","last_became_active":"2024-09-17T08:51:41.473449+0000","last_became_peered":"2024-09-17T08:51:41.473449+0000","last_unstale":"2024-09-17T08:52:36.793827+0000","last_undegraded":"2024-09-17T08:52:36.793827+0000","last_fullsized":"2024-09-17T08:52:36.793827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:17:25.331624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665851+0000","last_change":"2024-09-17T08:51:45.513428+0000","last_active":"2024-09-17T08:52:36.665851+0000","last_peered":"2024-09-17T08:52:36.665851+0000","last_clean":"2024-09-17T08:52:36.665851+0000","last_became_active":"2024-09-17T08:51:45.512779+0000","last_became_peered":"2024-09-17T08:51:45.512779+0000","last_unstale":"2024-09-17T08:52:36.665851+0000","last_undegraded":"2024-09-17T08:52:36.665851+0000","last_fullsized":"2024-09-17T08:52:36.665851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:05:51.885384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142514+0000","last_change":"2024-09-17T08:51:47.728778+0000","last_active":"2024-09-17T08:52:37.142514+0000","last_peered":"2024-09-17T08:52:37.142514+0000","last_clean":"2024-09-17T08:52:37.142514+0000","last_became_active":"2024-09-17T08:51:47.727961+0000","last_became_peered":"2024-09-17T08:51:47.727961+0000","last_unstale":"2024-09-17T08:52:37.142514+0000","last_undegraded":"2024-09-17T08:52:37.142514+0000","last_fullsized":"2024-09-17T08:52:37.142514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:28.014024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"68'10","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667131+0000","last_change":"2024-09-17T08:51:43.499881+0000","last_active":"2024-09-17T08:52:36.667131+0000","last_peered":"2024-09-17T08:52:36.667131+0000","last_clean":"2024-09-17T08:52:36.667131+0000","last_became_active":"2024-09-17T08:51:43.499058+0000","last_became_peered":"2024-09-17T08:51:43.499058+0000","last_unstale":"2024-09-17T08:52:36.667131+0000","last_undegraded":"2024-09-17T08:52:36.667131+0000","last_fullsized":"2024-09-17T08:52:36.667131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:04:53.654172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857372+0000","last_change":"2024-09-17T08:51:41.477641+0000","last_active":"2024-09-17T08:52:37.857372+0000","last_peered":"2024-09-17T08:52:37.857372+0000","last_clean":"2024-09-17T08:52:37.857372+0000","last_became_active":"2024-09-17T08:51:41.477302+0000","last_became_peered":"2024-09-17T08:51:41.477302+0000","last_unstale":"2024-09-17T08:52:37.857372+0000","last_undegraded":"2024-09-17T08:52:37.857372+0000","last_fullsized":"2024-09-17T08:52:37.857372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:09:02.338251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":270,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:38.820901+0000","last_change":"2024-09-17T08:51:06.272152+0000","last_active":"2024-09-17T08:52:38.820901+0000","last_peered":"2024-09-17T08:52:38.820901+0000","last_clean":"2024-09-17T08:52:38.820901+0000","last_became_active":"2024-09-17T08:51:06.271337+0000","last_became_peered":"2024-09-17T08:51:06.271337+0000","last_unstale":"2024-09-17T08:52:38.820901+0000","last_undegraded":"2024-09-17T08:52:38.820901+0000","last_fullsized":"2024-09-17T08:52:38.820901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:46:46.894504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:46:46.894504+0000","last_clean_scrub_stamp":"2024-09-17T08:46:46.894504+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:38.006446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779409+0000","last_change":"2024-09-17T08:51:45.683825+0000","last_active":"2024-09-17T08:52:36.779409+0000","last_peered":"2024-09-17T08:52:36.779409+0000","last_clean":"2024-09-17T08:52:36.779409+0000","last_became_active":"2024-09-17T08:51:45.682959+0000","last_became_peered":"2024-09-17T08:51:45.682959+0000","last_unstale":"2024-09-17T08:52:36.779409+0000","last_undegraded":"2024-09-17T08:52:36.779409+0000","last_fullsized":"2024-09-17T08:52:36.779409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:38.999911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858729+0000","last_change":"2024-09-17T08:51:47.736773+0000","last_active":"2024-09-17T08:52:37.858729+0000","last_peered":"2024-09-17T08:52:37.858729+0000","last_clean":"2024-09-17T08:52:37.858729+0000","last_became_active":"2024-09-17T08:51:47.735788+0000","last_became_peered":"2024-09-17T08:51:47.735788+0000","last_unstale":"2024-09-17T08:52:37.858729+0000","last_undegraded":"2024-09-17T08:52:37.858729+0000","last_fullsized":"2024-09-17T08:52:37.858729+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:20.500959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"68'17","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794473+0000","last_change":"2024-09-17T08:51:43.495863+0000","last_active":"2024-09-17T08:52:36.794473+0000","last_peered":"2024-09-17T08:52:36.794473+0000","last_clean":"2024-09-17T08:52:36.794473+0000","last_became_active":"2024-09-17T08:51:43.495119+0000","last_became_peered":"2024-09-17T08:51:43.495119+0000","last_unstale":"2024-09-17T08:52:36.794473+0000","last_undegraded":"2024-09-17T08:52:36.794473+0000","last_fullsized":"2024-09-17T08:52:36.794473+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:50:27.639103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.288185+0000","last_change":"2024-09-17T08:51:41.460709+0000","last_active":"2024-09-17T08:52:37.288185+0000","last_peered":"2024-09-17T08:52:37.288185+0000","last_clean":"2024-09-17T08:52:37.288185+0000","last_became_active":"2024-09-17T08:51:41.459963+0000","last_became_peered":"2024-09-17T08:51:41.459963+0000","last_unstale":"2024-09-17T08:52:37.288185+0000","last_undegraded":"2024-09-17T08:52:37.288185+0000","last_fullsized":"2024-09-17T08:52:37.288185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:29.670817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779119+0000","last_change":"2024-09-17T08:51:45.681673+0000","last_active":"2024-09-17T08:52:36.779119+0000","last_peered":"2024-09-17T08:52:36.779119+0000","last_clean":"2024-09-17T08:52:36.779119+0000","last_became_active":"2024-09-17T08:51:45.680843+0000","last_became_peered":"2024-09-17T08:51:45.680843+0000","last_unstale":"2024-09-17T08:52:36.779119+0000","last_undegraded":"2024-09-17T08:52:36.779119+0000","last_fullsized":"2024-09-17T08:52:36.779119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:15:36.180847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793883+0000","last_change":"2024-09-17T08:51:47.741957+0000","last_active":"2024-09-17T08:52:36.793883+0000","last_peered":"2024-09-17T08:52:36.793883+0000","last_clean":"2024-09-17T08:52:36.793883+0000","last_became_active":"2024-09-17T08:51:47.740967+0000","last_became_peered":"2024-09-17T08:51:47.740967+0000","last_unstale":"2024-09-17T08:52:36.793883+0000","last_undegraded":"2024-09-17T08:52:36.793883+0000","last_fullsized":"2024-09-17T08:52:36.793883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:47.993843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"68'10","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858596+0000","last_change":"2024-09-17T08:51:43.508807+0000","last_active":"2024-09-17T08:52:37.858596+0000","last_peered":"2024-09-17T08:52:37.858596+0000","last_clean":"2024-09-17T08:52:37.858596+0000","last_became_active":"2024-09-17T08:51:43.508210+0000","last_became_peered":"2024-09-17T08:51:43.508210+0000","last_unstale":"2024-09-17T08:52:37.858596+0000","last_undegraded":"2024-09-17T08:52:37.858596+0000","last_fullsized":"2024-09-17T08:52:37.858596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:20.147032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142874+0000","last_change":"2024-09-17T08:51:41.465461+0000","last_active":"2024-09-17T08:52:37.142874+0000","last_peered":"2024-09-17T08:52:37.142874+0000","last_clean":"2024-09-17T08:52:37.142874+0000","last_became_active":"2024-09-17T08:51:41.464966+0000","last_became_peered":"2024-09-17T08:51:41.464966+0000","last_unstale":"2024-09-17T08:52:37.142874+0000","last_undegraded":"2024-09-17T08:52:37.142874+0000","last_fullsized":"2024-09-17T08:52:37.142874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:08.256328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665094+0000","last_change":"2024-09-17T08:52:29.383362+0000","last_active":"2024-09-17T08:52:36.665094+0000","last_peered":"2024-09-17T08:52:36.665094+0000","last_clean":"2024-09-17T08:52:36.665094+0000","last_became_active":"2024-09-17T08:52:29.382383+0000","last_became_peered":"2024-09-17T08:52:29.382383+0000","last_unstale":"2024-09-17T08:52:36.665094+0000","last_undegraded":"2024-09-17T08:52:36.665094+0000","last_fullsized":"2024-09-17T08:52:36.665094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:27.051704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664432+0000","last_change":"2024-09-17T08:51:47.738399+0000","last_active":"2024-09-17T08:52:36.664432+0000","last_peered":"2024-09-17T08:52:36.664432+0000","last_clean":"2024-09-17T08:52:36.664432+0000","last_became_active":"2024-09-17T08:51:47.738098+0000","last_became_peered":"2024-09-17T08:51:47.738098+0000","last_unstale":"2024-09-17T08:52:36.664432+0000","last_undegraded":"2024-09-17T08:52:36.664432+0000","last_fullsized":"2024-09-17T08:52:36.664432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:30.802738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"68'15","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794248+0000","last_change":"2024-09-17T08:51:43.495285+0000","last_active":"2024-09-17T08:52:36.794248+0000","last_peered":"2024-09-17T08:52:36.794248+0000","last_clean":"2024-09-17T08:52:36.794248+0000","last_became_active":"2024-09-17T08:51:43.494510+0000","last_became_peered":"2024-09-17T08:51:43.494510+0000","last_unstale":"2024-09-17T08:52:36.794248+0000","last_undegraded":"2024-09-17T08:52:36.794248+0000","last_fullsized":"2024-09-17T08:52:36.794248+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:08:21.823500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287683+0000","last_change":"2024-09-17T08:51:41.453533+0000","last_active":"2024-09-17T08:52:37.287683+0000","last_peered":"2024-09-17T08:52:37.287683+0000","last_clean":"2024-09-17T08:52:37.287683+0000","last_became_active":"2024-09-17T08:51:41.453163+0000","last_became_peered":"2024-09-17T08:51:41.453163+0000","last_unstale":"2024-09-17T08:52:37.287683+0000","last_undegraded":"2024-09-17T08:52:37.287683+0000","last_fullsized":"2024-09-17T08:52:37.287683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:35.627026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857940+0000","last_change":"2024-09-17T08:51:45.683717+0000","last_active":"2024-09-17T08:52:37.857940+0000","last_peered":"2024-09-17T08:52:37.857940+0000","last_clean":"2024-09-17T08:52:37.857940+0000","last_became_active":"2024-09-17T08:51:45.682956+0000","last_became_peered":"2024-09-17T08:51:45.682956+0000","last_unstale":"2024-09-17T08:52:37.857940+0000","last_undegraded":"2024-09-17T08:52:37.857940+0000","last_fullsized":"2024-09-17T08:52:37.857940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:30.184395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858038+0000","last_change":"2024-09-17T08:51:47.984794+0000","last_active":"2024-09-17T08:52:37.858038+0000","last_peered":"2024-09-17T08:52:37.858038+0000","last_clean":"2024-09-17T08:52:37.858038+0000","last_became_active":"2024-09-17T08:51:47.983978+0000","last_became_peered":"2024-09-17T08:51:47.983978+0000","last_unstale":"2024-09-17T08:52:37.858038+0000","last_undegraded":"2024-09-17T08:52:37.858038+0000","last_fullsized":"2024-09-17T08:52:37.858038+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:42.769545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"68'11","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794252+0000","last_change":"2024-09-17T08:51:43.512709+0000","last_active":"2024-09-17T08:52:36.794252+0000","last_peered":"2024-09-17T08:52:36.794252+0000","last_clean":"2024-09-17T08:52:36.794252+0000","last_became_active":"2024-09-17T08:51:43.512201+0000","last_became_peered":"2024-09-17T08:51:43.512201+0000","last_unstale":"2024-09-17T08:52:36.794252+0000","last_undegraded":"2024-09-17T08:52:36.794252+0000","last_fullsized":"2024-09-17T08:52:36.794252+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:24.156161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.671775+0000","last_change":"2024-09-17T08:51:41.475371+0000","last_active":"2024-09-17T08:52:36.671775+0000","last_peered":"2024-09-17T08:52:36.671775+0000","last_clean":"2024-09-17T08:52:36.671775+0000","last_became_active":"2024-09-17T08:51:41.471873+0000","last_became_peered":"2024-09-17T08:51:41.471873+0000","last_unstale":"2024-09-17T08:52:36.671775+0000","last_undegraded":"2024-09-17T08:52:36.671775+0000","last_fullsized":"2024-09-17T08:52:36.671775+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:51:52.249149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"68'11","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.922769+0000","last_change":"2024-09-17T08:51:45.513118+0000","last_active":"2024-09-17T08:54:14.922769+0000","last_peered":"2024-09-17T08:54:14.922769+0000","last_clean":"2024-09-17T08:54:14.922769+0000","last_became_active":"2024-09-17T08:51:45.511337+0000","last_became_peered":"2024-09-17T08:51:45.511337+0000","last_unstale":"2024-09-17T08:54:14.922769+0000","last_undegraded":"2024-09-17T08:54:14.922769+0000","last_fullsized":"2024-09-17T08:54:14.922769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:08.907390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667879+0000","last_change":"2024-09-17T08:51:47.743755+0000","last_active":"2024-09-17T08:52:36.667879+0000","last_peered":"2024-09-17T08:52:36.667879+0000","last_clean":"2024-09-17T08:52:36.667879+0000","last_became_active":"2024-09-17T08:51:47.742954+0000","last_became_peered":"2024-09-17T08:51:47.742954+0000","last_unstale":"2024-09-17T08:52:36.667879+0000","last_undegraded":"2024-09-17T08:52:36.667879+0000","last_fullsized":"2024-09-17T08:52:36.667879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:20.860187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"68'11","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793918+0000","last_change":"2024-09-17T08:51:43.497863+0000","last_active":"2024-09-17T08:52:36.793918+0000","last_peered":"2024-09-17T08:52:36.793918+0000","last_clean":"2024-09-17T08:52:36.793918+0000","last_became_active":"2024-09-17T08:51:43.497031+0000","last_became_peered":"2024-09-17T08:51:43.497031+0000","last_unstale":"2024-09-17T08:52:36.793918+0000","last_undegraded":"2024-09-17T08:52:36.793918+0000","last_fullsized":"2024-09-17T08:52:36.793918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:23.410508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287017+0000","last_change":"2024-09-17T08:51:41.466663+0000","last_active":"2024-09-17T08:52:37.287017+0000","last_peered":"2024-09-17T08:52:37.287017+0000","last_clean":"2024-09-17T08:52:37.287017+0000","last_became_active":"2024-09-17T08:51:41.465737+0000","last_became_peered":"2024-09-17T08:51:41.465737+0000","last_unstale":"2024-09-17T08:52:37.287017+0000","last_undegraded":"2024-09-17T08:52:37.287017+0000","last_fullsized":"2024-09-17T08:52:37.287017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:44.782326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665343+0000","last_change":"2024-09-17T08:51:45.680458+0000","last_active":"2024-09-17T08:52:36.665343+0000","last_peered":"2024-09-17T08:52:36.665343+0000","last_clean":"2024-09-17T08:52:36.665343+0000","last_became_active":"2024-09-17T08:51:45.679541+0000","last_became_peered":"2024-09-17T08:51:45.679541+0000","last_unstale":"2024-09-17T08:52:36.665343+0000","last_undegraded":"2024-09-17T08:52:36.665343+0000","last_fullsized":"2024-09-17T08:52:36.665343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:07.717330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287279+0000","last_change":"2024-09-17T08:51:47.735494+0000","last_active":"2024-09-17T08:52:37.287279+0000","last_peered":"2024-09-17T08:52:37.287279+0000","last_clean":"2024-09-17T08:52:37.287279+0000","last_became_active":"2024-09-17T08:51:47.730694+0000","last_became_peered":"2024-09-17T08:51:47.730694+0000","last_unstale":"2024-09-17T08:52:37.287279+0000","last_undegraded":"2024-09-17T08:52:37.287279+0000","last_fullsized":"2024-09-17T08:52:37.287279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:32.636147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"68'4","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.778950+0000","last_change":"2024-09-17T08:51:43.504714+0000","last_active":"2024-09-17T08:52:36.778950+0000","last_peered":"2024-09-17T08:52:36.778950+0000","last_clean":"2024-09-17T08:52:36.778950+0000","last_became_active":"2024-09-17T08:51:43.504021+0000","last_became_peered":"2024-09-17T08:51:43.504021+0000","last_unstale":"2024-09-17T08:52:36.778950+0000","last_undegraded":"2024-09-17T08:52:36.778950+0000","last_fullsized":"2024-09-17T08:52:36.778950+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:37.939933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779136+0000","last_change":"2024-09-17T08:51:41.475443+0000","last_active":"2024-09-17T08:52:36.779136+0000","last_peered":"2024-09-17T08:52:36.779136+0000","last_clean":"2024-09-17T08:52:36.779136+0000","last_became_active":"2024-09-17T08:51:41.474504+0000","last_became_peered":"2024-09-17T08:51:41.474504+0000","last_unstale":"2024-09-17T08:52:36.779136+0000","last_undegraded":"2024-09-17T08:52:36.779136+0000","last_fullsized":"2024-09-17T08:52:36.779136+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:33.589212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669566+0000","last_change":"2024-09-17T08:51:45.681108+0000","last_active":"2024-09-17T08:52:36.669566+0000","last_peered":"2024-09-17T08:52:36.669566+0000","last_clean":"2024-09-17T08:52:36.669566+0000","last_became_active":"2024-09-17T08:51:45.680365+0000","last_became_peered":"2024-09-17T08:51:45.680365+0000","last_unstale":"2024-09-17T08:52:36.669566+0000","last_undegraded":"2024-09-17T08:52:36.669566+0000","last_fullsized":"2024-09-17T08:52:36.669566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:56.783439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794184+0000","last_change":"2024-09-17T08:51:47.983655+0000","last_active":"2024-09-17T08:52:36.794184+0000","last_peered":"2024-09-17T08:52:36.794184+0000","last_clean":"2024-09-17T08:52:36.794184+0000","last_became_active":"2024-09-17T08:51:47.982851+0000","last_became_peered":"2024-09-17T08:51:47.982851+0000","last_unstale":"2024-09-17T08:52:36.794184+0000","last_undegraded":"2024-09-17T08:52:36.794184+0000","last_fullsized":"2024-09-17T08:52:36.794184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:17:06.912741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"68'11","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794238+0000","last_change":"2024-09-17T08:51:43.549616+0000","last_active":"2024-09-17T08:52:36.794238+0000","last_peered":"2024-09-17T08:52:36.794238+0000","last_clean":"2024-09-17T08:52:36.794238+0000","last_became_active":"2024-09-17T08:51:43.549240+0000","last_became_peered":"2024-09-17T08:51:43.549240+0000","last_unstale":"2024-09-17T08:52:36.794238+0000","last_undegraded":"2024-09-17T08:52:36.794238+0000","last_fullsized":"2024-09-17T08:52:36.794238+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:05.472148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857586+0000","last_change":"2024-09-17T08:51:41.478108+0000","last_active":"2024-09-17T08:52:37.857586+0000","last_peered":"2024-09-17T08:52:37.857586+0000","last_clean":"2024-09-17T08:52:37.857586+0000","last_became_active":"2024-09-17T08:51:41.477708+0000","last_became_peered":"2024-09-17T08:51:41.477708+0000","last_unstale":"2024-09-17T08:52:37.857586+0000","last_undegraded":"2024-09-17T08:52:37.857586+0000","last_fullsized":"2024-09-17T08:52:37.857586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:22.111341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"68'11","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.920780+0000","last_change":"2024-09-17T08:51:45.682012+0000","last_active":"2024-09-17T08:54:14.920780+0000","last_peered":"2024-09-17T08:54:14.920780+0000","last_clean":"2024-09-17T08:54:14.920780+0000","last_became_active":"2024-09-17T08:51:45.681153+0000","last_became_peered":"2024-09-17T08:51:45.681153+0000","last_unstale":"2024-09-17T08:54:14.920780+0000","last_undegraded":"2024-09-17T08:54:14.920780+0000","last_fullsized":"2024-09-17T08:54:14.920780+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:26:39.558311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664923+0000","last_change":"2024-09-17T08:51:47.739542+0000","last_active":"2024-09-17T08:52:36.664923+0000","last_peered":"2024-09-17T08:52:36.664923+0000","last_clean":"2024-09-17T08:52:36.664923+0000","last_became_active":"2024-09-17T08:51:47.739062+0000","last_became_peered":"2024-09-17T08:51:47.739062+0000","last_unstale":"2024-09-17T08:52:36.664923+0000","last_undegraded":"2024-09-17T08:52:36.664923+0000","last_fullsized":"2024-09-17T08:52:36.664923+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:42.830439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664680+0000","last_change":"2024-09-17T08:51:43.489540+0000","last_active":"2024-09-17T08:52:36.664680+0000","last_peered":"2024-09-17T08:52:36.664680+0000","last_clean":"2024-09-17T08:52:36.664680+0000","last_became_active":"2024-09-17T08:51:43.488736+0000","last_became_peered":"2024-09-17T08:51:43.488736+0000","last_unstale":"2024-09-17T08:52:36.664680+0000","last_undegraded":"2024-09-17T08:52:36.664680+0000","last_fullsized":"2024-09-17T08:52:36.664680+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:33:09.298937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665872+0000","last_change":"2024-09-17T08:51:41.471084+0000","last_active":"2024-09-17T08:52:36.665872+0000","last_peered":"2024-09-17T08:52:36.665872+0000","last_clean":"2024-09-17T08:52:36.665872+0000","last_became_active":"2024-09-17T08:51:41.470670+0000","last_became_peered":"2024-09-17T08:51:41.470670+0000","last_unstale":"2024-09-17T08:52:36.665872+0000","last_undegraded":"2024-09-17T08:52:36.665872+0000","last_fullsized":"2024-09-17T08:52:36.665872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:11:37.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"68'11","reported_seq":63,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.922276+0000","last_change":"2024-09-17T08:51:45.683631+0000","last_active":"2024-09-17T08:54:14.922276+0000","last_peered":"2024-09-17T08:54:14.922276+0000","last_clean":"2024-09-17T08:54:14.922276+0000","last_became_active":"2024-09-17T08:51:45.682809+0000","last_became_peered":"2024-09-17T08:51:45.682809+0000","last_unstale":"2024-09-17T08:54:14.922276+0000","last_undegraded":"2024-09-17T08:54:14.922276+0000","last_fullsized":"2024-09-17T08:54:14.922276+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:17:55.648881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.671121+0000","last_change":"2024-09-17T08:51:47.735286+0000","last_active":"2024-09-17T08:52:36.671121+0000","last_peered":"2024-09-17T08:52:36.671121+0000","last_clean":"2024-09-17T08:52:36.671121+0000","last_became_active":"2024-09-17T08:51:47.734485+0000","last_became_peered":"2024-09-17T08:51:47.734485+0000","last_unstale":"2024-09-17T08:52:36.671121+0000","last_undegraded":"2024-09-17T08:52:36.671121+0000","last_fullsized":"2024-09-17T08:52:36.671121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:50:11.726884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"68'9","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794419+0000","last_change":"2024-09-17T08:51:43.492848+0000","last_active":"2024-09-17T08:52:36.794419+0000","last_peered":"2024-09-17T08:52:36.794419+0000","last_clean":"2024-09-17T08:52:36.794419+0000","last_became_active":"2024-09-17T08:51:43.491743+0000","last_became_peered":"2024-09-17T08:51:43.491743+0000","last_unstale":"2024-09-17T08:52:36.794419+0000","last_undegraded":"2024-09-17T08:52:36.794419+0000","last_fullsized":"2024-09-17T08:52:36.794419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:09.065057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779286+0000","last_change":"2024-09-17T08:51:41.468453+0000","last_active":"2024-09-17T08:52:36.779286+0000","last_peered":"2024-09-17T08:52:36.779286+0000","last_clean":"2024-09-17T08:52:36.779286+0000","last_became_active":"2024-09-17T08:51:41.467620+0000","last_became_peered":"2024-09-17T08:51:41.467620+0000","last_unstale":"2024-09-17T08:52:36.779286+0000","last_undegraded":"2024-09-17T08:52:36.779286+0000","last_fullsized":"2024-09-17T08:52:36.779286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:15.487970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142478+0000","last_change":"2024-09-17T08:51:45.509060+0000","last_active":"2024-09-17T08:52:37.142478+0000","last_peered":"2024-09-17T08:52:37.142478+0000","last_clean":"2024-09-17T08:52:37.142478+0000","last_became_active":"2024-09-17T08:51:45.506497+0000","last_became_peered":"2024-09-17T08:51:45.506497+0000","last_unstale":"2024-09-17T08:52:37.142478+0000","last_undegraded":"2024-09-17T08:52:37.142478+0000","last_fullsized":"2024-09-17T08:52:37.142478+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:14.288644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664488+0000","last_change":"2024-09-17T08:51:47.727280+0000","last_active":"2024-09-17T08:52:36.664488+0000","last_peered":"2024-09-17T08:52:36.664488+0000","last_clean":"2024-09-17T08:52:36.664488+0000","last_became_active":"2024-09-17T08:51:47.726844+0000","last_became_peered":"2024-09-17T08:51:47.726844+0000","last_unstale":"2024-09-17T08:52:36.664488+0000","last_undegraded":"2024-09-17T08:52:36.664488+0000","last_fullsized":"2024-09-17T08:52:36.664488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:32.625973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"68'10","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668935+0000","last_change":"2024-09-17T08:51:43.507840+0000","last_active":"2024-09-17T08:52:36.668935+0000","last_peered":"2024-09-17T08:52:36.668935+0000","last_clean":"2024-09-17T08:52:36.668935+0000","last_became_active":"2024-09-17T08:51:43.507216+0000","last_became_peered":"2024-09-17T08:51:43.507216+0000","last_unstale":"2024-09-17T08:52:36.668935+0000","last_undegraded":"2024-09-17T08:52:36.668935+0000","last_fullsized":"2024-09-17T08:52:36.668935+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:52.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142791+0000","last_change":"2024-09-17T08:51:41.467622+0000","last_active":"2024-09-17T08:52:37.142791+0000","last_peered":"2024-09-17T08:52:37.142791+0000","last_clean":"2024-09-17T08:52:37.142791+0000","last_became_active":"2024-09-17T08:51:41.467213+0000","last_became_peered":"2024-09-17T08:51:41.467213+0000","last_unstale":"2024-09-17T08:52:37.142791+0000","last_undegraded":"2024-09-17T08:52:37.142791+0000","last_fullsized":"2024-09-17T08:52:37.142791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:21.221750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668574+0000","last_change":"2024-09-17T08:51:45.498543+0000","last_active":"2024-09-17T08:52:36.668574+0000","last_peered":"2024-09-17T08:52:36.668574+0000","last_clean":"2024-09-17T08:52:36.668574+0000","last_became_active":"2024-09-17T08:51:45.497676+0000","last_became_peered":"2024-09-17T08:51:45.497676+0000","last_unstale":"2024-09-17T08:52:36.668574+0000","last_undegraded":"2024-09-17T08:52:36.668574+0000","last_fullsized":"2024-09-17T08:52:36.668574+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:25.839862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"68'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667128+0000","last_change":"2024-09-17T08:51:47.733844+0000","last_active":"2024-09-17T08:52:36.667128+0000","last_peered":"2024-09-17T08:52:36.667128+0000","last_clean":"2024-09-17T08:52:36.667128+0000","last_became_active":"2024-09-17T08:51:47.732818+0000","last_became_peered":"2024-09-17T08:51:47.732818+0000","last_unstale":"2024-09-17T08:52:36.667128+0000","last_undegraded":"2024-09-17T08:52:36.667128+0000","last_fullsized":"2024-09-17T08:52:36.667128+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:26.109316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"68'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666214+0000","last_change":"2024-09-17T08:51:43.486087+0000","last_active":"2024-09-17T08:52:36.666214+0000","last_peered":"2024-09-17T08:52:36.666214+0000","last_clean":"2024-09-17T08:52:36.666214+0000","last_became_active":"2024-09-17T08:51:43.485267+0000","last_became_peered":"2024-09-17T08:51:43.485267+0000","last_unstale":"2024-09-17T08:52:36.666214+0000","last_undegraded":"2024-09-17T08:52:36.666214+0000","last_fullsized":"2024-09-17T08:52:36.666214+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:44.819169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"61'1","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857535+0000","last_change":"2024-09-17T08:51:41.467913+0000","last_active":"2024-09-17T08:52:37.857535+0000","last_peered":"2024-09-17T08:52:37.857535+0000","last_clean":"2024-09-17T08:52:37.857535+0000","last_became_active":"2024-09-17T08:51:41.467483+0000","last_became_peered":"2024-09-17T08:51:41.467483+0000","last_unstale":"2024-09-17T08:52:37.857535+0000","last_undegraded":"2024-09-17T08:52:37.857535+0000","last_fullsized":"2024-09-17T08:52:37.857535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:44.169242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666661+0000","last_change":"2024-09-17T08:51:45.515333+0000","last_active":"2024-09-17T08:52:36.666661+0000","last_peered":"2024-09-17T08:52:36.666661+0000","last_clean":"2024-09-17T08:52:36.666661+0000","last_became_active":"2024-09-17T08:51:45.514419+0000","last_became_peered":"2024-09-17T08:51:45.514419+0000","last_unstale":"2024-09-17T08:52:36.666661+0000","last_undegraded":"2024-09-17T08:52:36.666661+0000","last_fullsized":"2024-09-17T08:52:36.666661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:51:10.226319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793787+0000","last_change":"2024-09-17T08:51:47.739700+0000","last_active":"2024-09-17T08:52:36.793787+0000","last_peered":"2024-09-17T08:52:36.793787+0000","last_clean":"2024-09-17T08:52:36.793787+0000","last_became_active":"2024-09-17T08:51:47.738852+0000","last_became_peered":"2024-09-17T08:51:47.738852+0000","last_unstale":"2024-09-17T08:52:36.793787+0000","last_undegraded":"2024-09-17T08:52:36.793787+0000","last_fullsized":"2024-09-17T08:52:36.793787+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:05.639685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858521+0000","last_change":"2024-09-17T08:51:43.501464+0000","last_active":"2024-09-17T08:52:37.858521+0000","last_peered":"2024-09-17T08:52:37.858521+0000","last_clean":"2024-09-17T08:52:37.858521+0000","last_became_active":"2024-09-17T08:51:43.500719+0000","last_became_peered":"2024-09-17T08:51:43.500719+0000","last_unstale":"2024-09-17T08:52:37.858521+0000","last_undegraded":"2024-09-17T08:52:37.858521+0000","last_fullsized":"2024-09-17T08:52:37.858521+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:18.363321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779411+0000","last_change":"2024-09-17T08:51:41.469768+0000","last_active":"2024-09-17T08:52:36.779411+0000","last_peered":"2024-09-17T08:52:36.779411+0000","last_clean":"2024-09-17T08:52:36.779411+0000","last_became_active":"2024-09-17T08:51:41.467529+0000","last_became_peered":"2024-09-17T08:51:41.467529+0000","last_unstale":"2024-09-17T08:52:36.779411+0000","last_undegraded":"2024-09-17T08:52:36.779411+0000","last_fullsized":"2024-09-17T08:52:36.779411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:22.804155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667333+0000","last_change":"2024-09-17T08:51:45.681134+0000","last_active":"2024-09-17T08:52:36.667333+0000","last_peered":"2024-09-17T08:52:36.667333+0000","last_clean":"2024-09-17T08:52:36.667333+0000","last_became_active":"2024-09-17T08:51:45.680316+0000","last_became_peered":"2024-09-17T08:51:45.680316+0000","last_unstale":"2024-09-17T08:52:36.667333+0000","last_undegraded":"2024-09-17T08:52:36.667333+0000","last_fullsized":"2024-09-17T08:52:36.667333+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:55.168951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667995+0000","last_change":"2024-09-17T08:51:47.982494+0000","last_active":"2024-09-17T08:52:36.667995+0000","last_peered":"2024-09-17T08:52:36.667995+0000","last_clean":"2024-09-17T08:52:36.667995+0000","last_became_active":"2024-09-17T08:51:47.981663+0000","last_became_peered":"2024-09-17T08:51:47.981663+0000","last_unstale":"2024-09-17T08:52:36.667995+0000","last_undegraded":"2024-09-17T08:52:36.667995+0000","last_fullsized":"2024-09-17T08:52:36.667995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:40.585079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794227+0000","last_change":"2024-09-17T08:51:47.742840+0000","last_active":"2024-09-17T08:52:36.794227+0000","last_peered":"2024-09-17T08:52:36.794227+0000","last_clean":"2024-09-17T08:52:36.794227+0000","last_became_active":"2024-09-17T08:51:47.741662+0000","last_became_peered":"2024-09-17T08:51:47.741662+0000","last_unstale":"2024-09-17T08:52:36.794227+0000","last_undegraded":"2024-09-17T08:52:36.794227+0000","last_fullsized":"2024-09-17T08:52:36.794227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:29.484553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"68'15","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142292+0000","last_change":"2024-09-17T08:51:43.508101+0000","last_active":"2024-09-17T08:52:37.142292+0000","last_peered":"2024-09-17T08:52:37.142292+0000","last_clean":"2024-09-17T08:52:37.142292+0000","last_became_active":"2024-09-17T08:51:43.507327+0000","last_became_peered":"2024-09-17T08:51:43.507327+0000","last_unstale":"2024-09-17T08:52:37.142292+0000","last_undegraded":"2024-09-17T08:52:37.142292+0000","last_fullsized":"2024-09-17T08:52:37.142292+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:06.204957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857378+0000","last_change":"2024-09-17T08:51:41.479661+0000","last_active":"2024-09-17T08:52:37.857378+0000","last_peered":"2024-09-17T08:52:37.857378+0000","last_clean":"2024-09-17T08:52:37.857378+0000","last_became_active":"2024-09-17T08:51:41.479263+0000","last_became_peered":"2024-09-17T08:51:41.479263+0000","last_unstale":"2024-09-17T08:52:37.857378+0000","last_undegraded":"2024-09-17T08:52:37.857378+0000","last_fullsized":"2024-09-17T08:52:37.857378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.427321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665144+0000","last_change":"2024-09-17T08:51:45.682043+0000","last_active":"2024-09-17T08:52:36.665144+0000","last_peered":"2024-09-17T08:52:36.665144+0000","last_clean":"2024-09-17T08:52:36.665144+0000","last_became_active":"2024-09-17T08:51:45.681300+0000","last_became_peered":"2024-09-17T08:51:45.681300+0000","last_unstale":"2024-09-17T08:52:36.665144+0000","last_undegraded":"2024-09-17T08:52:36.665144+0000","last_fullsized":"2024-09-17T08:52:36.665144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:22.793072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142671+0000","last_change":"2024-09-17T08:51:47.737760+0000","last_active":"2024-09-17T08:52:37.142671+0000","last_peered":"2024-09-17T08:52:37.142671+0000","last_clean":"2024-09-17T08:52:37.142671+0000","last_became_active":"2024-09-17T08:51:47.733320+0000","last_became_peered":"2024-09-17T08:51:47.733320+0000","last_unstale":"2024-09-17T08:52:37.142671+0000","last_undegraded":"2024-09-17T08:52:37.142671+0000","last_fullsized":"2024-09-17T08:52:37.142671+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:35.362937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666786+0000","last_change":"2024-09-17T08:51:43.492096+0000","last_active":"2024-09-17T08:52:36.666786+0000","last_peered":"2024-09-17T08:52:36.666786+0000","last_clean":"2024-09-17T08:52:36.666786+0000","last_became_active":"2024-09-17T08:51:43.488798+0000","last_became_peered":"2024-09-17T08:51:43.488798+0000","last_unstale":"2024-09-17T08:52:36.666786+0000","last_undegraded":"2024-09-17T08:52:36.666786+0000","last_fullsized":"2024-09-17T08:52:36.666786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:31.898518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668409+0000","last_change":"2024-09-17T08:51:41.458638+0000","last_active":"2024-09-17T08:52:36.668409+0000","last_peered":"2024-09-17T08:52:36.668409+0000","last_clean":"2024-09-17T08:52:36.668409+0000","last_became_active":"2024-09-17T08:51:41.458286+0000","last_became_peered":"2024-09-17T08:51:41.458286+0000","last_unstale":"2024-09-17T08:52:36.668409+0000","last_undegraded":"2024-09-17T08:52:36.668409+0000","last_fullsized":"2024-09-17T08:52:36.668409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:22.668997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"74'12","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:14.922193+0000","last_change":"2024-09-17T08:52:29.259855+0000","last_active":"2024-09-17T08:54:14.922193+0000","last_peered":"2024-09-17T08:54:14.922193+0000","last_clean":"2024-09-17T08:54:14.922193+0000","last_became_active":"2024-09-17T08:52:29.254211+0000","last_became_peered":"2024-09-17T08:52:29.254211+0000","last_unstale":"2024-09-17T08:54:14.922193+0000","last_undegraded":"2024-09-17T08:54:14.922193+0000","last_fullsized":"2024-09-17T08:54:14.922193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:50:32.450583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669648+0000","last_change":"2024-09-17T08:51:47.983418+0000","last_active":"2024-09-17T08:52:36.669648+0000","last_peered":"2024-09-17T08:52:36.669648+0000","last_clean":"2024-09-17T08:52:36.669648+0000","last_became_active":"2024-09-17T08:51:47.982631+0000","last_became_peered":"2024-09-17T08:51:47.982631+0000","last_unstale":"2024-09-17T08:52:36.669648+0000","last_undegraded":"2024-09-17T08:52:36.669648+0000","last_fullsized":"2024-09-17T08:52:36.669648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:30.125138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779528+0000","last_change":"2024-09-17T08:51:41.473436+0000","last_active":"2024-09-17T08:52:36.779528+0000","last_peered":"2024-09-17T08:52:36.779528+0000","last_clean":"2024-09-17T08:52:36.779528+0000","last_became_active":"2024-09-17T08:51:41.472679+0000","last_became_peered":"2024-09-17T08:51:41.472679+0000","last_unstale":"2024-09-17T08:52:36.779528+0000","last_undegraded":"2024-09-17T08:52:36.779528+0000","last_fullsized":"2024-09-17T08:52:36.779528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:33.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"68'5","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665835+0000","last_change":"2024-09-17T08:51:43.500334+0000","last_active":"2024-09-17T08:52:36.665835+0000","last_peered":"2024-09-17T08:52:36.665835+0000","last_clean":"2024-09-17T08:52:36.665835+0000","last_became_active":"2024-09-17T08:51:43.499220+0000","last_became_peered":"2024-09-17T08:51:43.499220+0000","last_unstale":"2024-09-17T08:52:36.665835+0000","last_undegraded":"2024-09-17T08:52:36.665835+0000","last_fullsized":"2024-09-17T08:52:36.665835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:58.286939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287759+0000","last_change":"2024-09-17T08:51:45.520070+0000","last_active":"2024-09-17T08:52:37.287759+0000","last_peered":"2024-09-17T08:52:37.287759+0000","last_clean":"2024-09-17T08:52:37.287759+0000","last_became_active":"2024-09-17T08:51:45.519503+0000","last_became_peered":"2024-09-17T08:51:45.519503+0000","last_unstale":"2024-09-17T08:52:37.287759+0000","last_undegraded":"2024-09-17T08:52:37.287759+0000","last_fullsized":"2024-09-17T08:52:37.287759+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:37.958874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669222+0000","last_change":"2024-09-17T08:51:47.982743+0000","last_active":"2024-09-17T08:52:36.669222+0000","last_peered":"2024-09-17T08:52:36.669222+0000","last_clean":"2024-09-17T08:52:36.669222+0000","last_became_active":"2024-09-17T08:51:47.981865+0000","last_became_peered":"2024-09-17T08:51:47.981865+0000","last_unstale":"2024-09-17T08:52:36.669222+0000","last_undegraded":"2024-09-17T08:52:36.669222+0000","last_fullsized":"2024-09-17T08:52:36.669222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:44.260817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668241+0000","last_change":"2024-09-17T08:51:41.462808+0000","last_active":"2024-09-17T08:52:36.668241+0000","last_peered":"2024-09-17T08:52:36.668241+0000","last_clean":"2024-09-17T08:52:36.668241+0000","last_became_active":"2024-09-17T08:51:41.462369+0000","last_became_peered":"2024-09-17T08:51:41.462369+0000","last_unstale":"2024-09-17T08:52:36.668241+0000","last_undegraded":"2024-09-17T08:52:36.668241+0000","last_fullsized":"2024-09-17T08:52:36.668241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:54.094167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"68'9","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.670328+0000","last_change":"2024-09-17T08:51:43.552054+0000","last_active":"2024-09-17T08:52:36.670328+0000","last_peered":"2024-09-17T08:52:36.670328+0000","last_clean":"2024-09-17T08:52:36.670328+0000","last_became_active":"2024-09-17T08:51:43.551713+0000","last_became_peered":"2024-09-17T08:51:43.551713+0000","last_unstale":"2024-09-17T08:52:36.670328+0000","last_undegraded":"2024-09-17T08:52:36.670328+0000","last_fullsized":"2024-09-17T08:52:36.670328+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:58.676966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668020+0000","last_change":"2024-09-17T08:52:29.381735+0000","last_active":"2024-09-17T08:52:36.668020+0000","last_peered":"2024-09-17T08:52:36.668020+0000","last_clean":"2024-09-17T08:52:36.668020+0000","last_became_active":"2024-09-17T08:52:29.380953+0000","last_became_peered":"2024-09-17T08:52:29.380953+0000","last_unstale":"2024-09-17T08:52:36.668020+0000","last_undegraded":"2024-09-17T08:52:36.668020+0000","last_fullsized":"2024-09-17T08:52:36.668020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:24.953773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1386,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201322,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32528,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712624,"statfs":{"total":95995035648,"available":95961726976,"internally_reserved":0,"allocated":1449984,"data_stored":947190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88600000000000001,"15min":0.88},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.258,"5min":2.726,"15min":2.726},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.92800000000000005,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.286,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.1020000000000001}]},{"osd":1,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.96399999999999997},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2649999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96999999999999997,"15min":0.99299999999999999},"min":{"1min":0.70099999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2849999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90100000000000002,"15min":0.92300000000000004},"min":{"1min":0.56599999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.67900000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.198,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.212}]},{"osd":3,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93400000000000005,"15min":0.94799999999999995},"min":{"1min":0.71899999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.196,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0229999999999999,"15min":1.0509999999999999},"min":{"1min":0.61099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.379,"5min":2.79,"15min":2.79},"last":1.1359999999999999}]},{"osd":4,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.89000000000000001,"15min":0.90100000000000002},"min":{"1min":0.66700000000000004,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3500000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.93799999999999994,"15min":0.95999999999999996},"min":{"1min":0.66600000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.4139999999999999,"5min":1.456,"15min":1.456},"last":0.96799999999999997}]},{"osd":5,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.628,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.484,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97899999999999998,"15min":0.98499999999999999},"min":{"1min":0.71199999999999997,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.647,"15min":1.647},"last":0.88800000000000001}]},{"osd":6,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0469999999999999,"15min":1.0569999999999999},"min":{"1min":0.83599999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.875,"15min":1.875},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.008,"15min":1.0489999999999999},"min":{"1min":0.79900000000000004,"5min":0.312,"15min":0.312},"max":{"1min":1.298,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0669999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462965,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1417216,"data_stored":945471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.84199999999999997,"15min":0.86099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2250000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.873,"15min":0.89100000000000001},"min":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1399999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93999999999999995}]},{"osd":1,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86199999999999999,"15min":0.84999999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0209999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.54200000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.204,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.878,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94999999999999996,"15min":0.93400000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2170000000000001,"5min":1.234,"15min":1.234},"last":1.0620000000000001}]},{"osd":3,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.115,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.92000000000000004,"15min":0.90700000000000003},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2509999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0960000000000001}]},{"osd":4,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.84599999999999997,"15min":0.81399999999999995},"min":{"1min":0.42299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1930000000000001,"5min":1.256,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.88900000000000001,"15min":0.84099999999999997},"min":{"1min":0.42199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.327,"5min":1.391,"15min":1.391},"last":1.01}]},{"osd":5,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.87,"15min":0.84099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1930000000000001,"5min":1.349,"15min":1.349},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.97999999999999998,"15min":0.93999999999999995},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.2749999999999999,"5min":1.472,"15min":1.472},"last":0.86599999999999999}]},{"osd":7,"last update":"Tue Sep 17 08:54:09 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.046,"15min":1.0820000000000001},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.099,"15min":1.119},"min":{"1min":0.46100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.208}]}]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":843776,"data_stored":356704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.88900000000000001,"15min":0.85799999999999998},"min":{"1min":0.65300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.89000000000000001,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.67600000000000005}]},{"osd":1,"last update":"Tue Sep 17 08:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.872,"15min":0.84199999999999997},"min":{"1min":0.69199999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91400000000000003,"15min":0.89900000000000002},"min":{"1min":0.70999999999999996,"5min":0.318,"15min":0.318},"max":{"1min":1.2729999999999999,"5min":1.28,"15min":1.28},"last":0.82899999999999996}]},{"osd":2,"last update":"Tue Sep 17 08:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.90100000000000002,"15min":0.88700000000000001},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.159,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.90300000000000002,"15min":0.88700000000000001},"min":{"1min":0.70799999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.04}]},{"osd":3,"last update":"Tue Sep 17 08:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.90700000000000003,"15min":0.88900000000000001},"min":{"1min":0.79600000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.872},{"interface":"front","average":{"1min":1.042,"5min":0.97199999999999998,"15min":0.94799999999999995},"min":{"1min":0.64600000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.1779999999999999}]},{"osd":4,"last update":"Tue Sep 17 08:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.80900000000000005,"15min":0.76400000000000001},"min":{"1min":0.63400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.81899999999999995,"15min":0.76300000000000001},"min":{"1min":0.72299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3180000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.139}]},{"osd":6,"last update":"Tue Sep 17 08:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.61499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1899999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.65100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.2509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.2050000000000001}]},{"osd":7,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0489999999999999,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0229999999999999,"15min":1.0129999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.077}]}]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":860160,"data_stored":356025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.871,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.254,"5min":1.45,"15min":1.45},"last":1.121},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.88300000000000001,"15min":0.83999999999999997},"min":{"1min":0.61199999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2789999999999999,"5min":1.333,"15min":1.333},"last":0.84599999999999997}]},{"osd":1,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84699999999999998,"15min":0.81799999999999995},"min":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.21,"5min":1.357,"15min":1.357},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.92100000000000004,"15min":0.85799999999999998},"min":{"1min":0.61299999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.415,"5min":1.488,"15min":1.488},"last":1.226}]},{"osd":2,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88500000000000001,"15min":0.82699999999999996},"min":{"1min":0.52900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.165,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.091},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.85299999999999998,"15min":0.82199999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.304,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89500000000000002,"15min":0.85099999999999998},"min":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.379,"5min":1.49,"15min":1.49},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.284,"5min":1.371,"15min":1.371},"last":0.97499999999999998}]},{"osd":5,"last update":"Tue Sep 17 08:53:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.80600000000000005,"15min":0.72699999999999998},"min":{"1min":0.50800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89000000000000001,"15min":0.81999999999999995},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1599999999999999}]},{"osd":6,"last update":"Tue Sep 17 08:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.79000000000000004},"min":{"1min":0.45100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.131,"5min":1.296,"15min":1.296},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.0009999999999999,"15min":0.97099999999999997},"min":{"1min":0.40600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.2749999999999999,"5min":1.466,"15min":1.466},"last":0.94199999999999995}]},{"osd":7,"last update":"Tue Sep 17 08:54:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0609999999999999,"15min":1.0580000000000001},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97299999999999998,"15min":0.97099999999999997},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.89100000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149780,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31924,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713228,"statfs":{"total":95995035648,"available":95962345472,"internally_reserved":0,"allocated":827392,"data_stored":355383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36599999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.69699999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45100000000000001},"max":{"1min":1.073,"5min":1.534,"15min":1.534},"last":0.60399999999999998}]},{"osd":1,"last update":"Tue Sep 17 08:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":0.94899999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77500000000000002,"15min":0.73299999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.34599999999999997},"max":{"1min":1.198,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0169999999999999}]},{"osd":2,"last update":"Tue Sep 17 08:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84699999999999998,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":1.821,"15min":1.821},"last":0.753},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77800000000000002,"15min":0.74099999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40500000000000003},"max":{"1min":0.97399999999999998,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Tue Sep 17 08:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.94499999999999995,"15min":0.873},"min":{"1min":0.67900000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.22,"5min":1.778,"15min":1.778},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97799999999999998,"15min":0.93300000000000005},"min":{"1min":0.79900000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.236,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.88300000000000001}]},{"osd":5,"last update":"Tue Sep 17 08:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.98299999999999998,"15min":0.94599999999999995},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3300000000000001,"5min":1.528,"15min":1.528},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.96499999999999997},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.1859999999999999,"5min":1.712,"15min":1.712},"last":1.0820000000000001}]},{"osd":6,"last update":"Tue Sep 17 08:54:17 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.095,"15min":1.1100000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.641,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.123,"15min":1.1120000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.6040000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.163}]},{"osd":7,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.694,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.262},{"interface":"front","average":{"1min":1.01,"5min":1.083,"15min":1.105},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.28,"5min":1.631,"15min":1.631},"last":0.95499999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31936,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713216,"statfs":{"total":95995035648,"available":95962333184,"internally_reserved":0,"allocated":839680,"data_stored":356782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.56999999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27200000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73399999999999999,"15min":0.63300000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.226,"5min":1.252,"15min":1.252},"last":0.73699999999999999}]},{"osd":1,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69699999999999995,"15min":0.63200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":1.0329999999999999,"5min":1.843,"15min":1.843},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77600000000000002,"15min":0.66600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":1.0289999999999999,"5min":1.486,"15min":1.486},"last":1.008}]},{"osd":3,"last update":"Tue Sep 17 08:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.83299999999999996,"15min":0.78900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.145,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.80600000000000005,"15min":0.76600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2030000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.82899999999999996}]},{"osd":4,"last update":"Tue Sep 17 08:53:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94299999999999995,"15min":0.89900000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88900000000000001,"15min":0.85899999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4019999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.86099999999999999}]},{"osd":5,"last update":"Tue Sep 17 08:53:28 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.93600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4610000000000001,"5min":1.464,"15min":1.464},"last":1.2549999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.97999999999999998,"15min":0.96799999999999997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.429,"5min":1.516,"15min":1.516},"last":1.0469999999999999}]},{"osd":6,"last update":"Tue Sep 17 08:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1879999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0600000000000001,"15min":1.073},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.232,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1799999999999999}]},{"osd":7,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.113,"15min":1.147},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.369,"5min":1.631,"15min":1.631},"last":1.101},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.127,"15min":1.157},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3069999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.325}]}]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":355159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:54:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.58999999999999997},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.27400000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76200000000000001,"15min":0.61099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.1200000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Tue Sep 17 08:53:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.873},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71799999999999997,"15min":0.60699999999999998},"min":{"1min":0.442,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Tue Sep 17 08:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.72599999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.83899999999999997,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.105}]},{"osd":4,"last update":"Tue Sep 17 08:53:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.96099999999999997,"15min":0.91400000000000003},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.204},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.89800000000000002,"15min":0.85699999999999998},"min":{"1min":0.62,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.0209999999999999}]},{"osd":5,"last update":"Tue Sep 17 08:53:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.92600000000000005,"15min":0.91800000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.22,"15min":1.22},"last":1.23},{"interface":"front","average":{"1min":1.046,"5min":1.0389999999999999,"15min":1.0209999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.004}]},{"osd":6,"last update":"Tue Sep 17 08:54:17 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.96199999999999997,"15min":0.93400000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.173},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.085,"15min":1.0880000000000001},"min":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.284}]},{"osd":7,"last update":"Tue Sep 17 08:54:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0840000000000001,"15min":1.079},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.327},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.65900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.2529999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738483,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1437696,"data_stored":945649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 08:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":1.141,"5min":1.752,"15min":1.752},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.1419999999999999,"5min":1.27,"15min":1.27},"last":0.88400000000000001}]},{"osd":2,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.64300000000000002},"min":{"1min":0.38300000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.91000000000000003,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79500000000000004,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.228,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.65200000000000002}]},{"osd":3,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82899999999999996,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.119,"5min":1.804,"15min":1.804},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.78200000000000003},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.256,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.97999999999999998}]},{"osd":4,"last update":"Tue Sep 17 08:53:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93899999999999995,"15min":0.92700000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.242,"5min":1.329,"15min":1.329},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.95899999999999996,"15min":0.89400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.147,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":0.95099999999999996}]},{"osd":5,"last update":"Tue Sep 17 08:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.008,"15min":1.016},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.202,"5min":3.347,"15min":3.347},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.97799999999999998,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.244,"5min":5.1539999999999999,"15min":5.1539999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Tue Sep 17 08:53:20 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.052,"15min":1.028},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3049999999999999,"5min":4.9210000000000003,"15min":4.9210000000000003},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1140000000000001,"15min":1.1040000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.26,"5min":3.605,"15min":3.605},"last":1.2729999999999999}]},{"osd":7,"last update":"Tue Sep 17 08:54:07 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.163,"15min":1.2270000000000001},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.369,"5min":4.2199999999999998,"15min":4.2199999999999998},"last":1.242},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.1890000000000001,"15min":1.2609999999999999},"min":{"1min":0.71199999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.216,"5min":5.0110000000000001,"15min":5.0110000000000001},"last":1.018}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T08:54:27.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T08:54:28.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:27 smithi078 bash[22670]: cluster 2024-09-17T08:54:26.733175+0000 mgr.y (mgr.14532) 102 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:28.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:27 smithi078 bash[32124]: cluster 2024-09-17T08:54:26.733175+0000 mgr.y (mgr.14532) 102 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:28.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:54:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:54:28.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:27 smithi136 bash[24812]: cluster 2024-09-17T08:54:26.733175+0000 mgr.y (mgr.14532) 102 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:28 smithi078 bash[22670]: audit 2024-09-17T08:54:27.330199+0000 mgr.y (mgr.14532) 103 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:54:29.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:28 smithi078 bash[32124]: audit 2024-09-17T08:54:27.330199+0000 mgr.y (mgr.14532) 103 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:54:29.191 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:28 smithi136 bash[24812]: audit 2024-09-17T08:54:27.330199+0000 mgr.y (mgr.14532) 103 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:54:29.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:54:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:54:30.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:29 smithi078 bash[22670]: cluster 2024-09-17T08:54:28.734693+0000 mgr.y (mgr.14532) 104 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:30.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:29 smithi078 bash[32124]: cluster 2024-09-17T08:54:28.734693+0000 mgr.y (mgr.14532) 104 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:30.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:29 smithi136 bash[24812]: cluster 2024-09-17T08:54:28.734693+0000 mgr.y (mgr.14532) 104 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:31.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:30 smithi078 bash[22670]: audit 2024-09-17T08:54:29.193456+0000 mgr.y (mgr.14532) 105 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:31.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:30 smithi078 bash[32124]: audit 2024-09-17T08:54:29.193456+0000 mgr.y (mgr.14532) 105 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:30 smithi136 bash[24812]: audit 2024-09-17T08:54:29.193456+0000 mgr.y (mgr.14532) 105 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:32.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:31 smithi078 bash[22670]: cluster 2024-09-17T08:54:30.735311+0000 mgr.y (mgr.14532) 106 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:32.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:31 smithi078 bash[32124]: cluster 2024-09-17T08:54:30.735311+0000 mgr.y (mgr.14532) 106 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:32.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:31 smithi136 bash[24812]: cluster 2024-09-17T08:54:30.735311+0000 mgr.y (mgr.14532) 106 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:32.738 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:33 smithi078 bash[22670]: cluster 2024-09-17T08:54:32.735975+0000 mgr.y (mgr.14532) 107 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:34.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:33 smithi078 bash[32124]: cluster 2024-09-17T08:54:32.735975+0000 mgr.y (mgr.14532) 107 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:34.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:33 smithi136 bash[24812]: cluster 2024-09-17T08:54:32.735975+0000 mgr.y (mgr.14532) 107 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:35.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- 172.21.15.78:0/1732898136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 msgr2=0x7fa918100410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:35.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 --2- 172.21.15.78:0/1732898136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa918100410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa910009ca0 tx=0x7fa91002a8c0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- 172.21.15.78:0/1732898136 shutdown_connections 2024-09-17T08:54:35.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 --2- 172.21.15.78:0/1732898136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa918105160 0x7fa91810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 --2- 172.21.15.78:0/1732898136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9181009e0 0x7fa918104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 --2- 172.21.15.78:0/1732898136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa918100410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- 172.21.15.78:0/1732898136 >> 172.21.15.78:0/1732898136 conn(0x7fa9180fbad0 msgr2=0x7fa9180fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:35.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- 172.21.15.78:0/1732898136 shutdown_connections 2024-09-17T08:54:35.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- 172.21.15.78:0/1732898136 wait complete. 2024-09-17T08:54:35.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 Processor -- start 2024-09-17T08:54:35.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- start start 2024-09-17T08:54:35.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa91819b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:35.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9181009e0 0x7fa91819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa918105160 0x7fa9181956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa918195db0 con 0x7fa918105160 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa918195f20 con 0x7fa9181009e0 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9181960e0 con 0x7fa918100030 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa91819b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa91819b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:58310/0 (socket says 172.21.15.78:58310) 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 -- 172.21.15.78:0/3924310087 learned_addr learned my addr 172.21.15.78:0/3924310087 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa917fff640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa918105160 0x7fa9181956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa916ffd640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9181009e0 0x7fa91819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 -- 172.21.15.78:0/3924310087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9181009e0 msgr2=0x7fa91819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9181009e0 0x7fa91819bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 -- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa918105160 msgr2=0x7fa9181956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa918105160 0x7fa9181956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 -- 172.21.15.78:0/3924310087 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910009900 con 0x7fa918100030 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa916ffd640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9181009e0 0x7fa91819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa917fff640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa918105160 0x7fa9181956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa9177fe640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa91819b5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa910005e30 tx=0x7fa910030ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa914ff9640 1 -- 172.21.15.78:0/3924310087 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910003bf0 con 0x7fa918100030 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa914ff9640 1 -- 172.21.15.78:0/3924310087 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa910040070 con 0x7fa918100030 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa918196360 con 0x7fa918100030 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa914ff9640 1 -- 172.21.15.78:0/3924310087 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910004380 con 0x7fa918100030 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.542+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9181a25b0 con 0x7fa918100030 2024-09-17T08:54:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.546+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa918101510 con 0x7fa918100030 2024-09-17T08:54:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.546+0000 7fa914ff9640 1 -- 172.21.15.78:0/3924310087 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fa910042030 con 0x7fa918100030 2024-09-17T08:54:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.546+0000 7fa914ff9640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa90006cec0 0x7fa90006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.546+0000 7fa916ffd640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa90006cec0 0x7fa90006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.546+0000 7fa914ff9640 1 -- 172.21.15.78:0/3924310087 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fa9100adf00 con 0x7fa918100030 2024-09-17T08:54:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.546+0000 7fa916ffd640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa90006cec0 0x7fa90006f380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa9180fdaf0 tx=0x7fa90c005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.550+0000 7fa914ff9640 1 -- 172.21.15.78:0/3924310087 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa910077b30 con 0x7fa918100030 2024-09-17T08:54:35.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.718+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 --> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa918196bc0 con 0x7fa90006cec0 2024-09-17T08:54:35.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.730+0000 7fa914ff9640 1 -- 172.21.15.78:0/3924310087 <== mgr.14532 v2:172.21.15.78:6800/1209266769 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+381994 (secure 0 0 0) 0x7fa918196bc0 con 0x7fa90006cec0 2024-09-17T08:54:35.728 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:54:35.732 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T08:54:35.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa90006cec0 msgr2=0x7fa90006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa90006cec0 0x7fa90006f380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa9180fdaf0 tx=0x7fa90c005f90 comp rx=0 tx=0).stop 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 msgr2=0x7fa91819b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa91819b5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa910005e30 tx=0x7fa910030ee0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 shutdown_connections 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa90006cec0 0x7fa90006f380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa918105160 0x7fa9181956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9181009e0 0x7fa91819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 --2- 172.21.15.78:0/3924310087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa918100030 0x7fa91819b5c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 >> 172.21.15.78:0/3924310087 conn(0x7fa9180fbad0 msgr2=0x7fa9180fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 shutdown_connections 2024-09-17T08:54:35.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:35.734+0000 7fa91df27640 1 -- 172.21.15.78:0/3924310087 wait complete. 2024-09-17T08:54:36.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:35 smithi078 bash[32124]: cluster 2024-09-17T08:54:34.737419+0000 mgr.y (mgr.14532) 108 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:35 smithi078 bash[22670]: cluster 2024-09-17T08:54:34.737419+0000 mgr.y (mgr.14532) 108 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:36.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:35 smithi136 bash[24812]: cluster 2024-09-17T08:54:34.737419+0000 mgr.y (mgr.14532) 108 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:36.328 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-17T08:54:34.736268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596246,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":1081,"num_read_kb":927,"num_write":609,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":624,"ondisk_log_size":624,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":236748,"kb_used_data":8308,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749724468,"statfs":{"total":767960285184,"available":767717855232,"internally_reserved":0,"allocated":8507392,"data_stored":4618363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005870"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667815+0000","last_change":"2024-09-17T08:51:47.988669+0000","last_active":"2024-09-17T08:52:36.667815+0000","last_peered":"2024-09-17T08:52:36.667815+0000","last_clean":"2024-09-17T08:52:36.667815+0000","last_became_active":"2024-09-17T08:51:47.987836+0000","last_became_peered":"2024-09-17T08:51:47.987836+0000","last_unstale":"2024-09-17T08:52:36.667815+0000","last_undegraded":"2024-09-17T08:52:36.667815+0000","last_fullsized":"2024-09-17T08:52:36.667815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:22:46.513084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666431+0000","last_change":"2024-09-17T08:51:41.477585+0000","last_active":"2024-09-17T08:52:36.666431+0000","last_peered":"2024-09-17T08:52:36.666431+0000","last_clean":"2024-09-17T08:52:36.666431+0000","last_became_active":"2024-09-17T08:51:41.477032+0000","last_became_peered":"2024-09-17T08:51:41.477032+0000","last_unstale":"2024-09-17T08:52:36.666431+0000","last_undegraded":"2024-09-17T08:52:36.666431+0000","last_fullsized":"2024-09-17T08:52:36.666431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:09.445075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"68'10","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668562+0000","last_change":"2024-09-17T08:51:43.550898+0000","last_active":"2024-09-17T08:52:36.668562+0000","last_peered":"2024-09-17T08:52:36.668562+0000","last_clean":"2024-09-17T08:52:36.668562+0000","last_became_active":"2024-09-17T08:51:43.550302+0000","last_became_peered":"2024-09-17T08:51:43.550302+0000","last_unstale":"2024-09-17T08:52:36.668562+0000","last_undegraded":"2024-09-17T08:52:36.668562+0000","last_fullsized":"2024-09-17T08:52:36.668562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:17.654233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668059+0000","last_change":"2024-09-17T08:51:45.506337+0000","last_active":"2024-09-17T08:52:36.668059+0000","last_peered":"2024-09-17T08:52:36.668059+0000","last_clean":"2024-09-17T08:52:36.668059+0000","last_became_active":"2024-09-17T08:51:45.505514+0000","last_became_peered":"2024-09-17T08:51:45.505514+0000","last_unstale":"2024-09-17T08:52:36.668059+0000","last_undegraded":"2024-09-17T08:52:36.668059+0000","last_fullsized":"2024-09-17T08:52:36.668059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:19.966036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669088+0000","last_change":"2024-09-17T08:51:41.460439+0000","last_active":"2024-09-17T08:52:36.669088+0000","last_peered":"2024-09-17T08:52:36.669088+0000","last_clean":"2024-09-17T08:52:36.669088+0000","last_became_active":"2024-09-17T08:51:41.459977+0000","last_became_peered":"2024-09-17T08:51:41.459977+0000","last_unstale":"2024-09-17T08:52:36.669088+0000","last_undegraded":"2024-09-17T08:52:36.669088+0000","last_fullsized":"2024-09-17T08:52:36.669088+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:37.072223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"68'11","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665954+0000","last_change":"2024-09-17T08:51:43.552480+0000","last_active":"2024-09-17T08:52:36.665954+0000","last_peered":"2024-09-17T08:52:36.665954+0000","last_clean":"2024-09-17T08:52:36.665954+0000","last_became_active":"2024-09-17T08:51:43.551617+0000","last_became_peered":"2024-09-17T08:51:43.551617+0000","last_unstale":"2024-09-17T08:52:36.665954+0000","last_undegraded":"2024-09-17T08:52:36.665954+0000","last_fullsized":"2024-09-17T08:52:36.665954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:30.235900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667669+0000","last_change":"2024-09-17T08:51:45.523836+0000","last_active":"2024-09-17T08:52:36.667669+0000","last_peered":"2024-09-17T08:52:36.667669+0000","last_clean":"2024-09-17T08:52:36.667669+0000","last_became_active":"2024-09-17T08:51:45.522807+0000","last_became_peered":"2024-09-17T08:51:45.522807+0000","last_unstale":"2024-09-17T08:52:36.667669+0000","last_undegraded":"2024-09-17T08:52:36.667669+0000","last_fullsized":"2024-09-17T08:52:36.667669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:47.716999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669358+0000","last_change":"2024-09-17T08:51:47.728297+0000","last_active":"2024-09-17T08:52:36.669358+0000","last_peered":"2024-09-17T08:52:36.669358+0000","last_clean":"2024-09-17T08:52:36.669358+0000","last_became_active":"2024-09-17T08:51:47.727532+0000","last_became_peered":"2024-09-17T08:51:47.727532+0000","last_unstale":"2024-09-17T08:52:36.669358+0000","last_undegraded":"2024-09-17T08:52:36.669358+0000","last_fullsized":"2024-09-17T08:52:36.669358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:31:05.430603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794648+0000","last_change":"2024-09-17T08:51:41.473651+0000","last_active":"2024-09-17T08:52:36.794648+0000","last_peered":"2024-09-17T08:52:36.794648+0000","last_clean":"2024-09-17T08:52:36.794648+0000","last_became_active":"2024-09-17T08:51:41.472449+0000","last_became_peered":"2024-09-17T08:51:41.472449+0000","last_unstale":"2024-09-17T08:52:36.794648+0000","last_undegraded":"2024-09-17T08:52:36.794648+0000","last_fullsized":"2024-09-17T08:52:36.794648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:15.929460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"68'15","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858425+0000","last_change":"2024-09-17T08:51:43.505903+0000","last_active":"2024-09-17T08:52:37.858425+0000","last_peered":"2024-09-17T08:52:37.858425+0000","last_clean":"2024-09-17T08:52:37.858425+0000","last_became_active":"2024-09-17T08:51:43.505176+0000","last_became_peered":"2024-09-17T08:51:43.505176+0000","last_unstale":"2024-09-17T08:52:37.858425+0000","last_undegraded":"2024-09-17T08:52:37.858425+0000","last_fullsized":"2024-09-17T08:52:37.858425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:44.131360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668350+0000","last_change":"2024-09-17T08:51:45.515099+0000","last_active":"2024-09-17T08:52:36.668350+0000","last_peered":"2024-09-17T08:52:36.668350+0000","last_clean":"2024-09-17T08:52:36.668350+0000","last_became_active":"2024-09-17T08:51:45.513728+0000","last_became_peered":"2024-09-17T08:51:45.513728+0000","last_unstale":"2024-09-17T08:52:36.668350+0000","last_undegraded":"2024-09-17T08:52:36.668350+0000","last_fullsized":"2024-09-17T08:52:36.668350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:10.585508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858029+0000","last_change":"2024-09-17T08:51:47.734730+0000","last_active":"2024-09-17T08:52:37.858029+0000","last_peered":"2024-09-17T08:52:37.858029+0000","last_clean":"2024-09-17T08:52:37.858029+0000","last_became_active":"2024-09-17T08:51:47.733895+0000","last_became_peered":"2024-09-17T08:51:47.733895+0000","last_unstale":"2024-09-17T08:52:37.858029+0000","last_undegraded":"2024-09-17T08:52:37.858029+0000","last_fullsized":"2024-09-17T08:52:37.858029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:44.588976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'1","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794616+0000","last_change":"2024-09-17T08:51:41.474730+0000","last_active":"2024-09-17T08:52:36.794616+0000","last_peered":"2024-09-17T08:52:36.794616+0000","last_clean":"2024-09-17T08:52:36.794616+0000","last_became_active":"2024-09-17T08:51:41.473964+0000","last_became_peered":"2024-09-17T08:51:41.473964+0000","last_unstale":"2024-09-17T08:52:36.794616+0000","last_undegraded":"2024-09-17T08:52:36.794616+0000","last_fullsized":"2024-09-17T08:52:36.794616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:02.448064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"68'12","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858701+0000","last_change":"2024-09-17T08:51:43.507593+0000","last_active":"2024-09-17T08:52:37.858701+0000","last_peered":"2024-09-17T08:52:37.858701+0000","last_clean":"2024-09-17T08:52:37.858701+0000","last_became_active":"2024-09-17T08:51:43.507050+0000","last_became_peered":"2024-09-17T08:51:43.507050+0000","last_unstale":"2024-09-17T08:52:37.858701+0000","last_undegraded":"2024-09-17T08:52:37.858701+0000","last_fullsized":"2024-09-17T08:52:37.858701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:02.107121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669929+0000","last_change":"2024-09-17T08:51:45.513457+0000","last_active":"2024-09-17T08:52:36.669929+0000","last_peered":"2024-09-17T08:52:36.669929+0000","last_clean":"2024-09-17T08:52:36.669929+0000","last_became_active":"2024-09-17T08:51:45.511422+0000","last_became_peered":"2024-09-17T08:51:45.511422+0000","last_unstale":"2024-09-17T08:52:36.669929+0000","last_undegraded":"2024-09-17T08:52:36.669929+0000","last_fullsized":"2024-09-17T08:52:36.669929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:34.942212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664750+0000","last_change":"2024-09-17T08:51:47.740946+0000","last_active":"2024-09-17T08:52:36.664750+0000","last_peered":"2024-09-17T08:52:36.664750+0000","last_clean":"2024-09-17T08:52:36.664750+0000","last_became_active":"2024-09-17T08:51:47.740338+0000","last_became_peered":"2024-09-17T08:51:47.740338+0000","last_unstale":"2024-09-17T08:52:36.664750+0000","last_undegraded":"2024-09-17T08:52:36.664750+0000","last_fullsized":"2024-09-17T08:52:36.664750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:26:28.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"68'19","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779342+0000","last_change":"2024-09-17T08:51:43.503205+0000","last_active":"2024-09-17T08:52:36.779342+0000","last_peered":"2024-09-17T08:52:36.779342+0000","last_clean":"2024-09-17T08:52:36.779342+0000","last_became_active":"2024-09-17T08:51:43.502248+0000","last_became_peered":"2024-09-17T08:51:43.502248+0000","last_unstale":"2024-09-17T08:52:36.779342+0000","last_undegraded":"2024-09-17T08:52:36.779342+0000","last_fullsized":"2024-09-17T08:52:36.779342+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:28.928553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794413+0000","last_change":"2024-09-17T08:51:41.480634+0000","last_active":"2024-09-17T08:52:36.794413+0000","last_peered":"2024-09-17T08:52:36.794413+0000","last_clean":"2024-09-17T08:52:36.794413+0000","last_became_active":"2024-09-17T08:51:41.480278+0000","last_became_peered":"2024-09-17T08:51:41.480278+0000","last_unstale":"2024-09-17T08:52:36.794413+0000","last_undegraded":"2024-09-17T08:52:36.794413+0000","last_fullsized":"2024-09-17T08:52:36.794413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:27:16.561972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"68'11","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.929991+0000","last_change":"2024-09-17T08:51:45.511019+0000","last_active":"2024-09-17T08:54:24.929991+0000","last_peered":"2024-09-17T08:54:24.929991+0000","last_clean":"2024-09-17T08:54:24.929991+0000","last_became_active":"2024-09-17T08:51:45.509407+0000","last_became_peered":"2024-09-17T08:51:45.509407+0000","last_unstale":"2024-09-17T08:54:24.929991+0000","last_undegraded":"2024-09-17T08:54:24.929991+0000","last_fullsized":"2024-09-17T08:54:24.929991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:15.856267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287878+0000","last_change":"2024-09-17T08:51:47.737575+0000","last_active":"2024-09-17T08:52:37.287878+0000","last_peered":"2024-09-17T08:52:37.287878+0000","last_clean":"2024-09-17T08:52:37.287878+0000","last_became_active":"2024-09-17T08:51:47.737209+0000","last_became_peered":"2024-09-17T08:51:47.737209+0000","last_unstale":"2024-09-17T08:52:37.287878+0000","last_undegraded":"2024-09-17T08:52:37.287878+0000","last_fullsized":"2024-09-17T08:52:37.287878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:06.352101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668081+0000","last_change":"2024-09-17T08:51:43.497916+0000","last_active":"2024-09-17T08:52:36.668081+0000","last_peered":"2024-09-17T08:52:36.668081+0000","last_clean":"2024-09-17T08:52:36.668081+0000","last_became_active":"2024-09-17T08:51:43.497128+0000","last_became_peered":"2024-09-17T08:51:43.497128+0000","last_unstale":"2024-09-17T08:52:36.668081+0000","last_undegraded":"2024-09-17T08:52:36.668081+0000","last_fullsized":"2024-09-17T08:52:36.668081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:22.196101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142671+0000","last_change":"2024-09-17T08:52:29.253902+0000","last_active":"2024-09-17T08:52:37.142671+0000","last_peered":"2024-09-17T08:52:37.142671+0000","last_clean":"2024-09-17T08:52:37.142671+0000","last_became_active":"2024-09-17T08:52:29.252912+0000","last_became_peered":"2024-09-17T08:52:29.252912+0000","last_unstale":"2024-09-17T08:52:37.142671+0000","last_undegraded":"2024-09-17T08:52:37.142671+0000","last_fullsized":"2024-09-17T08:52:37.142671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:41.882955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668353+0000","last_change":"2024-09-17T08:51:45.511251+0000","last_active":"2024-09-17T08:52:36.668353+0000","last_peered":"2024-09-17T08:52:36.668353+0000","last_clean":"2024-09-17T08:52:36.668353+0000","last_became_active":"2024-09-17T08:51:45.510479+0000","last_became_peered":"2024-09-17T08:51:45.510479+0000","last_unstale":"2024-09-17T08:52:36.668353+0000","last_undegraded":"2024-09-17T08:52:36.668353+0000","last_fullsized":"2024-09-17T08:52:36.668353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:31.453038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669823+0000","last_change":"2024-09-17T08:51:47.730951+0000","last_active":"2024-09-17T08:52:36.669823+0000","last_peered":"2024-09-17T08:52:36.669823+0000","last_clean":"2024-09-17T08:52:36.669823+0000","last_became_active":"2024-09-17T08:51:47.730080+0000","last_became_peered":"2024-09-17T08:51:47.730080+0000","last_unstale":"2024-09-17T08:52:36.669823+0000","last_undegraded":"2024-09-17T08:52:36.669823+0000","last_fullsized":"2024-09-17T08:52:36.669823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:13.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"68'15","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666812+0000","last_change":"2024-09-17T08:51:43.492865+0000","last_active":"2024-09-17T08:52:36.666812+0000","last_peered":"2024-09-17T08:52:36.666812+0000","last_clean":"2024-09-17T08:52:36.666812+0000","last_became_active":"2024-09-17T08:51:43.492068+0000","last_became_peered":"2024-09-17T08:51:43.492068+0000","last_unstale":"2024-09-17T08:52:36.666812+0000","last_undegraded":"2024-09-17T08:52:36.666812+0000","last_fullsized":"2024-09-17T08:52:36.666812+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:42:41.574972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142394+0000","last_change":"2024-09-17T08:51:41.463556+0000","last_active":"2024-09-17T08:52:37.142394+0000","last_peered":"2024-09-17T08:52:37.142394+0000","last_clean":"2024-09-17T08:52:37.142394+0000","last_became_active":"2024-09-17T08:51:41.463204+0000","last_became_peered":"2024-09-17T08:51:41.463204+0000","last_unstale":"2024-09-17T08:52:37.142394+0000","last_undegraded":"2024-09-17T08:52:37.142394+0000","last_fullsized":"2024-09-17T08:52:37.142394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:40:43.382126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142858+0000","last_change":"2024-09-17T08:51:45.511725+0000","last_active":"2024-09-17T08:52:37.142858+0000","last_peered":"2024-09-17T08:52:37.142858+0000","last_clean":"2024-09-17T08:52:37.142858+0000","last_became_active":"2024-09-17T08:51:45.511076+0000","last_became_peered":"2024-09-17T08:51:45.511076+0000","last_unstale":"2024-09-17T08:52:37.142858+0000","last_undegraded":"2024-09-17T08:52:37.142858+0000","last_fullsized":"2024-09-17T08:52:37.142858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:59.488255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858426+0000","last_change":"2024-09-17T08:51:47.735767+0000","last_active":"2024-09-17T08:52:37.858426+0000","last_peered":"2024-09-17T08:52:37.858426+0000","last_clean":"2024-09-17T08:52:37.858426+0000","last_became_active":"2024-09-17T08:51:47.734765+0000","last_became_peered":"2024-09-17T08:51:47.734765+0000","last_unstale":"2024-09-17T08:52:37.858426+0000","last_undegraded":"2024-09-17T08:52:37.858426+0000","last_fullsized":"2024-09-17T08:52:37.858426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:45.396948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"68'12","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668747+0000","last_change":"2024-09-17T08:51:43.551435+0000","last_active":"2024-09-17T08:52:36.668747+0000","last_peered":"2024-09-17T08:52:36.668747+0000","last_clean":"2024-09-17T08:52:36.668747+0000","last_became_active":"2024-09-17T08:51:43.551082+0000","last_became_peered":"2024-09-17T08:51:43.551082+0000","last_unstale":"2024-09-17T08:52:36.668747+0000","last_undegraded":"2024-09-17T08:52:36.668747+0000","last_fullsized":"2024-09-17T08:52:36.668747+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:01.086134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793768+0000","last_change":"2024-09-17T08:51:41.474620+0000","last_active":"2024-09-17T08:52:36.793768+0000","last_peered":"2024-09-17T08:52:36.793768+0000","last_clean":"2024-09-17T08:52:36.793768+0000","last_became_active":"2024-09-17T08:51:41.472430+0000","last_became_peered":"2024-09-17T08:51:41.472430+0000","last_unstale":"2024-09-17T08:52:36.793768+0000","last_undegraded":"2024-09-17T08:52:36.793768+0000","last_fullsized":"2024-09-17T08:52:36.793768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:05:56.514064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"68'11","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.929971+0000","last_change":"2024-09-17T08:51:45.521777+0000","last_active":"2024-09-17T08:54:24.929971+0000","last_peered":"2024-09-17T08:54:24.929971+0000","last_clean":"2024-09-17T08:54:24.929971+0000","last_became_active":"2024-09-17T08:51:45.521104+0000","last_became_peered":"2024-09-17T08:51:45.521104+0000","last_unstale":"2024-09-17T08:54:24.929971+0000","last_undegraded":"2024-09-17T08:54:24.929971+0000","last_fullsized":"2024-09-17T08:54:24.929971+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:20.463257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667249+0000","last_change":"2024-09-17T08:51:47.982151+0000","last_active":"2024-09-17T08:52:36.667249+0000","last_peered":"2024-09-17T08:52:36.667249+0000","last_clean":"2024-09-17T08:52:36.667249+0000","last_became_active":"2024-09-17T08:51:47.981311+0000","last_became_peered":"2024-09-17T08:51:47.981311+0000","last_unstale":"2024-09-17T08:52:36.667249+0000","last_undegraded":"2024-09-17T08:52:36.667249+0000","last_fullsized":"2024-09-17T08:52:36.667249+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:04.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"68'12","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665561+0000","last_change":"2024-09-17T08:51:43.502292+0000","last_active":"2024-09-17T08:52:36.665561+0000","last_peered":"2024-09-17T08:52:36.665561+0000","last_clean":"2024-09-17T08:52:36.665561+0000","last_became_active":"2024-09-17T08:51:43.501147+0000","last_became_peered":"2024-09-17T08:51:43.501147+0000","last_unstale":"2024-09-17T08:52:36.665561+0000","last_undegraded":"2024-09-17T08:52:36.665561+0000","last_fullsized":"2024-09-17T08:52:36.665561+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:42:19.092688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779501+0000","last_change":"2024-09-17T08:51:41.462284+0000","last_active":"2024-09-17T08:52:36.779501+0000","last_peered":"2024-09-17T08:52:36.779501+0000","last_clean":"2024-09-17T08:52:36.779501+0000","last_became_active":"2024-09-17T08:51:41.460181+0000","last_became_peered":"2024-09-17T08:51:41.460181+0000","last_unstale":"2024-09-17T08:52:36.779501+0000","last_undegraded":"2024-09-17T08:52:36.779501+0000","last_fullsized":"2024-09-17T08:52:36.779501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:15.274747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668323+0000","last_change":"2024-09-17T08:51:45.494756+0000","last_active":"2024-09-17T08:52:36.668323+0000","last_peered":"2024-09-17T08:52:36.668323+0000","last_clean":"2024-09-17T08:52:36.668323+0000","last_became_active":"2024-09-17T08:51:45.493959+0000","last_became_peered":"2024-09-17T08:51:45.493959+0000","last_unstale":"2024-09-17T08:52:36.668323+0000","last_undegraded":"2024-09-17T08:52:36.668323+0000","last_fullsized":"2024-09-17T08:52:36.668323+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:21.975168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"72'5","reported_seq":178,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:31.353177+0000","last_change":"2024-09-17T08:51:55.303011+0000","last_active":"2024-09-17T08:54:31.353177+0000","last_peered":"2024-09-17T08:54:31.353177+0000","last_clean":"2024-09-17T08:54:31.353177+0000","last_became_active":"2024-09-17T08:51:45.517414+0000","last_became_peered":"2024-09-17T08:51:45.517414+0000","last_unstale":"2024-09-17T08:54:31.353177+0000","last_undegraded":"2024-09-17T08:54:31.353177+0000","last_fullsized":"2024-09-17T08:54:31.353177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:00.420583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071769999999999,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793989+0000","last_change":"2024-09-17T08:51:47.990146+0000","last_active":"2024-09-17T08:52:36.793989+0000","last_peered":"2024-09-17T08:52:36.793989+0000","last_clean":"2024-09-17T08:52:36.793989+0000","last_became_active":"2024-09-17T08:51:47.989349+0000","last_became_peered":"2024-09-17T08:51:47.989349+0000","last_unstale":"2024-09-17T08:52:36.793989+0000","last_undegraded":"2024-09-17T08:52:36.793989+0000","last_fullsized":"2024-09-17T08:52:36.793989+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:50.843883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"68'13","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669960+0000","last_change":"2024-09-17T08:51:43.491731+0000","last_active":"2024-09-17T08:52:36.669960+0000","last_peered":"2024-09-17T08:52:36.669960+0000","last_clean":"2024-09-17T08:52:36.669960+0000","last_became_active":"2024-09-17T08:51:43.490012+0000","last_became_peered":"2024-09-17T08:51:43.490012+0000","last_unstale":"2024-09-17T08:52:36.669960+0000","last_undegraded":"2024-09-17T08:52:36.669960+0000","last_fullsized":"2024-09-17T08:52:36.669960+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:29.977920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142967+0000","last_change":"2024-09-17T08:51:41.458787+0000","last_active":"2024-09-17T08:52:37.142967+0000","last_peered":"2024-09-17T08:52:37.142967+0000","last_clean":"2024-09-17T08:52:37.142967+0000","last_became_active":"2024-09-17T08:51:41.458359+0000","last_became_peered":"2024-09-17T08:51:41.458359+0000","last_unstale":"2024-09-17T08:52:37.142967+0000","last_undegraded":"2024-09-17T08:52:37.142967+0000","last_fullsized":"2024-09-17T08:52:37.142967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:41:55.223097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"68'11","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.927630+0000","last_change":"2024-09-17T08:51:45.680106+0000","last_active":"2024-09-17T08:54:24.927630+0000","last_peered":"2024-09-17T08:54:24.927630+0000","last_clean":"2024-09-17T08:54:24.927630+0000","last_became_active":"2024-09-17T08:51:45.679238+0000","last_became_peered":"2024-09-17T08:51:45.679238+0000","last_unstale":"2024-09-17T08:54:24.927630+0000","last_undegraded":"2024-09-17T08:54:24.927630+0000","last_fullsized":"2024-09-17T08:54:24.927630+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:33:40.794924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"69'1","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669242+0000","last_change":"2024-09-17T08:51:55.351163+0000","last_active":"2024-09-17T08:52:36.669242+0000","last_peered":"2024-09-17T08:52:36.669242+0000","last_clean":"2024-09-17T08:52:36.669242+0000","last_became_active":"2024-09-17T08:51:45.682795+0000","last_became_peered":"2024-09-17T08:51:45.682795+0000","last_unstale":"2024-09-17T08:52:36.669242+0000","last_undegraded":"2024-09-17T08:52:36.669242+0000","last_fullsized":"2024-09-17T08:52:36.669242+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:21.803688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078411799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669715+0000","last_change":"2024-09-17T08:51:47.733945+0000","last_active":"2024-09-17T08:52:36.669715+0000","last_peered":"2024-09-17T08:52:36.669715+0000","last_clean":"2024-09-17T08:52:36.669715+0000","last_became_active":"2024-09-17T08:51:47.733107+0000","last_became_peered":"2024-09-17T08:51:47.733107+0000","last_unstale":"2024-09-17T08:52:36.669715+0000","last_undegraded":"2024-09-17T08:52:36.669715+0000","last_fullsized":"2024-09-17T08:52:36.669715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:50:32.437663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"68'30","reported_seq":106,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.927618+0000","last_change":"2024-09-17T08:51:43.549386+0000","last_active":"2024-09-17T08:54:24.927618+0000","last_peered":"2024-09-17T08:54:24.927618+0000","last_clean":"2024-09-17T08:54:24.927618+0000","last_became_active":"2024-09-17T08:51:43.548771+0000","last_became_peered":"2024-09-17T08:51:43.548771+0000","last_unstale":"2024-09-17T08:54:24.927618+0000","last_undegraded":"2024-09-17T08:54:24.927618+0000","last_fullsized":"2024-09-17T08:54:24.927618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:13:26.469717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794599+0000","last_change":"2024-09-17T08:51:41.475949+0000","last_active":"2024-09-17T08:52:36.794599+0000","last_peered":"2024-09-17T08:52:36.794599+0000","last_clean":"2024-09-17T08:52:36.794599+0000","last_became_active":"2024-09-17T08:51:41.473499+0000","last_became_peered":"2024-09-17T08:51:41.473499+0000","last_unstale":"2024-09-17T08:52:36.794599+0000","last_undegraded":"2024-09-17T08:52:36.794599+0000","last_fullsized":"2024-09-17T08:52:36.794599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:42.667190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"68'11","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.927586+0000","last_change":"2024-09-17T08:51:45.680786+0000","last_active":"2024-09-17T08:54:24.927586+0000","last_peered":"2024-09-17T08:54:24.927586+0000","last_clean":"2024-09-17T08:54:24.927586+0000","last_became_active":"2024-09-17T08:51:45.679966+0000","last_became_peered":"2024-09-17T08:51:45.679966+0000","last_unstale":"2024-09-17T08:54:24.927586+0000","last_undegraded":"2024-09-17T08:54:24.927586+0000","last_fullsized":"2024-09-17T08:54:24.927586+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:32:23.054666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"71'2","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779024+0000","last_change":"2024-09-17T08:51:55.313222+0000","last_active":"2024-09-17T08:52:36.779024+0000","last_peered":"2024-09-17T08:52:36.779024+0000","last_clean":"2024-09-17T08:52:36.779024+0000","last_became_active":"2024-09-17T08:51:45.492846+0000","last_became_peered":"2024-09-17T08:51:45.492846+0000","last_unstale":"2024-09-17T08:52:36.779024+0000","last_undegraded":"2024-09-17T08:52:36.779024+0000","last_fullsized":"2024-09-17T08:52:36.779024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:30.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026464560000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142201+0000","last_change":"2024-09-17T08:51:47.981508+0000","last_active":"2024-09-17T08:52:37.142201+0000","last_peered":"2024-09-17T08:52:37.142201+0000","last_clean":"2024-09-17T08:52:37.142201+0000","last_became_active":"2024-09-17T08:51:47.980686+0000","last_became_peered":"2024-09-17T08:51:47.980686+0000","last_unstale":"2024-09-17T08:52:37.142201+0000","last_undegraded":"2024-09-17T08:52:37.142201+0000","last_fullsized":"2024-09-17T08:52:37.142201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:11.609319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"68'14","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858700+0000","last_change":"2024-09-17T08:51:43.550396+0000","last_active":"2024-09-17T08:52:37.858700+0000","last_peered":"2024-09-17T08:52:37.858700+0000","last_clean":"2024-09-17T08:52:37.858700+0000","last_became_active":"2024-09-17T08:51:43.550025+0000","last_became_peered":"2024-09-17T08:51:43.550025+0000","last_unstale":"2024-09-17T08:52:37.858700+0000","last_undegraded":"2024-09-17T08:52:37.858700+0000","last_fullsized":"2024-09-17T08:52:37.858700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:06.656598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142818+0000","last_change":"2024-09-17T08:51:41.466102+0000","last_active":"2024-09-17T08:52:37.142818+0000","last_peered":"2024-09-17T08:52:37.142818+0000","last_clean":"2024-09-17T08:52:37.142818+0000","last_became_active":"2024-09-17T08:51:41.465236+0000","last_became_peered":"2024-09-17T08:51:41.465236+0000","last_unstale":"2024-09-17T08:52:37.142818+0000","last_undegraded":"2024-09-17T08:52:37.142818+0000","last_fullsized":"2024-09-17T08:52:37.142818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:48.787417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142326+0000","last_change":"2024-09-17T08:51:45.507374+0000","last_active":"2024-09-17T08:52:37.142326+0000","last_peered":"2024-09-17T08:52:37.142326+0000","last_clean":"2024-09-17T08:52:37.142326+0000","last_became_active":"2024-09-17T08:51:45.505661+0000","last_became_peered":"2024-09-17T08:51:45.505661+0000","last_unstale":"2024-09-17T08:52:37.142326+0000","last_undegraded":"2024-09-17T08:52:37.142326+0000","last_fullsized":"2024-09-17T08:52:37.142326+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:18.785660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664871+0000","last_change":"2024-09-17T08:51:47.733610+0000","last_active":"2024-09-17T08:52:36.664871+0000","last_peered":"2024-09-17T08:52:36.664871+0000","last_clean":"2024-09-17T08:52:36.664871+0000","last_became_active":"2024-09-17T08:51:47.733064+0000","last_became_peered":"2024-09-17T08:51:47.733064+0000","last_unstale":"2024-09-17T08:52:36.664871+0000","last_undegraded":"2024-09-17T08:52:36.664871+0000","last_fullsized":"2024-09-17T08:52:36.664871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:16.884545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"68'19","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669263+0000","last_change":"2024-09-17T08:51:43.515100+0000","last_active":"2024-09-17T08:52:36.669263+0000","last_peered":"2024-09-17T08:52:36.669263+0000","last_clean":"2024-09-17T08:52:36.669263+0000","last_became_active":"2024-09-17T08:51:43.512871+0000","last_became_peered":"2024-09-17T08:51:43.512871+0000","last_unstale":"2024-09-17T08:52:36.669263+0000","last_undegraded":"2024-09-17T08:52:36.669263+0000","last_fullsized":"2024-09-17T08:52:36.669263+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:27.196985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857380+0000","last_change":"2024-09-17T08:51:41.476712+0000","last_active":"2024-09-17T08:52:37.857380+0000","last_peered":"2024-09-17T08:52:37.857380+0000","last_clean":"2024-09-17T08:52:37.857380+0000","last_became_active":"2024-09-17T08:51:41.471124+0000","last_became_peered":"2024-09-17T08:51:41.471124+0000","last_unstale":"2024-09-17T08:52:37.857380+0000","last_undegraded":"2024-09-17T08:52:37.857380+0000","last_fullsized":"2024-09-17T08:52:37.857380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:36.316469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142675+0000","last_change":"2024-09-17T08:51:45.512245+0000","last_active":"2024-09-17T08:52:37.142675+0000","last_peered":"2024-09-17T08:52:37.142675+0000","last_clean":"2024-09-17T08:52:37.142675+0000","last_became_active":"2024-09-17T08:51:45.511418+0000","last_became_peered":"2024-09-17T08:51:45.511418+0000","last_unstale":"2024-09-17T08:52:37.142675+0000","last_undegraded":"2024-09-17T08:52:37.142675+0000","last_fullsized":"2024-09-17T08:52:37.142675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:40.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667321+0000","last_change":"2024-09-17T08:51:47.733849+0000","last_active":"2024-09-17T08:52:36.667321+0000","last_peered":"2024-09-17T08:52:36.667321+0000","last_clean":"2024-09-17T08:52:36.667321+0000","last_became_active":"2024-09-17T08:51:47.731661+0000","last_became_peered":"2024-09-17T08:51:47.731661+0000","last_unstale":"2024-09-17T08:52:36.667321+0000","last_undegraded":"2024-09-17T08:52:36.667321+0000","last_fullsized":"2024-09-17T08:52:36.667321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:03.773723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"68'18","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142236+0000","last_change":"2024-09-17T08:51:43.553886+0000","last_active":"2024-09-17T08:52:37.142236+0000","last_peered":"2024-09-17T08:52:37.142236+0000","last_clean":"2024-09-17T08:52:37.142236+0000","last_became_active":"2024-09-17T08:51:43.553150+0000","last_became_peered":"2024-09-17T08:51:43.553150+0000","last_unstale":"2024-09-17T08:52:37.142236+0000","last_undegraded":"2024-09-17T08:52:37.142236+0000","last_fullsized":"2024-09-17T08:52:37.142236+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:53.142625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287336+0000","last_change":"2024-09-17T08:51:41.464715+0000","last_active":"2024-09-17T08:52:37.287336+0000","last_peered":"2024-09-17T08:52:37.287336+0000","last_clean":"2024-09-17T08:52:37.287336+0000","last_became_active":"2024-09-17T08:51:41.464320+0000","last_became_peered":"2024-09-17T08:51:41.464320+0000","last_unstale":"2024-09-17T08:52:37.287336+0000","last_undegraded":"2024-09-17T08:52:37.287336+0000","last_fullsized":"2024-09-17T08:52:37.287336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:45.825985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142908+0000","last_change":"2024-09-17T08:51:45.506842+0000","last_active":"2024-09-17T08:52:37.142908+0000","last_peered":"2024-09-17T08:52:37.142908+0000","last_clean":"2024-09-17T08:52:37.142908+0000","last_became_active":"2024-09-17T08:51:45.506014+0000","last_became_peered":"2024-09-17T08:51:45.506014+0000","last_unstale":"2024-09-17T08:52:37.142908+0000","last_undegraded":"2024-09-17T08:52:37.142908+0000","last_fullsized":"2024-09-17T08:52:37.142908+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:35.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794301+0000","last_change":"2024-09-17T08:51:47.984346+0000","last_active":"2024-09-17T08:52:36.794301+0000","last_peered":"2024-09-17T08:52:36.794301+0000","last_clean":"2024-09-17T08:52:36.794301+0000","last_became_active":"2024-09-17T08:51:47.982959+0000","last_became_peered":"2024-09-17T08:51:47.982959+0000","last_unstale":"2024-09-17T08:52:36.794301+0000","last_undegraded":"2024-09-17T08:52:36.794301+0000","last_fullsized":"2024-09-17T08:52:36.794301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:37.613009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"68'14","reported_seq":44,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664504+0000","last_change":"2024-09-17T08:51:43.499533+0000","last_active":"2024-09-17T08:52:36.664504+0000","last_peered":"2024-09-17T08:52:36.664504+0000","last_clean":"2024-09-17T08:52:36.664504+0000","last_became_active":"2024-09-17T08:51:43.498691+0000","last_became_peered":"2024-09-17T08:51:43.498691+0000","last_unstale":"2024-09-17T08:52:36.664504+0000","last_undegraded":"2024-09-17T08:52:36.664504+0000","last_fullsized":"2024-09-17T08:52:36.664504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:15:34.018222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793827+0000","last_change":"2024-09-17T08:51:41.475110+0000","last_active":"2024-09-17T08:52:36.793827+0000","last_peered":"2024-09-17T08:52:36.793827+0000","last_clean":"2024-09-17T08:52:36.793827+0000","last_became_active":"2024-09-17T08:51:41.473449+0000","last_became_peered":"2024-09-17T08:51:41.473449+0000","last_unstale":"2024-09-17T08:52:36.793827+0000","last_undegraded":"2024-09-17T08:52:36.793827+0000","last_fullsized":"2024-09-17T08:52:36.793827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:17:25.331624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665851+0000","last_change":"2024-09-17T08:51:45.513428+0000","last_active":"2024-09-17T08:52:36.665851+0000","last_peered":"2024-09-17T08:52:36.665851+0000","last_clean":"2024-09-17T08:52:36.665851+0000","last_became_active":"2024-09-17T08:51:45.512779+0000","last_became_peered":"2024-09-17T08:51:45.512779+0000","last_unstale":"2024-09-17T08:52:36.665851+0000","last_undegraded":"2024-09-17T08:52:36.665851+0000","last_fullsized":"2024-09-17T08:52:36.665851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:05:51.885384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142514+0000","last_change":"2024-09-17T08:51:47.728778+0000","last_active":"2024-09-17T08:52:37.142514+0000","last_peered":"2024-09-17T08:52:37.142514+0000","last_clean":"2024-09-17T08:52:37.142514+0000","last_became_active":"2024-09-17T08:51:47.727961+0000","last_became_peered":"2024-09-17T08:51:47.727961+0000","last_unstale":"2024-09-17T08:52:37.142514+0000","last_undegraded":"2024-09-17T08:52:37.142514+0000","last_fullsized":"2024-09-17T08:52:37.142514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:28.014024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"68'10","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667131+0000","last_change":"2024-09-17T08:51:43.499881+0000","last_active":"2024-09-17T08:52:36.667131+0000","last_peered":"2024-09-17T08:52:36.667131+0000","last_clean":"2024-09-17T08:52:36.667131+0000","last_became_active":"2024-09-17T08:51:43.499058+0000","last_became_peered":"2024-09-17T08:51:43.499058+0000","last_unstale":"2024-09-17T08:52:36.667131+0000","last_undegraded":"2024-09-17T08:52:36.667131+0000","last_fullsized":"2024-09-17T08:52:36.667131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:04:53.654172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857372+0000","last_change":"2024-09-17T08:51:41.477641+0000","last_active":"2024-09-17T08:52:37.857372+0000","last_peered":"2024-09-17T08:52:37.857372+0000","last_clean":"2024-09-17T08:52:37.857372+0000","last_became_active":"2024-09-17T08:51:41.477302+0000","last_became_peered":"2024-09-17T08:51:41.477302+0000","last_unstale":"2024-09-17T08:52:37.857372+0000","last_undegraded":"2024-09-17T08:52:37.857372+0000","last_fullsized":"2024-09-17T08:52:37.857372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:09:02.338251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":270,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:38.820901+0000","last_change":"2024-09-17T08:51:06.272152+0000","last_active":"2024-09-17T08:52:38.820901+0000","last_peered":"2024-09-17T08:52:38.820901+0000","last_clean":"2024-09-17T08:52:38.820901+0000","last_became_active":"2024-09-17T08:51:06.271337+0000","last_became_peered":"2024-09-17T08:51:06.271337+0000","last_unstale":"2024-09-17T08:52:38.820901+0000","last_undegraded":"2024-09-17T08:52:38.820901+0000","last_fullsized":"2024-09-17T08:52:38.820901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:46:46.894504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:46:46.894504+0000","last_clean_scrub_stamp":"2024-09-17T08:46:46.894504+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:38.006446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779409+0000","last_change":"2024-09-17T08:51:45.683825+0000","last_active":"2024-09-17T08:52:36.779409+0000","last_peered":"2024-09-17T08:52:36.779409+0000","last_clean":"2024-09-17T08:52:36.779409+0000","last_became_active":"2024-09-17T08:51:45.682959+0000","last_became_peered":"2024-09-17T08:51:45.682959+0000","last_unstale":"2024-09-17T08:52:36.779409+0000","last_undegraded":"2024-09-17T08:52:36.779409+0000","last_fullsized":"2024-09-17T08:52:36.779409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:38.999911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858729+0000","last_change":"2024-09-17T08:51:47.736773+0000","last_active":"2024-09-17T08:52:37.858729+0000","last_peered":"2024-09-17T08:52:37.858729+0000","last_clean":"2024-09-17T08:52:37.858729+0000","last_became_active":"2024-09-17T08:51:47.735788+0000","last_became_peered":"2024-09-17T08:51:47.735788+0000","last_unstale":"2024-09-17T08:52:37.858729+0000","last_undegraded":"2024-09-17T08:52:37.858729+0000","last_fullsized":"2024-09-17T08:52:37.858729+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:20.500959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"68'17","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794473+0000","last_change":"2024-09-17T08:51:43.495863+0000","last_active":"2024-09-17T08:52:36.794473+0000","last_peered":"2024-09-17T08:52:36.794473+0000","last_clean":"2024-09-17T08:52:36.794473+0000","last_became_active":"2024-09-17T08:51:43.495119+0000","last_became_peered":"2024-09-17T08:51:43.495119+0000","last_unstale":"2024-09-17T08:52:36.794473+0000","last_undegraded":"2024-09-17T08:52:36.794473+0000","last_fullsized":"2024-09-17T08:52:36.794473+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:50:27.639103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.288185+0000","last_change":"2024-09-17T08:51:41.460709+0000","last_active":"2024-09-17T08:52:37.288185+0000","last_peered":"2024-09-17T08:52:37.288185+0000","last_clean":"2024-09-17T08:52:37.288185+0000","last_became_active":"2024-09-17T08:51:41.459963+0000","last_became_peered":"2024-09-17T08:51:41.459963+0000","last_unstale":"2024-09-17T08:52:37.288185+0000","last_undegraded":"2024-09-17T08:52:37.288185+0000","last_fullsized":"2024-09-17T08:52:37.288185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:29.670817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779119+0000","last_change":"2024-09-17T08:51:45.681673+0000","last_active":"2024-09-17T08:52:36.779119+0000","last_peered":"2024-09-17T08:52:36.779119+0000","last_clean":"2024-09-17T08:52:36.779119+0000","last_became_active":"2024-09-17T08:51:45.680843+0000","last_became_peered":"2024-09-17T08:51:45.680843+0000","last_unstale":"2024-09-17T08:52:36.779119+0000","last_undegraded":"2024-09-17T08:52:36.779119+0000","last_fullsized":"2024-09-17T08:52:36.779119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:15:36.180847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793883+0000","last_change":"2024-09-17T08:51:47.741957+0000","last_active":"2024-09-17T08:52:36.793883+0000","last_peered":"2024-09-17T08:52:36.793883+0000","last_clean":"2024-09-17T08:52:36.793883+0000","last_became_active":"2024-09-17T08:51:47.740967+0000","last_became_peered":"2024-09-17T08:51:47.740967+0000","last_unstale":"2024-09-17T08:52:36.793883+0000","last_undegraded":"2024-09-17T08:52:36.793883+0000","last_fullsized":"2024-09-17T08:52:36.793883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:47.993843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"68'10","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858596+0000","last_change":"2024-09-17T08:51:43.508807+0000","last_active":"2024-09-17T08:52:37.858596+0000","last_peered":"2024-09-17T08:52:37.858596+0000","last_clean":"2024-09-17T08:52:37.858596+0000","last_became_active":"2024-09-17T08:51:43.508210+0000","last_became_peered":"2024-09-17T08:51:43.508210+0000","last_unstale":"2024-09-17T08:52:37.858596+0000","last_undegraded":"2024-09-17T08:52:37.858596+0000","last_fullsized":"2024-09-17T08:52:37.858596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:20.147032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142874+0000","last_change":"2024-09-17T08:51:41.465461+0000","last_active":"2024-09-17T08:52:37.142874+0000","last_peered":"2024-09-17T08:52:37.142874+0000","last_clean":"2024-09-17T08:52:37.142874+0000","last_became_active":"2024-09-17T08:51:41.464966+0000","last_became_peered":"2024-09-17T08:51:41.464966+0000","last_unstale":"2024-09-17T08:52:37.142874+0000","last_undegraded":"2024-09-17T08:52:37.142874+0000","last_fullsized":"2024-09-17T08:52:37.142874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:08.256328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665094+0000","last_change":"2024-09-17T08:52:29.383362+0000","last_active":"2024-09-17T08:52:36.665094+0000","last_peered":"2024-09-17T08:52:36.665094+0000","last_clean":"2024-09-17T08:52:36.665094+0000","last_became_active":"2024-09-17T08:52:29.382383+0000","last_became_peered":"2024-09-17T08:52:29.382383+0000","last_unstale":"2024-09-17T08:52:36.665094+0000","last_undegraded":"2024-09-17T08:52:36.665094+0000","last_fullsized":"2024-09-17T08:52:36.665094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:27.051704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664432+0000","last_change":"2024-09-17T08:51:47.738399+0000","last_active":"2024-09-17T08:52:36.664432+0000","last_peered":"2024-09-17T08:52:36.664432+0000","last_clean":"2024-09-17T08:52:36.664432+0000","last_became_active":"2024-09-17T08:51:47.738098+0000","last_became_peered":"2024-09-17T08:51:47.738098+0000","last_unstale":"2024-09-17T08:52:36.664432+0000","last_undegraded":"2024-09-17T08:52:36.664432+0000","last_fullsized":"2024-09-17T08:52:36.664432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:30.802738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"68'15","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794248+0000","last_change":"2024-09-17T08:51:43.495285+0000","last_active":"2024-09-17T08:52:36.794248+0000","last_peered":"2024-09-17T08:52:36.794248+0000","last_clean":"2024-09-17T08:52:36.794248+0000","last_became_active":"2024-09-17T08:51:43.494510+0000","last_became_peered":"2024-09-17T08:51:43.494510+0000","last_unstale":"2024-09-17T08:52:36.794248+0000","last_undegraded":"2024-09-17T08:52:36.794248+0000","last_fullsized":"2024-09-17T08:52:36.794248+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:08:21.823500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287683+0000","last_change":"2024-09-17T08:51:41.453533+0000","last_active":"2024-09-17T08:52:37.287683+0000","last_peered":"2024-09-17T08:52:37.287683+0000","last_clean":"2024-09-17T08:52:37.287683+0000","last_became_active":"2024-09-17T08:51:41.453163+0000","last_became_peered":"2024-09-17T08:51:41.453163+0000","last_unstale":"2024-09-17T08:52:37.287683+0000","last_undegraded":"2024-09-17T08:52:37.287683+0000","last_fullsized":"2024-09-17T08:52:37.287683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:35.627026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857940+0000","last_change":"2024-09-17T08:51:45.683717+0000","last_active":"2024-09-17T08:52:37.857940+0000","last_peered":"2024-09-17T08:52:37.857940+0000","last_clean":"2024-09-17T08:52:37.857940+0000","last_became_active":"2024-09-17T08:51:45.682956+0000","last_became_peered":"2024-09-17T08:51:45.682956+0000","last_unstale":"2024-09-17T08:52:37.857940+0000","last_undegraded":"2024-09-17T08:52:37.857940+0000","last_fullsized":"2024-09-17T08:52:37.857940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:30.184395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858038+0000","last_change":"2024-09-17T08:51:47.984794+0000","last_active":"2024-09-17T08:52:37.858038+0000","last_peered":"2024-09-17T08:52:37.858038+0000","last_clean":"2024-09-17T08:52:37.858038+0000","last_became_active":"2024-09-17T08:51:47.983978+0000","last_became_peered":"2024-09-17T08:51:47.983978+0000","last_unstale":"2024-09-17T08:52:37.858038+0000","last_undegraded":"2024-09-17T08:52:37.858038+0000","last_fullsized":"2024-09-17T08:52:37.858038+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:42.769545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"68'11","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794252+0000","last_change":"2024-09-17T08:51:43.512709+0000","last_active":"2024-09-17T08:52:36.794252+0000","last_peered":"2024-09-17T08:52:36.794252+0000","last_clean":"2024-09-17T08:52:36.794252+0000","last_became_active":"2024-09-17T08:51:43.512201+0000","last_became_peered":"2024-09-17T08:51:43.512201+0000","last_unstale":"2024-09-17T08:52:36.794252+0000","last_undegraded":"2024-09-17T08:52:36.794252+0000","last_fullsized":"2024-09-17T08:52:36.794252+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:24.156161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.671775+0000","last_change":"2024-09-17T08:51:41.475371+0000","last_active":"2024-09-17T08:52:36.671775+0000","last_peered":"2024-09-17T08:52:36.671775+0000","last_clean":"2024-09-17T08:52:36.671775+0000","last_became_active":"2024-09-17T08:51:41.471873+0000","last_became_peered":"2024-09-17T08:51:41.471873+0000","last_unstale":"2024-09-17T08:52:36.671775+0000","last_undegraded":"2024-09-17T08:52:36.671775+0000","last_fullsized":"2024-09-17T08:52:36.671775+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:51:52.249149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"68'11","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.930092+0000","last_change":"2024-09-17T08:51:45.513118+0000","last_active":"2024-09-17T08:54:24.930092+0000","last_peered":"2024-09-17T08:54:24.930092+0000","last_clean":"2024-09-17T08:54:24.930092+0000","last_became_active":"2024-09-17T08:51:45.511337+0000","last_became_peered":"2024-09-17T08:51:45.511337+0000","last_unstale":"2024-09-17T08:54:24.930092+0000","last_undegraded":"2024-09-17T08:54:24.930092+0000","last_fullsized":"2024-09-17T08:54:24.930092+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:08.907390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667879+0000","last_change":"2024-09-17T08:51:47.743755+0000","last_active":"2024-09-17T08:52:36.667879+0000","last_peered":"2024-09-17T08:52:36.667879+0000","last_clean":"2024-09-17T08:52:36.667879+0000","last_became_active":"2024-09-17T08:51:47.742954+0000","last_became_peered":"2024-09-17T08:51:47.742954+0000","last_unstale":"2024-09-17T08:52:36.667879+0000","last_undegraded":"2024-09-17T08:52:36.667879+0000","last_fullsized":"2024-09-17T08:52:36.667879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:20.860187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"68'11","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793918+0000","last_change":"2024-09-17T08:51:43.497863+0000","last_active":"2024-09-17T08:52:36.793918+0000","last_peered":"2024-09-17T08:52:36.793918+0000","last_clean":"2024-09-17T08:52:36.793918+0000","last_became_active":"2024-09-17T08:51:43.497031+0000","last_became_peered":"2024-09-17T08:51:43.497031+0000","last_unstale":"2024-09-17T08:52:36.793918+0000","last_undegraded":"2024-09-17T08:52:36.793918+0000","last_fullsized":"2024-09-17T08:52:36.793918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:23.410508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287017+0000","last_change":"2024-09-17T08:51:41.466663+0000","last_active":"2024-09-17T08:52:37.287017+0000","last_peered":"2024-09-17T08:52:37.287017+0000","last_clean":"2024-09-17T08:52:37.287017+0000","last_became_active":"2024-09-17T08:51:41.465737+0000","last_became_peered":"2024-09-17T08:51:41.465737+0000","last_unstale":"2024-09-17T08:52:37.287017+0000","last_undegraded":"2024-09-17T08:52:37.287017+0000","last_fullsized":"2024-09-17T08:52:37.287017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:44.782326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665343+0000","last_change":"2024-09-17T08:51:45.680458+0000","last_active":"2024-09-17T08:52:36.665343+0000","last_peered":"2024-09-17T08:52:36.665343+0000","last_clean":"2024-09-17T08:52:36.665343+0000","last_became_active":"2024-09-17T08:51:45.679541+0000","last_became_peered":"2024-09-17T08:51:45.679541+0000","last_unstale":"2024-09-17T08:52:36.665343+0000","last_undegraded":"2024-09-17T08:52:36.665343+0000","last_fullsized":"2024-09-17T08:52:36.665343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:07.717330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287279+0000","last_change":"2024-09-17T08:51:47.735494+0000","last_active":"2024-09-17T08:52:37.287279+0000","last_peered":"2024-09-17T08:52:37.287279+0000","last_clean":"2024-09-17T08:52:37.287279+0000","last_became_active":"2024-09-17T08:51:47.730694+0000","last_became_peered":"2024-09-17T08:51:47.730694+0000","last_unstale":"2024-09-17T08:52:37.287279+0000","last_undegraded":"2024-09-17T08:52:37.287279+0000","last_fullsized":"2024-09-17T08:52:37.287279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:32.636147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"68'4","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.778950+0000","last_change":"2024-09-17T08:51:43.504714+0000","last_active":"2024-09-17T08:52:36.778950+0000","last_peered":"2024-09-17T08:52:36.778950+0000","last_clean":"2024-09-17T08:52:36.778950+0000","last_became_active":"2024-09-17T08:51:43.504021+0000","last_became_peered":"2024-09-17T08:51:43.504021+0000","last_unstale":"2024-09-17T08:52:36.778950+0000","last_undegraded":"2024-09-17T08:52:36.778950+0000","last_fullsized":"2024-09-17T08:52:36.778950+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:37.939933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779136+0000","last_change":"2024-09-17T08:51:41.475443+0000","last_active":"2024-09-17T08:52:36.779136+0000","last_peered":"2024-09-17T08:52:36.779136+0000","last_clean":"2024-09-17T08:52:36.779136+0000","last_became_active":"2024-09-17T08:51:41.474504+0000","last_became_peered":"2024-09-17T08:51:41.474504+0000","last_unstale":"2024-09-17T08:52:36.779136+0000","last_undegraded":"2024-09-17T08:52:36.779136+0000","last_fullsized":"2024-09-17T08:52:36.779136+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:33.589212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669566+0000","last_change":"2024-09-17T08:51:45.681108+0000","last_active":"2024-09-17T08:52:36.669566+0000","last_peered":"2024-09-17T08:52:36.669566+0000","last_clean":"2024-09-17T08:52:36.669566+0000","last_became_active":"2024-09-17T08:51:45.680365+0000","last_became_peered":"2024-09-17T08:51:45.680365+0000","last_unstale":"2024-09-17T08:52:36.669566+0000","last_undegraded":"2024-09-17T08:52:36.669566+0000","last_fullsized":"2024-09-17T08:52:36.669566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:56.783439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794184+0000","last_change":"2024-09-17T08:51:47.983655+0000","last_active":"2024-09-17T08:52:36.794184+0000","last_peered":"2024-09-17T08:52:36.794184+0000","last_clean":"2024-09-17T08:52:36.794184+0000","last_became_active":"2024-09-17T08:51:47.982851+0000","last_became_peered":"2024-09-17T08:51:47.982851+0000","last_unstale":"2024-09-17T08:52:36.794184+0000","last_undegraded":"2024-09-17T08:52:36.794184+0000","last_fullsized":"2024-09-17T08:52:36.794184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:17:06.912741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"68'11","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794238+0000","last_change":"2024-09-17T08:51:43.549616+0000","last_active":"2024-09-17T08:52:36.794238+0000","last_peered":"2024-09-17T08:52:36.794238+0000","last_clean":"2024-09-17T08:52:36.794238+0000","last_became_active":"2024-09-17T08:51:43.549240+0000","last_became_peered":"2024-09-17T08:51:43.549240+0000","last_unstale":"2024-09-17T08:52:36.794238+0000","last_undegraded":"2024-09-17T08:52:36.794238+0000","last_fullsized":"2024-09-17T08:52:36.794238+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:05.472148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857586+0000","last_change":"2024-09-17T08:51:41.478108+0000","last_active":"2024-09-17T08:52:37.857586+0000","last_peered":"2024-09-17T08:52:37.857586+0000","last_clean":"2024-09-17T08:52:37.857586+0000","last_became_active":"2024-09-17T08:51:41.477708+0000","last_became_peered":"2024-09-17T08:51:41.477708+0000","last_unstale":"2024-09-17T08:52:37.857586+0000","last_undegraded":"2024-09-17T08:52:37.857586+0000","last_fullsized":"2024-09-17T08:52:37.857586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:22.111341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"68'11","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.927822+0000","last_change":"2024-09-17T08:51:45.682012+0000","last_active":"2024-09-17T08:54:24.927822+0000","last_peered":"2024-09-17T08:54:24.927822+0000","last_clean":"2024-09-17T08:54:24.927822+0000","last_became_active":"2024-09-17T08:51:45.681153+0000","last_became_peered":"2024-09-17T08:51:45.681153+0000","last_unstale":"2024-09-17T08:54:24.927822+0000","last_undegraded":"2024-09-17T08:54:24.927822+0000","last_fullsized":"2024-09-17T08:54:24.927822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:26:39.558311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664923+0000","last_change":"2024-09-17T08:51:47.739542+0000","last_active":"2024-09-17T08:52:36.664923+0000","last_peered":"2024-09-17T08:52:36.664923+0000","last_clean":"2024-09-17T08:52:36.664923+0000","last_became_active":"2024-09-17T08:51:47.739062+0000","last_became_peered":"2024-09-17T08:51:47.739062+0000","last_unstale":"2024-09-17T08:52:36.664923+0000","last_undegraded":"2024-09-17T08:52:36.664923+0000","last_fullsized":"2024-09-17T08:52:36.664923+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:42.830439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664680+0000","last_change":"2024-09-17T08:51:43.489540+0000","last_active":"2024-09-17T08:52:36.664680+0000","last_peered":"2024-09-17T08:52:36.664680+0000","last_clean":"2024-09-17T08:52:36.664680+0000","last_became_active":"2024-09-17T08:51:43.488736+0000","last_became_peered":"2024-09-17T08:51:43.488736+0000","last_unstale":"2024-09-17T08:52:36.664680+0000","last_undegraded":"2024-09-17T08:52:36.664680+0000","last_fullsized":"2024-09-17T08:52:36.664680+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:33:09.298937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665872+0000","last_change":"2024-09-17T08:51:41.471084+0000","last_active":"2024-09-17T08:52:36.665872+0000","last_peered":"2024-09-17T08:52:36.665872+0000","last_clean":"2024-09-17T08:52:36.665872+0000","last_became_active":"2024-09-17T08:51:41.470670+0000","last_became_peered":"2024-09-17T08:51:41.470670+0000","last_unstale":"2024-09-17T08:52:36.665872+0000","last_undegraded":"2024-09-17T08:52:36.665872+0000","last_fullsized":"2024-09-17T08:52:36.665872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:11:37.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"68'11","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.929999+0000","last_change":"2024-09-17T08:51:45.683631+0000","last_active":"2024-09-17T08:54:24.929999+0000","last_peered":"2024-09-17T08:54:24.929999+0000","last_clean":"2024-09-17T08:54:24.929999+0000","last_became_active":"2024-09-17T08:51:45.682809+0000","last_became_peered":"2024-09-17T08:51:45.682809+0000","last_unstale":"2024-09-17T08:54:24.929999+0000","last_undegraded":"2024-09-17T08:54:24.929999+0000","last_fullsized":"2024-09-17T08:54:24.929999+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:17:55.648881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.671121+0000","last_change":"2024-09-17T08:51:47.735286+0000","last_active":"2024-09-17T08:52:36.671121+0000","last_peered":"2024-09-17T08:52:36.671121+0000","last_clean":"2024-09-17T08:52:36.671121+0000","last_became_active":"2024-09-17T08:51:47.734485+0000","last_became_peered":"2024-09-17T08:51:47.734485+0000","last_unstale":"2024-09-17T08:52:36.671121+0000","last_undegraded":"2024-09-17T08:52:36.671121+0000","last_fullsized":"2024-09-17T08:52:36.671121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:50:11.726884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"68'9","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794419+0000","last_change":"2024-09-17T08:51:43.492848+0000","last_active":"2024-09-17T08:52:36.794419+0000","last_peered":"2024-09-17T08:52:36.794419+0000","last_clean":"2024-09-17T08:52:36.794419+0000","last_became_active":"2024-09-17T08:51:43.491743+0000","last_became_peered":"2024-09-17T08:51:43.491743+0000","last_unstale":"2024-09-17T08:52:36.794419+0000","last_undegraded":"2024-09-17T08:52:36.794419+0000","last_fullsized":"2024-09-17T08:52:36.794419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:09.065057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779286+0000","last_change":"2024-09-17T08:51:41.468453+0000","last_active":"2024-09-17T08:52:36.779286+0000","last_peered":"2024-09-17T08:52:36.779286+0000","last_clean":"2024-09-17T08:52:36.779286+0000","last_became_active":"2024-09-17T08:51:41.467620+0000","last_became_peered":"2024-09-17T08:51:41.467620+0000","last_unstale":"2024-09-17T08:52:36.779286+0000","last_undegraded":"2024-09-17T08:52:36.779286+0000","last_fullsized":"2024-09-17T08:52:36.779286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:15.487970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142478+0000","last_change":"2024-09-17T08:51:45.509060+0000","last_active":"2024-09-17T08:52:37.142478+0000","last_peered":"2024-09-17T08:52:37.142478+0000","last_clean":"2024-09-17T08:52:37.142478+0000","last_became_active":"2024-09-17T08:51:45.506497+0000","last_became_peered":"2024-09-17T08:51:45.506497+0000","last_unstale":"2024-09-17T08:52:37.142478+0000","last_undegraded":"2024-09-17T08:52:37.142478+0000","last_fullsized":"2024-09-17T08:52:37.142478+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:14.288644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.664488+0000","last_change":"2024-09-17T08:51:47.727280+0000","last_active":"2024-09-17T08:52:36.664488+0000","last_peered":"2024-09-17T08:52:36.664488+0000","last_clean":"2024-09-17T08:52:36.664488+0000","last_became_active":"2024-09-17T08:51:47.726844+0000","last_became_peered":"2024-09-17T08:51:47.726844+0000","last_unstale":"2024-09-17T08:52:36.664488+0000","last_undegraded":"2024-09-17T08:52:36.664488+0000","last_fullsized":"2024-09-17T08:52:36.664488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:32.625973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"68'10","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668935+0000","last_change":"2024-09-17T08:51:43.507840+0000","last_active":"2024-09-17T08:52:36.668935+0000","last_peered":"2024-09-17T08:52:36.668935+0000","last_clean":"2024-09-17T08:52:36.668935+0000","last_became_active":"2024-09-17T08:51:43.507216+0000","last_became_peered":"2024-09-17T08:51:43.507216+0000","last_unstale":"2024-09-17T08:52:36.668935+0000","last_undegraded":"2024-09-17T08:52:36.668935+0000","last_fullsized":"2024-09-17T08:52:36.668935+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:52.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142791+0000","last_change":"2024-09-17T08:51:41.467622+0000","last_active":"2024-09-17T08:52:37.142791+0000","last_peered":"2024-09-17T08:52:37.142791+0000","last_clean":"2024-09-17T08:52:37.142791+0000","last_became_active":"2024-09-17T08:51:41.467213+0000","last_became_peered":"2024-09-17T08:51:41.467213+0000","last_unstale":"2024-09-17T08:52:37.142791+0000","last_undegraded":"2024-09-17T08:52:37.142791+0000","last_fullsized":"2024-09-17T08:52:37.142791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:21.221750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668574+0000","last_change":"2024-09-17T08:51:45.498543+0000","last_active":"2024-09-17T08:52:36.668574+0000","last_peered":"2024-09-17T08:52:36.668574+0000","last_clean":"2024-09-17T08:52:36.668574+0000","last_became_active":"2024-09-17T08:51:45.497676+0000","last_became_peered":"2024-09-17T08:51:45.497676+0000","last_unstale":"2024-09-17T08:52:36.668574+0000","last_undegraded":"2024-09-17T08:52:36.668574+0000","last_fullsized":"2024-09-17T08:52:36.668574+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:25.839862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"68'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667128+0000","last_change":"2024-09-17T08:51:47.733844+0000","last_active":"2024-09-17T08:52:36.667128+0000","last_peered":"2024-09-17T08:52:36.667128+0000","last_clean":"2024-09-17T08:52:36.667128+0000","last_became_active":"2024-09-17T08:51:47.732818+0000","last_became_peered":"2024-09-17T08:51:47.732818+0000","last_unstale":"2024-09-17T08:52:36.667128+0000","last_undegraded":"2024-09-17T08:52:36.667128+0000","last_fullsized":"2024-09-17T08:52:36.667128+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:26.109316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"68'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666214+0000","last_change":"2024-09-17T08:51:43.486087+0000","last_active":"2024-09-17T08:52:36.666214+0000","last_peered":"2024-09-17T08:52:36.666214+0000","last_clean":"2024-09-17T08:52:36.666214+0000","last_became_active":"2024-09-17T08:51:43.485267+0000","last_became_peered":"2024-09-17T08:51:43.485267+0000","last_unstale":"2024-09-17T08:52:36.666214+0000","last_undegraded":"2024-09-17T08:52:36.666214+0000","last_fullsized":"2024-09-17T08:52:36.666214+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:44.819169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"61'1","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857535+0000","last_change":"2024-09-17T08:51:41.467913+0000","last_active":"2024-09-17T08:52:37.857535+0000","last_peered":"2024-09-17T08:52:37.857535+0000","last_clean":"2024-09-17T08:52:37.857535+0000","last_became_active":"2024-09-17T08:51:41.467483+0000","last_became_peered":"2024-09-17T08:51:41.467483+0000","last_unstale":"2024-09-17T08:52:37.857535+0000","last_undegraded":"2024-09-17T08:52:37.857535+0000","last_fullsized":"2024-09-17T08:52:37.857535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:44.169242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666661+0000","last_change":"2024-09-17T08:51:45.515333+0000","last_active":"2024-09-17T08:52:36.666661+0000","last_peered":"2024-09-17T08:52:36.666661+0000","last_clean":"2024-09-17T08:52:36.666661+0000","last_became_active":"2024-09-17T08:51:45.514419+0000","last_became_peered":"2024-09-17T08:51:45.514419+0000","last_unstale":"2024-09-17T08:52:36.666661+0000","last_undegraded":"2024-09-17T08:52:36.666661+0000","last_fullsized":"2024-09-17T08:52:36.666661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:51:10.226319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.793787+0000","last_change":"2024-09-17T08:51:47.739700+0000","last_active":"2024-09-17T08:52:36.793787+0000","last_peered":"2024-09-17T08:52:36.793787+0000","last_clean":"2024-09-17T08:52:36.793787+0000","last_became_active":"2024-09-17T08:51:47.738852+0000","last_became_peered":"2024-09-17T08:51:47.738852+0000","last_unstale":"2024-09-17T08:52:36.793787+0000","last_undegraded":"2024-09-17T08:52:36.793787+0000","last_fullsized":"2024-09-17T08:52:36.793787+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:05.639685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.858521+0000","last_change":"2024-09-17T08:51:43.501464+0000","last_active":"2024-09-17T08:52:37.858521+0000","last_peered":"2024-09-17T08:52:37.858521+0000","last_clean":"2024-09-17T08:52:37.858521+0000","last_became_active":"2024-09-17T08:51:43.500719+0000","last_became_peered":"2024-09-17T08:51:43.500719+0000","last_unstale":"2024-09-17T08:52:37.858521+0000","last_undegraded":"2024-09-17T08:52:37.858521+0000","last_fullsized":"2024-09-17T08:52:37.858521+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:18.363321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779411+0000","last_change":"2024-09-17T08:51:41.469768+0000","last_active":"2024-09-17T08:52:36.779411+0000","last_peered":"2024-09-17T08:52:36.779411+0000","last_clean":"2024-09-17T08:52:36.779411+0000","last_became_active":"2024-09-17T08:51:41.467529+0000","last_became_peered":"2024-09-17T08:51:41.467529+0000","last_unstale":"2024-09-17T08:52:36.779411+0000","last_undegraded":"2024-09-17T08:52:36.779411+0000","last_fullsized":"2024-09-17T08:52:36.779411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:22.804155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667333+0000","last_change":"2024-09-17T08:51:45.681134+0000","last_active":"2024-09-17T08:52:36.667333+0000","last_peered":"2024-09-17T08:52:36.667333+0000","last_clean":"2024-09-17T08:52:36.667333+0000","last_became_active":"2024-09-17T08:51:45.680316+0000","last_became_peered":"2024-09-17T08:51:45.680316+0000","last_unstale":"2024-09-17T08:52:36.667333+0000","last_undegraded":"2024-09-17T08:52:36.667333+0000","last_fullsized":"2024-09-17T08:52:36.667333+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:55.168951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.667995+0000","last_change":"2024-09-17T08:51:47.982494+0000","last_active":"2024-09-17T08:52:36.667995+0000","last_peered":"2024-09-17T08:52:36.667995+0000","last_clean":"2024-09-17T08:52:36.667995+0000","last_became_active":"2024-09-17T08:51:47.981663+0000","last_became_peered":"2024-09-17T08:51:47.981663+0000","last_unstale":"2024-09-17T08:52:36.667995+0000","last_undegraded":"2024-09-17T08:52:36.667995+0000","last_fullsized":"2024-09-17T08:52:36.667995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:40.585079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.794227+0000","last_change":"2024-09-17T08:51:47.742840+0000","last_active":"2024-09-17T08:52:36.794227+0000","last_peered":"2024-09-17T08:52:36.794227+0000","last_clean":"2024-09-17T08:52:36.794227+0000","last_became_active":"2024-09-17T08:51:47.741662+0000","last_became_peered":"2024-09-17T08:51:47.741662+0000","last_unstale":"2024-09-17T08:52:36.794227+0000","last_undegraded":"2024-09-17T08:52:36.794227+0000","last_fullsized":"2024-09-17T08:52:36.794227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:29.484553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"68'15","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142292+0000","last_change":"2024-09-17T08:51:43.508101+0000","last_active":"2024-09-17T08:52:37.142292+0000","last_peered":"2024-09-17T08:52:37.142292+0000","last_clean":"2024-09-17T08:52:37.142292+0000","last_became_active":"2024-09-17T08:51:43.507327+0000","last_became_peered":"2024-09-17T08:51:43.507327+0000","last_unstale":"2024-09-17T08:52:37.142292+0000","last_undegraded":"2024-09-17T08:52:37.142292+0000","last_fullsized":"2024-09-17T08:52:37.142292+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:06.204957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.857378+0000","last_change":"2024-09-17T08:51:41.479661+0000","last_active":"2024-09-17T08:52:37.857378+0000","last_peered":"2024-09-17T08:52:37.857378+0000","last_clean":"2024-09-17T08:52:37.857378+0000","last_became_active":"2024-09-17T08:51:41.479263+0000","last_became_peered":"2024-09-17T08:51:41.479263+0000","last_unstale":"2024-09-17T08:52:37.857378+0000","last_undegraded":"2024-09-17T08:52:37.857378+0000","last_fullsized":"2024-09-17T08:52:37.857378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.427321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665144+0000","last_change":"2024-09-17T08:51:45.682043+0000","last_active":"2024-09-17T08:52:36.665144+0000","last_peered":"2024-09-17T08:52:36.665144+0000","last_clean":"2024-09-17T08:52:36.665144+0000","last_became_active":"2024-09-17T08:51:45.681300+0000","last_became_peered":"2024-09-17T08:51:45.681300+0000","last_unstale":"2024-09-17T08:52:36.665144+0000","last_undegraded":"2024-09-17T08:52:36.665144+0000","last_fullsized":"2024-09-17T08:52:36.665144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:22.793072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.142671+0000","last_change":"2024-09-17T08:51:47.737760+0000","last_active":"2024-09-17T08:52:37.142671+0000","last_peered":"2024-09-17T08:52:37.142671+0000","last_clean":"2024-09-17T08:52:37.142671+0000","last_became_active":"2024-09-17T08:51:47.733320+0000","last_became_peered":"2024-09-17T08:51:47.733320+0000","last_unstale":"2024-09-17T08:52:37.142671+0000","last_undegraded":"2024-09-17T08:52:37.142671+0000","last_fullsized":"2024-09-17T08:52:37.142671+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:35.362937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"68'9","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.666786+0000","last_change":"2024-09-17T08:51:43.492096+0000","last_active":"2024-09-17T08:52:36.666786+0000","last_peered":"2024-09-17T08:52:36.666786+0000","last_clean":"2024-09-17T08:52:36.666786+0000","last_became_active":"2024-09-17T08:51:43.488798+0000","last_became_peered":"2024-09-17T08:51:43.488798+0000","last_unstale":"2024-09-17T08:52:36.666786+0000","last_undegraded":"2024-09-17T08:52:36.666786+0000","last_fullsized":"2024-09-17T08:52:36.666786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:31.898518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668409+0000","last_change":"2024-09-17T08:51:41.458638+0000","last_active":"2024-09-17T08:52:36.668409+0000","last_peered":"2024-09-17T08:52:36.668409+0000","last_clean":"2024-09-17T08:52:36.668409+0000","last_became_active":"2024-09-17T08:51:41.458286+0000","last_became_peered":"2024-09-17T08:51:41.458286+0000","last_unstale":"2024-09-17T08:52:36.668409+0000","last_undegraded":"2024-09-17T08:52:36.668409+0000","last_fullsized":"2024-09-17T08:52:36.668409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:22.668997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"74'12","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:54:24.930065+0000","last_change":"2024-09-17T08:52:29.259855+0000","last_active":"2024-09-17T08:54:24.930065+0000","last_peered":"2024-09-17T08:54:24.930065+0000","last_clean":"2024-09-17T08:54:24.930065+0000","last_became_active":"2024-09-17T08:52:29.254211+0000","last_became_peered":"2024-09-17T08:52:29.254211+0000","last_unstale":"2024-09-17T08:54:24.930065+0000","last_undegraded":"2024-09-17T08:54:24.930065+0000","last_fullsized":"2024-09-17T08:54:24.930065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:50:32.450583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669648+0000","last_change":"2024-09-17T08:51:47.983418+0000","last_active":"2024-09-17T08:52:36.669648+0000","last_peered":"2024-09-17T08:52:36.669648+0000","last_clean":"2024-09-17T08:52:36.669648+0000","last_became_active":"2024-09-17T08:51:47.982631+0000","last_became_peered":"2024-09-17T08:51:47.982631+0000","last_unstale":"2024-09-17T08:52:36.669648+0000","last_undegraded":"2024-09-17T08:52:36.669648+0000","last_fullsized":"2024-09-17T08:52:36.669648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:30.125138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.779528+0000","last_change":"2024-09-17T08:51:41.473436+0000","last_active":"2024-09-17T08:52:36.779528+0000","last_peered":"2024-09-17T08:52:36.779528+0000","last_clean":"2024-09-17T08:52:36.779528+0000","last_became_active":"2024-09-17T08:51:41.472679+0000","last_became_peered":"2024-09-17T08:51:41.472679+0000","last_unstale":"2024-09-17T08:52:36.779528+0000","last_undegraded":"2024-09-17T08:52:36.779528+0000","last_fullsized":"2024-09-17T08:52:36.779528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:33.490354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"68'5","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.665835+0000","last_change":"2024-09-17T08:51:43.500334+0000","last_active":"2024-09-17T08:52:36.665835+0000","last_peered":"2024-09-17T08:52:36.665835+0000","last_clean":"2024-09-17T08:52:36.665835+0000","last_became_active":"2024-09-17T08:51:43.499220+0000","last_became_peered":"2024-09-17T08:51:43.499220+0000","last_unstale":"2024-09-17T08:52:36.665835+0000","last_undegraded":"2024-09-17T08:52:36.665835+0000","last_fullsized":"2024-09-17T08:52:36.665835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:58.286939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:37.287759+0000","last_change":"2024-09-17T08:51:45.520070+0000","last_active":"2024-09-17T08:52:37.287759+0000","last_peered":"2024-09-17T08:52:37.287759+0000","last_clean":"2024-09-17T08:52:37.287759+0000","last_became_active":"2024-09-17T08:51:45.519503+0000","last_became_peered":"2024-09-17T08:51:45.519503+0000","last_unstale":"2024-09-17T08:52:37.287759+0000","last_undegraded":"2024-09-17T08:52:37.287759+0000","last_fullsized":"2024-09-17T08:52:37.287759+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:37.958874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.669222+0000","last_change":"2024-09-17T08:51:47.982743+0000","last_active":"2024-09-17T08:52:36.669222+0000","last_peered":"2024-09-17T08:52:36.669222+0000","last_clean":"2024-09-17T08:52:36.669222+0000","last_became_active":"2024-09-17T08:51:47.981865+0000","last_became_peered":"2024-09-17T08:51:47.981865+0000","last_unstale":"2024-09-17T08:52:36.669222+0000","last_undegraded":"2024-09-17T08:52:36.669222+0000","last_fullsized":"2024-09-17T08:52:36.669222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:46.697285+0000","last_clean_scrub_stamp":"2024-09-17T08:51:46.697285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:44.260817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668241+0000","last_change":"2024-09-17T08:51:41.462808+0000","last_active":"2024-09-17T08:52:36.668241+0000","last_peered":"2024-09-17T08:52:36.668241+0000","last_clean":"2024-09-17T08:52:36.668241+0000","last_became_active":"2024-09-17T08:51:41.462369+0000","last_became_peered":"2024-09-17T08:51:41.462369+0000","last_unstale":"2024-09-17T08:52:36.668241+0000","last_undegraded":"2024-09-17T08:52:36.668241+0000","last_fullsized":"2024-09-17T08:52:36.668241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:40.422707+0000","last_clean_scrub_stamp":"2024-09-17T08:51:40.422707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:54.094167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"68'9","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.670328+0000","last_change":"2024-09-17T08:51:43.552054+0000","last_active":"2024-09-17T08:52:36.670328+0000","last_peered":"2024-09-17T08:52:36.670328+0000","last_clean":"2024-09-17T08:52:36.670328+0000","last_became_active":"2024-09-17T08:51:43.551713+0000","last_became_peered":"2024-09-17T08:51:43.551713+0000","last_unstale":"2024-09-17T08:52:36.670328+0000","last_undegraded":"2024-09-17T08:52:36.670328+0000","last_fullsized":"2024-09-17T08:52:36.670328+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:42.451339+0000","last_clean_scrub_stamp":"2024-09-17T08:51:42.451339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:58.676966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T08:52:36.668020+0000","last_change":"2024-09-17T08:52:29.381735+0000","last_active":"2024-09-17T08:52:36.668020+0000","last_peered":"2024-09-17T08:52:36.668020+0000","last_clean":"2024-09-17T08:52:36.668020+0000","last_became_active":"2024-09-17T08:52:29.380953+0000","last_became_peered":"2024-09-17T08:52:29.380953+0000","last_unstale":"2024-09-17T08:52:36.668020+0000","last_undegraded":"2024-09-17T08:52:36.668020+0000","last_fullsized":"2024-09-17T08:52:36.668020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T08:51:44.465024+0000","last_clean_scrub_stamp":"2024-09-17T08:51:44.465024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:24.953773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1386,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201324,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32528,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712624,"statfs":{"total":95995035648,"available":95961726976,"internally_reserved":0,"allocated":1449984,"data_stored":947190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88600000000000001,"15min":0.88},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.258,"5min":2.726,"15min":2.726},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.92800000000000005,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.286,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0029999999999999}]},{"osd":1,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.96399999999999997},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2649999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96999999999999997,"15min":0.99299999999999999},"min":{"1min":0.70099999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2849999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90100000000000002,"15min":0.92300000000000004},"min":{"1min":0.56599999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.75},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.67900000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.198,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.286}]},{"osd":3,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93400000000000005,"15min":0.94799999999999995},"min":{"1min":0.71899999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.196,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0229999999999999,"15min":1.0509999999999999},"min":{"1min":0.61099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.379,"5min":2.79,"15min":2.79},"last":1.163}]},{"osd":4,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.89000000000000001,"15min":0.90100000000000002},"min":{"1min":0.66700000000000004,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3500000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.93799999999999994,"15min":0.95999999999999996},"min":{"1min":0.66600000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.4139999999999999,"5min":1.456,"15min":1.456},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.628,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.484,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97899999999999998,"15min":0.98499999999999999},"min":{"1min":0.71199999999999997,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.647,"15min":1.647},"last":1.2250000000000001}]},{"osd":6,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0469999999999999,"15min":1.0569999999999999},"min":{"1min":0.83599999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.51,"5min":1.875,"15min":1.875},"last":1.123},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.008,"15min":1.0489999999999999},"min":{"1min":0.79900000000000004,"5min":0.312,"15min":0.312},"max":{"1min":1.298,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0820000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462967,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1417216,"data_stored":945471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.84199999999999997,"15min":0.86099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2250000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.073},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.873,"15min":0.89100000000000001},"min":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1399999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86299999999999999}]},{"osd":1,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86199999999999999,"15min":0.84999999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0209999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.54200000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.204,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.878,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94999999999999996,"15min":0.93400000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2170000000000001,"5min":1.234,"15min":1.234},"last":0.97299999999999998}]},{"osd":3,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.115,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.036},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.92000000000000004,"15min":0.90700000000000003},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2509999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0049999999999999}]},{"osd":4,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.84599999999999997,"15min":0.81399999999999995},"min":{"1min":0.42299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1930000000000001,"5min":1.256,"15min":1.256},"last":0.746},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.88900000000000001,"15min":0.84099999999999997},"min":{"1min":0.42199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.327,"5min":1.391,"15min":1.391},"last":0.60699999999999998}]},{"osd":5,"last update":"Tue Sep 17 08:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.87,"15min":0.84099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1930000000000001,"5min":1.349,"15min":1.349},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.97999999999999998,"15min":0.93999999999999995},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.2749999999999999,"5min":1.472,"15min":1.472},"last":1.1180000000000001}]},{"osd":7,"last update":"Tue Sep 17 08:54:09 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.046,"15min":1.0820000000000001},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.097},{"interface":"front","average":{"1min":1.123,"5min":1.099,"15min":1.119},"min":{"1min":0.46100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.27}]}]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":843776,"data_stored":356704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.88400000000000001,"15min":0.85599999999999998},"min":{"1min":0.52800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1539999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89900000000000002,"15min":0.872},"min":{"1min":0.67600000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.105,"5min":1.429,"15min":1.429},"last":0.91900000000000004}]},{"osd":1,"last update":"Tue Sep 17 08:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88700000000000001,"15min":0.84699999999999998},"min":{"1min":0.61599999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.363,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.91200000000000003,"15min":0.89800000000000002},"min":{"1min":0.61899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.1000000000000001,"5min":1.28,"15min":1.28},"last":1.0309999999999999}]},{"osd":2,"last update":"Tue Sep 17 08:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.88700000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.91500000000000004,"15min":0.89100000000000001},"min":{"1min":0.65400000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.556,"15min":1.556},"last":0.97999999999999998}]},{"osd":3,"last update":"Tue Sep 17 08:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.90900000000000003,"15min":0.88900000000000001},"min":{"1min":0.64000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.153,"5min":1.268,"15min":1.268},"last":1.002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98299999999999998,"15min":0.95199999999999996},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1779999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.0549999999999999}]},{"osd":4,"last update":"Tue Sep 17 08:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84199999999999997,"15min":0.77500000000000002},"min":{"1min":0.48699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.131},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.85699999999999998,"15min":0.77500000000000002},"min":{"1min":0.61299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.282,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Tue Sep 17 08:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.61499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1899999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.65100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.2509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.109}]},{"osd":7,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0489999999999999,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0229999999999999,"15min":1.0129999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.085}]}]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":860160,"data_stored":356025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.871,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.254,"5min":1.45,"15min":1.45},"last":1.103},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.88300000000000001,"15min":0.83999999999999997},"min":{"1min":0.61199999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2789999999999999,"5min":1.333,"15min":1.333},"last":1.0569999999999999}]},{"osd":1,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84699999999999998,"15min":0.81799999999999995},"min":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.21,"5min":1.357,"15min":1.357},"last":0.751},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.92100000000000004,"15min":0.85799999999999998},"min":{"1min":0.61299999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.415,"5min":1.488,"15min":1.488},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88500000000000001,"15min":0.82699999999999996},"min":{"1min":0.52900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.165,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.194},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.85299999999999998,"15min":0.82199999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.304,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Tue Sep 17 08:53:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89500000000000002,"15min":0.85099999999999998},"min":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.379,"5min":1.49,"15min":1.49},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.284,"5min":1.371,"15min":1.371},"last":1.014}]},{"osd":5,"last update":"Tue Sep 17 08:54:26 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.73599999999999999},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2370000000000001,"5min":1.361,"15min":1.361},"last":1.129},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92400000000000004,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.244,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.2629999999999999}]},{"osd":6,"last update":"Tue Sep 17 08:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.79000000000000004},"min":{"1min":0.45100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.131,"5min":1.296,"15min":1.296},"last":0.628},{"interface":"front","average":{"1min":0.995,"5min":1.0009999999999999,"15min":0.97099999999999997},"min":{"1min":0.40600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.2749999999999999,"5min":1.466,"15min":1.466},"last":0.93400000000000005}]},{"osd":7,"last update":"Tue Sep 17 08:54:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0609999999999999,"15min":1.0580000000000001},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97299999999999998,"15min":0.97099999999999997},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.89100000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149782,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31924,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713228,"statfs":{"total":95995035648,"available":95962345472,"internally_reserved":0,"allocated":827392,"data_stored":355383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36599999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.69699999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45100000000000001},"max":{"1min":1.073,"5min":1.534,"15min":1.534},"last":0.84199999999999997}]},{"osd":1,"last update":"Tue Sep 17 08:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":0.94899999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77500000000000002,"15min":0.73299999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.34599999999999997},"max":{"1min":1.198,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.61499999999999999}]},{"osd":2,"last update":"Tue Sep 17 08:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84699999999999998,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":1.821,"15min":1.821},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77800000000000002,"15min":0.74099999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40500000000000003},"max":{"1min":0.97399999999999998,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Tue Sep 17 08:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.94499999999999995,"15min":0.873},"min":{"1min":0.67900000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.22,"5min":1.778,"15min":1.778},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97799999999999998,"15min":0.93300000000000005},"min":{"1min":0.79900000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.236,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.109}]},{"osd":5,"last update":"Tue Sep 17 08:54:32 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.006,"15min":0.95399999999999996},"min":{"1min":0.78000000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":0.96599999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5740000000000001,"5min":1.712,"15min":1.712},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Sep 17 08:54:17 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.095,"15min":1.1100000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.641,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.028},{"interface":"front","average":{"1min":1.107,"5min":1.123,"15min":1.1120000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.6040000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0760000000000001}]},{"osd":7,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.694,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.149},{"interface":"front","average":{"1min":1.01,"5min":1.083,"15min":1.105},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.28,"5min":1.631,"15min":1.631},"last":1.2370000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31936,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713216,"statfs":{"total":95995035648,"available":95962333184,"internally_reserved":0,"allocated":839680,"data_stored":356782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65400000000000003,"15min":0.56999999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27200000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73399999999999999,"15min":0.63300000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.226,"5min":1.252,"15min":1.252},"last":0.623}]},{"osd":1,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69699999999999995,"15min":0.63200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":1.0329999999999999,"5min":1.843,"15min":1.843},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77600000000000002,"15min":0.66600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":1.0289999999999999,"5min":1.486,"15min":1.486},"last":0.69099999999999995}]},{"osd":3,"last update":"Tue Sep 17 08:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.83299999999999996,"15min":0.78900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.145,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.80600000000000005,"15min":0.76600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2030000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.88500000000000001}]},{"osd":4,"last update":"Tue Sep 17 08:53:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94299999999999995,"15min":0.89900000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88900000000000001,"15min":0.85899999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4019999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81499999999999995}]},{"osd":5,"last update":"Tue Sep 17 08:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.97899999999999998,"15min":0.93799999999999994},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2549999999999999,"5min":1.464,"15min":1.464},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.97799999999999998,"15min":0.96699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.27,"5min":1.516,"15min":1.516},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Sep 17 08:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1879999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.008},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0600000000000001,"15min":1.073},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.232,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.95999999999999996}]},{"osd":7,"last update":"Tue Sep 17 08:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.113,"15min":1.147},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.369,"5min":1.631,"15min":1.631},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.127,"15min":1.157},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3069999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":355159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 08:54:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.58999999999999997},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.27400000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.874},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76200000000000001,"15min":0.61099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.1200000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Sep 17 08:53:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71799999999999997,"15min":0.60699999999999998},"min":{"1min":0.442,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Tue Sep 17 08:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.72599999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.83899999999999997,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.755}]},{"osd":4,"last update":"Tue Sep 17 08:53:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.96099999999999997,"15min":0.91400000000000003},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.89800000000000002,"15min":0.85699999999999998},"min":{"1min":0.62,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Sep 17 08:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93600000000000005,"15min":0.92100000000000004},"min":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.016},{"interface":"front","average":{"1min":1.034,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.63900000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.2270000000000001}]},{"osd":6,"last update":"Tue Sep 17 08:54:17 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.96199999999999997,"15min":0.93400000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.085,"15min":1.0880000000000001},"min":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.1439999999999999}]},{"osd":7,"last update":"Tue Sep 17 08:54:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0840000000000001,"15min":1.079},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.65900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.042}]}]},{"osd":0,"up_from":8,"seq":34359738485,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1437696,"data_stored":945649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 08:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":1.141,"5min":1.752,"15min":1.752},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.1419999999999999,"5min":1.27,"15min":1.27},"last":0.38700000000000001}]},{"osd":2,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.64300000000000002},"min":{"1min":0.38300000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.91000000000000003,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79500000000000004,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.228,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Tue Sep 17 08:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82899999999999996,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.119,"5min":1.804,"15min":1.804},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.78200000000000003},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.256,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.437}]},{"osd":4,"last update":"Tue Sep 17 08:53:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93899999999999995,"15min":0.92700000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.242,"5min":1.329,"15min":1.329},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.95899999999999996,"15min":0.89400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.147,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":0.78300000000000003}]},{"osd":5,"last update":"Tue Sep 17 08:53:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.008,"15min":1.016},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.202,"5min":3.347,"15min":3.347},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.97799999999999998,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.244,"5min":5.1539999999999999,"15min":5.1539999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Sep 17 08:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.0429999999999999,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.339,"5min":4.9210000000000003,"15min":4.9210000000000003},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.054,"5min":1.105,"15min":1.101},"min":{"1min":0.60299999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":3.605,"15min":3.605},"last":0.81699999999999995}]},{"osd":7,"last update":"Tue Sep 17 08:54:07 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.163,"15min":1.2270000000000001},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.369,"5min":4.2199999999999998,"15min":4.2199999999999998},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.1890000000000001,"15min":1.2609999999999999},"min":{"1min":0.71199999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.216,"5min":5.0110000000000001,"15min":5.0110000000000001},"last":0.85899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T08:54:36.334 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T08:54:36.334 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T08:54:36.334 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T08:54:36.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T08:54:37.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:36 smithi136 bash[24812]: audit 2024-09-17T08:54:35.719531+0000 mgr.y (mgr.14532) 109 : audit [DBG] from='client.24614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:54:37.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:36 smithi078 bash[22670]: audit 2024-09-17T08:54:35.719531+0000 mgr.y (mgr.14532) 109 : audit [DBG] from='client.24614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:54:37.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:36 smithi078 bash[32124]: audit 2024-09-17T08:54:35.719531+0000 mgr.y (mgr.14532) 109 : audit [DBG] from='client.24614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T08:54:38.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:37 smithi136 bash[24812]: cluster 2024-09-17T08:54:36.738053+0000 mgr.y (mgr.14532) 110 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:38.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:37 smithi136 bash[24812]: audit 2024-09-17T08:54:36.987262+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:54:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:54:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:37 smithi078 bash[22670]: cluster 2024-09-17T08:54:36.738053+0000 mgr.y (mgr.14532) 110 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:37 smithi078 bash[22670]: audit 2024-09-17T08:54:36.987262+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:38.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:37 smithi078 bash[32124]: cluster 2024-09-17T08:54:36.738053+0000 mgr.y (mgr.14532) 110 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:37 smithi078 bash[32124]: audit 2024-09-17T08:54:36.987262+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:39.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:54:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:54:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:39 smithi136 bash[24812]: cluster 2024-09-17T08:54:38.739516+0000 mgr.y (mgr.14532) 111 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:39 smithi078 bash[22670]: cluster 2024-09-17T08:54:38.739516+0000 mgr.y (mgr.14532) 111 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:39 smithi078 bash[32124]: cluster 2024-09-17T08:54:38.739516+0000 mgr.y (mgr.14532) 111 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T08:54:41.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:40 smithi078 bash[32124]: audit 2024-09-17T08:54:39.204840+0000 mgr.y (mgr.14532) 112 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:41.167 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:40 smithi078 bash[22670]: audit 2024-09-17T08:54:39.204840+0000 mgr.y (mgr.14532) 112 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:41.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:40 smithi136 bash[24812]: audit 2024-09-17T08:54:39.204840+0000 mgr.y (mgr.14532) 112 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:42.124 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:41 smithi078 bash[32124]: cluster 2024-09-17T08:54:40.740224+0000 mgr.y (mgr.14532) 113 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:42.125 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:41 smithi078 bash[22670]: cluster 2024-09-17T08:54:40.740224+0000 mgr.y (mgr.14532) 113 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:42.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:41 smithi136 bash[24812]: cluster 2024-09-17T08:54:40.740224+0000 mgr.y (mgr.14532) 113 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:43.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.762+0000 7f1a4869a640 1 -- 172.21.15.78:0/1210618181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40104180 msgr2=0x7f1a40104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.762+0000 7f1a4869a640 1 --2- 172.21.15.78:0/1210618181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40104180 0x7f1a40104610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009ca0 tx=0x7f1a3802a940 comp rx=0 tx=0).stop 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- 172.21.15.78:0/1210618181 shutdown_connections 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 --2- 172.21.15.78:0/1210618181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40104180 0x7f1a40104610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 --2- 172.21.15.78:0/1210618181 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 0x7f1a40103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 --2- 172.21.15.78:0/1210618181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a400fed70 0x7f1a400ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- 172.21.15.78:0/1210618181 >> 172.21.15.78:0/1210618181 conn(0x7f1a400fa9a0 msgr2=0x7f1a400fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- 172.21.15.78:0/1210618181 shutdown_connections 2024-09-17T08:54:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- 172.21.15.78:0/1210618181 wait complete. 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 Processor -- start 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- start start 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a400fed70 0x7f1a4019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 0x7f1a4019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a40104180 0x7f1a4019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4019fb60 con 0x7f1a400fed70 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4019fcd0 con 0x7f1a40104180 2024-09-17T08:54:43.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4019fe90 con 0x7f1a400ff690 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 0x7f1a4019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 0x7f1a4019c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:53602/0 (socket says 172.21.15.78:53602) 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 -- 172.21.15.78:0/902872568 learned_addr learned my addr 172.21.15.78:0/902872568 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a46436640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a400fed70 0x7f1a4019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a46c37640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a40104180 0x7f1a4019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 -- 172.21.15.78:0/902872568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a40104180 msgr2=0x7f1a4019f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a40104180 0x7f1a4019f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 -- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a400fed70 msgr2=0x7f1a4019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a400fed70 0x7f1a4019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 -- 172.21.15.78:0/902872568 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a38009900 con 0x7f1a400ff690 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a45c35640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 0x7f1a4019c210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400e9f0 tx=0x7f1a3400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:43.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a337fe640 1 -- 172.21.15.78:0/902872568 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400cab0 con 0x7f1a400ff690 2024-09-17T08:54:43.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a337fe640 1 -- 172.21.15.78:0/902872568 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1a34005470 con 0x7f1a400ff690 2024-09-17T08:54:43.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a401a0170 con 0x7f1a400ff690 2024-09-17T08:54:43.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a337fe640 1 -- 172.21.15.78:0/902872568 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004c10 con 0x7f1a400ff690 2024-09-17T08:54:43.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a401a8ac0 con 0x7f1a400ff690 2024-09-17T08:54:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.766+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a40069030 con 0x7f1a400ff690 2024-09-17T08:54:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.770+0000 7f1a337fe640 1 -- 172.21.15.78:0/902872568 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f1a34004e70 con 0x7f1a400ff690 2024-09-17T08:54:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.770+0000 7f1a337fe640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a2c06cec0 0x7f1a2c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T08:54:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.770+0000 7f1a337fe640 1 -- 172.21.15.78:0/902872568 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f1a34014070 con 0x7f1a400ff690 2024-09-17T08:54:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.770+0000 7f1a46436640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a2c06cec0 0x7f1a2c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T08:54:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.770+0000 7f1a46436640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a2c06cec0 0x7f1a2c06f380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00abe0 tx=0x7f1a3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T08:54:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.774+0000 7f1a337fe640 1 -- 172.21.15.78:0/902872568 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1a34056b50 con 0x7f1a400ff690 2024-09-17T08:54:43.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.978+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1a4019cff0 con 0x7f1a400ff690 2024-09-17T08:54:43.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.978+0000 7f1a337fe640 1 -- 172.21.15.78:0/902872568 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1a34005120 con 0x7f1a400ff690 2024-09-17T08:54:43.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T08:54:43.979 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T08:54:43.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a2c06cec0 msgr2=0x7f1a2c06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:43.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a2c06cec0 0x7f1a2c06f380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00abe0 tx=0x7f1a3c00a2d0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 msgr2=0x7f1a4019c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 0x7f1a4019c210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400e9f0 tx=0x7f1a3400edf0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 shutdown_connections 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f1a2c06cec0 0x7f1a2c06f380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a40104180 0x7f1a4019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a400ff690 0x7f1a4019c210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 --2- 172.21.15.78:0/902872568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a400fed70 0x7f1a4019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 >> 172.21.15.78:0/902872568 conn(0x7f1a400fa9a0 msgr2=0x7f1a400fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 shutdown_connections 2024-09-17T08:54:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T08:54:43.982+0000 7f1a4869a640 1 -- 172.21.15.78:0/902872568 wait complete. 2024-09-17T08:54:43.991 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:43 smithi078 bash[32124]: cluster 2024-09-17T08:54:42.740909+0000 mgr.y (mgr.14532) 114 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:43.991 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:43 smithi078 bash[22670]: cluster 2024-09-17T08:54:42.740909+0000 mgr.y (mgr.14532) 114 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:44.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:43 smithi136 bash[24812]: cluster 2024-09-17T08:54:42.740909+0000 mgr.y (mgr.14532) 114 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:44.552 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T08:54:44.552 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T08:54:44.553 INFO:teuthology.run_tasks:Running task workunit... 2024-09-17T08:54:44.568 INFO:tasks.workunit:Pulling workunits from ref 1cbdc9211df088cccbd94423c7cf3a2b85fe432b 2024-09-17T08:54:44.568 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T08:54:44.569 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T08:54:44.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T08:54:44.575 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-17T08:54:44.575 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-17T08:54:44.623 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-17T08:54:44.624 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-17T08:54:44.672 INFO:tasks.workunit:timeout=3h 2024-09-17T08:54:44.672 INFO:tasks.workunit:cleanup=True 2024-09-17T08:54:44.673 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cbdc9211df088cccbd94423c7cf3a2b85fe432b 2024-09-17T08:54:44.722 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T08:54:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:44 smithi136 bash[24812]: audit 2024-09-17T08:54:43.982113+0000 mon.c (mon.2) 30 : audit [DBG] from='client.? 172.21.15.78:0/902872568' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T08:54:45.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:44 smithi078 bash[32124]: audit 2024-09-17T08:54:43.982113+0000 mon.c (mon.2) 30 : audit [DBG] from='client.? 172.21.15.78:0/902872568' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T08:54:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:44 smithi078 bash[22670]: audit 2024-09-17T08:54:43.982113+0000 mon.c (mon.2) 30 : audit [DBG] from='client.? 172.21.15.78:0/902872568' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T08:54:46.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:45 smithi136 bash[24812]: cluster 2024-09-17T08:54:44.741752+0000 mgr.y (mgr.14532) 115 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:45 smithi078 bash[22670]: cluster 2024-09-17T08:54:44.741752+0000 mgr.y (mgr.14532) 115 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:46.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:45 smithi078 bash[32124]: cluster 2024-09-17T08:54:44.741752+0000 mgr.y (mgr.14532) 115 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:47 smithi136 bash[24812]: cluster 2024-09-17T08:54:46.742390+0000 mgr.y (mgr.14532) 116 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:47 smithi078 bash[22670]: cluster 2024-09-17T08:54:46.742390+0000 mgr.y (mgr.14532) 116 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:48.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:54:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:54:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:47 smithi078 bash[32124]: cluster 2024-09-17T08:54:46.742390+0000 mgr.y (mgr.14532) 116 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:49.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:54:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:54:50.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:49 smithi136 bash[24812]: cluster 2024-09-17T08:54:48.743764+0000 mgr.y (mgr.14532) 117 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:50.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:49 smithi078 bash[22670]: cluster 2024-09-17T08:54:48.743764+0000 mgr.y (mgr.14532) 117 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:50.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:49 smithi078 bash[32124]: cluster 2024-09-17T08:54:48.743764+0000 mgr.y (mgr.14532) 117 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:51.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:50 smithi136 bash[24812]: audit 2024-09-17T08:54:49.216273+0000 mgr.y (mgr.14532) 118 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:51.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:50 smithi078 bash[22670]: audit 2024-09-17T08:54:49.216273+0000 mgr.y (mgr.14532) 118 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:51.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:50 smithi078 bash[32124]: audit 2024-09-17T08:54:49.216273+0000 mgr.y (mgr.14532) 118 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:54:52.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:51 smithi136 bash[24812]: cluster 2024-09-17T08:54:50.744474+0000 mgr.y (mgr.14532) 119 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:52.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:51 smithi078 bash[22670]: cluster 2024-09-17T08:54:50.744474+0000 mgr.y (mgr.14532) 119 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:52.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:51 smithi078 bash[32124]: cluster 2024-09-17T08:54:50.744474+0000 mgr.y (mgr.14532) 119 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:53.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:52 smithi136 bash[24812]: audit 2024-09-17T08:54:52.013625+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:53.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:52 smithi078 bash[22670]: audit 2024-09-17T08:54:52.013625+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:53.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:52 smithi078 bash[32124]: audit 2024-09-17T08:54:52.013625+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:54:54.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:53 smithi136 bash[24812]: cluster 2024-09-17T08:54:52.745114+0000 mgr.y (mgr.14532) 120 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:54.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:53 smithi078 bash[32124]: cluster 2024-09-17T08:54:52.745114+0000 mgr.y (mgr.14532) 120 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:54.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:53 smithi078 bash[22670]: cluster 2024-09-17T08:54:52.745114+0000 mgr.y (mgr.14532) 120 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:56.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:55 smithi136 bash[24812]: cluster 2024-09-17T08:54:54.746488+0000 mgr.y (mgr.14532) 121 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:55 smithi078 bash[32124]: cluster 2024-09-17T08:54:54.746488+0000 mgr.y (mgr.14532) 121 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:55 smithi078 bash[22670]: cluster 2024-09-17T08:54:54.746488+0000 mgr.y (mgr.14532) 121 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:54:58.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:57 smithi136 bash[24812]: cluster 2024-09-17T08:54:56.747193+0000 mgr.y (mgr.14532) 122 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:58.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:57 smithi078 bash[22670]: cluster 2024-09-17T08:54:56.747193+0000 mgr.y (mgr.14532) 122 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:57 smithi078 bash[32124]: cluster 2024-09-17T08:54:56.747193+0000 mgr.y (mgr.14532) 122 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:54:58.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:54:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:54:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:54:59.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:54:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:55:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:54:59 smithi136 bash[24812]: cluster 2024-09-17T08:54:58.748613+0000 mgr.y (mgr.14532) 123 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:54:59 smithi078 bash[32124]: cluster 2024-09-17T08:54:58.748613+0000 mgr.y (mgr.14532) 123 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:00.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:54:59 smithi078 bash[22670]: cluster 2024-09-17T08:54:58.748613+0000 mgr.y (mgr.14532) 123 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:01.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:00 smithi136 bash[24812]: audit 2024-09-17T08:54:59.227710+0000 mgr.y (mgr.14532) 124 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:00 smithi078 bash[32124]: audit 2024-09-17T08:54:59.227710+0000 mgr.y (mgr.14532) 124 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:01.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:00 smithi078 bash[22670]: audit 2024-09-17T08:54:59.227710+0000 mgr.y (mgr.14532) 124 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:02.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:00.749284+0000 mgr.y (mgr.14532) 125 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:02.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:00.749284+0000 mgr.y (mgr.14532) 125 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:00.749284+0000 mgr.y (mgr.14532) 125 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:04.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:03 smithi136 bash[24812]: cluster 2024-09-17T08:55:02.749848+0000 mgr.y (mgr.14532) 126 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:04.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:03 smithi078 bash[32124]: cluster 2024-09-17T08:55:02.749848+0000 mgr.y (mgr.14532) 126 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:04.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:03 smithi078 bash[22670]: cluster 2024-09-17T08:55:02.749848+0000 mgr.y (mgr.14532) 126 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:05 smithi136 bash[24812]: cluster 2024-09-17T08:55:04.751454+0000 mgr.y (mgr.14532) 127 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:05 smithi078 bash[32124]: cluster 2024-09-17T08:55:04.751454+0000 mgr.y (mgr.14532) 127 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:05 smithi078 bash[22670]: cluster 2024-09-17T08:55:04.751454+0000 mgr.y (mgr.14532) 127 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:07 smithi136 bash[24812]: cluster 2024-09-17T08:55:06.751904+0000 mgr.y (mgr.14532) 128 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:08.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:07 smithi136 bash[24812]: audit 2024-09-17T08:55:07.040445+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:08.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:07 smithi078 bash[32124]: cluster 2024-09-17T08:55:06.751904+0000 mgr.y (mgr.14532) 128 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:08.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:07 smithi078 bash[32124]: audit 2024-09-17T08:55:07.040445+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:08.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:55:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:55:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:55:08.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:07 smithi078 bash[22670]: cluster 2024-09-17T08:55:06.751904+0000 mgr.y (mgr.14532) 128 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:08.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:07 smithi078 bash[22670]: audit 2024-09-17T08:55:07.040445+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:09.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:55:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:55:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:09 smithi136 bash[24812]: cluster 2024-09-17T08:55:08.753255+0000 mgr.y (mgr.14532) 129 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:10.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:09 smithi078 bash[32124]: cluster 2024-09-17T08:55:08.753255+0000 mgr.y (mgr.14532) 129 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:10.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:09 smithi078 bash[22670]: cluster 2024-09-17T08:55:08.753255+0000 mgr.y (mgr.14532) 129 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:10 smithi136 bash[24812]: audit 2024-09-17T08:55:09.238949+0000 mgr.y (mgr.14532) 130 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:11.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:10 smithi078 bash[22670]: audit 2024-09-17T08:55:09.238949+0000 mgr.y (mgr.14532) 130 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:10 smithi078 bash[32124]: audit 2024-09-17T08:55:09.238949+0000 mgr.y (mgr.14532) 130 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:11 smithi136 bash[24812]: cluster 2024-09-17T08:55:10.754037+0000 mgr.y (mgr.14532) 131 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:12.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:11 smithi078 bash[32124]: cluster 2024-09-17T08:55:10.754037+0000 mgr.y (mgr.14532) 131 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:11 smithi078 bash[22670]: cluster 2024-09-17T08:55:10.754037+0000 mgr.y (mgr.14532) 131 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:14.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:13 smithi136 bash[24812]: cluster 2024-09-17T08:55:12.754801+0000 mgr.y (mgr.14532) 132 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:14.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:13 smithi078 bash[32124]: cluster 2024-09-17T08:55:12.754801+0000 mgr.y (mgr.14532) 132 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:13 smithi078 bash[22670]: cluster 2024-09-17T08:55:12.754801+0000 mgr.y (mgr.14532) 132 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:16.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:15 smithi136 bash[24812]: cluster 2024-09-17T08:55:14.756259+0000 mgr.y (mgr.14532) 133 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:16.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:15 smithi078 bash[22670]: cluster 2024-09-17T08:55:14.756259+0000 mgr.y (mgr.14532) 133 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:15 smithi078 bash[32124]: cluster 2024-09-17T08:55:14.756259+0000 mgr.y (mgr.14532) 133 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:18.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:17 smithi136 bash[24812]: cluster 2024-09-17T08:55:16.756725+0000 mgr.y (mgr.14532) 134 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:18.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:17 smithi136 bash[24812]: audit 2024-09-17T08:55:17.608190+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:55:18.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:55:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:55:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:55:18.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:17 smithi078 bash[32124]: cluster 2024-09-17T08:55:16.756725+0000 mgr.y (mgr.14532) 134 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:18.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:17 smithi078 bash[32124]: audit 2024-09-17T08:55:17.608190+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:55:18.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:17 smithi078 bash[22670]: cluster 2024-09-17T08:55:16.756725+0000 mgr.y (mgr.14532) 134 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:18.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:17 smithi078 bash[22670]: audit 2024-09-17T08:55:17.608190+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:55:19.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:55:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:55:19.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:19 smithi136 bash[24812]: audit 2024-09-17T08:55:18.150921+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:55:19.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:19 smithi136 bash[24812]: audit 2024-09-17T08:55:18.151732+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:55:19.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:19 smithi136 bash[24812]: audit 2024-09-17T08:55:18.159482+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:55:19.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:18 smithi078 bash[32124]: audit 2024-09-17T08:55:18.150921+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:55:19.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:18 smithi078 bash[32124]: audit 2024-09-17T08:55:18.151732+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:55:19.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:18 smithi078 bash[32124]: audit 2024-09-17T08:55:18.159482+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:55:19.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:18 smithi078 bash[22670]: audit 2024-09-17T08:55:18.150921+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:55:19.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:18 smithi078 bash[22670]: audit 2024-09-17T08:55:18.151732+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:55:19.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:18 smithi078 bash[22670]: audit 2024-09-17T08:55:18.159482+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:55:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:20 smithi136 bash[24812]: cluster 2024-09-17T08:55:18.757479+0000 mgr.y (mgr.14532) 135 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:20.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:19 smithi078 bash[32124]: cluster 2024-09-17T08:55:18.757479+0000 mgr.y (mgr.14532) 135 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:19 smithi078 bash[22670]: cluster 2024-09-17T08:55:18.757479+0000 mgr.y (mgr.14532) 135 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:21 smithi136 bash[24812]: audit 2024-09-17T08:55:19.243717+0000 mgr.y (mgr.14532) 136 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:21.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:21 smithi078 bash[32124]: audit 2024-09-17T08:55:19.243717+0000 mgr.y (mgr.14532) 136 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:21 smithi078 bash[22670]: audit 2024-09-17T08:55:19.243717+0000 mgr.y (mgr.14532) 136 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:22 smithi136 bash[24812]: cluster 2024-09-17T08:55:20.757871+0000 mgr.y (mgr.14532) 137 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:22.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:22 smithi078 bash[32124]: cluster 2024-09-17T08:55:20.757871+0000 mgr.y (mgr.14532) 137 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:22.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:22 smithi078 bash[22670]: cluster 2024-09-17T08:55:20.757871+0000 mgr.y (mgr.14532) 137 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:23.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:23 smithi136 bash[24812]: audit 2024-09-17T08:55:22.064472+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:23.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:23 smithi078 bash[32124]: audit 2024-09-17T08:55:22.064472+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:23 smithi078 bash[22670]: audit 2024-09-17T08:55:22.064472+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:24.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:24 smithi136 bash[24812]: cluster 2024-09-17T08:55:22.758327+0000 mgr.y (mgr.14532) 138 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:24.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:24 smithi078 bash[32124]: cluster 2024-09-17T08:55:22.758327+0000 mgr.y (mgr.14532) 138 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:24 smithi078 bash[22670]: cluster 2024-09-17T08:55:22.758327+0000 mgr.y (mgr.14532) 138 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:26.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:26 smithi136 bash[24812]: cluster 2024-09-17T08:55:24.759044+0000 mgr.y (mgr.14532) 139 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:26 smithi078 bash[32124]: cluster 2024-09-17T08:55:24.759044+0000 mgr.y (mgr.14532) 139 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:26 smithi078 bash[22670]: cluster 2024-09-17T08:55:24.759044+0000 mgr.y (mgr.14532) 139 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:28.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:28 smithi136 bash[24812]: cluster 2024-09-17T08:55:26.759461+0000 mgr.y (mgr.14532) 140 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:28.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:55:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:55:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:55:28.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:28 smithi078 bash[32124]: cluster 2024-09-17T08:55:26.759461+0000 mgr.y (mgr.14532) 140 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:28.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:28 smithi078 bash[22670]: cluster 2024-09-17T08:55:26.759461+0000 mgr.y (mgr.14532) 140 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:29.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:55:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:55:30.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:30 smithi136 bash[24812]: cluster 2024-09-17T08:55:28.760233+0000 mgr.y (mgr.14532) 141 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:30.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:30 smithi078 bash[32124]: cluster 2024-09-17T08:55:28.760233+0000 mgr.y (mgr.14532) 141 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:30.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:30 smithi078 bash[22670]: cluster 2024-09-17T08:55:28.760233+0000 mgr.y (mgr.14532) 141 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:31 smithi136 bash[24812]: audit 2024-09-17T08:55:29.252857+0000 mgr.y (mgr.14532) 142 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:31.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:31 smithi078 bash[32124]: audit 2024-09-17T08:55:29.252857+0000 mgr.y (mgr.14532) 142 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:31.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:31 smithi078 bash[22670]: audit 2024-09-17T08:55:29.252857+0000 mgr.y (mgr.14532) 142 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:32.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:32 smithi136 bash[24812]: cluster 2024-09-17T08:55:30.760658+0000 mgr.y (mgr.14532) 143 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:32.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:32 smithi078 bash[32124]: cluster 2024-09-17T08:55:30.760658+0000 mgr.y (mgr.14532) 143 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:32.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:32 smithi078 bash[22670]: cluster 2024-09-17T08:55:30.760658+0000 mgr.y (mgr.14532) 143 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:33.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:33 smithi078 bash[32124]: cluster 2024-09-17T08:55:32.761153+0000 mgr.y (mgr.14532) 144 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:33.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:33 smithi078 bash[22670]: cluster 2024-09-17T08:55:32.761153+0000 mgr.y (mgr.14532) 144 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:33.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:33 smithi136 bash[24812]: cluster 2024-09-17T08:55:32.761153+0000 mgr.y (mgr.14532) 144 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:35 smithi078 bash[22670]: cluster 2024-09-17T08:55:34.761825+0000 mgr.y (mgr.14532) 145 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:36.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:35 smithi078 bash[32124]: cluster 2024-09-17T08:55:34.761825+0000 mgr.y (mgr.14532) 145 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:36.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:35 smithi136 bash[24812]: cluster 2024-09-17T08:55:34.761825+0000 mgr.y (mgr.14532) 145 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:38.002 INFO:tasks.workunit.client.0.smithi078.stderr:Updating files: 97% (12619/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T08:55:38.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:55:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:55:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:55:38.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:37 smithi078 bash[32124]: cluster 2024-09-17T08:55:36.762441+0000 mgr.y (mgr.14532) 146 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:38.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:37 smithi078 bash[32124]: audit 2024-09-17T08:55:37.079754+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:37 smithi078 bash[22670]: cluster 2024-09-17T08:55:36.762441+0000 mgr.y (mgr.14532) 146 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:37 smithi078 bash[22670]: audit 2024-09-17T08:55:37.079754+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:38.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:37 smithi136 bash[24812]: cluster 2024-09-17T08:55:36.762441+0000 mgr.y (mgr.14532) 146 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T08:55:38.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:37 smithi136 bash[24812]: audit 2024-09-17T08:55:37.079754+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:38.509 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '1cbdc9211df088cccbd94423c7cf3a2b85fe432b'. 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-17T08:55:38.510 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-17T08:55:38.511 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-17T08:55:38.511 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-17T08:55:38.511 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-17T08:55:38.511 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-17T08:55:38.511 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T08:55:38.511 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-17T08:55:38.511 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 1cbdc9211df Merge pull request #56819 from cbodley/wip-65410-reef 2024-09-17T08:55:38.519 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T08:55:38.569 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T08:55:38.573 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T08:55:38.573 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T08:55:39.332 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T08:55:39.426 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T08:55:39.476 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T08:55:39.478 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T08:55:39.478 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T08:55:39.525 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T08:55:39.529 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T08:55:39.529 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T08:55:39.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:55:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:55:39.576 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-17T08:55:39.577 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-17T08:55:39.577 DEBUG:teuthology.orchestra.run.smithi078:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cbdc9211df088cccbd94423c7cf3a2b85fe432b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-09-17T08:55:39.629 INFO:tasks.workunit.client.0.smithi078.stderr:+ parallel=1 2024-09-17T08:55:39.630 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '' = --serial ']' 2024-09-17T08:55:39.630 INFO:tasks.workunit.client.0.smithi078.stderr:+ color= 2024-09-17T08:55:39.630 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -t 1 ']' 2024-09-17T08:55:39.630 INFO:tasks.workunit.client.0.smithi078.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-17T08:55:39.630 INFO:tasks.workunit.client.0.smithi078.stderr:+ declare -A pids 2024-09-17T08:55:39.630 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.631 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.631 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_aio 2024-09-17T08:55:39.631 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_aio' 2024-09-17T08:55:39.631 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_aio 2024-09-17T08:55:39.631 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.633 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_aio 2024-09-17T08:55:39.633 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64675 2024-09-17T08:55:39.633 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_aio on pid 64675' 2024-09-17T08:55:39.633 INFO:tasks.workunit.client.0.smithi078.stdout:test api_aio on pid 64675 2024-09-17T08:55:39.634 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64675 2024-09-17T08:55:39.634 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_aio_pp 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_aio_pp' 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_aio_pp 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_aio 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_aio.log 2024-09-17T08:55:39.636 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_aio: /' 2024-09-17T08:55:39.637 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_aio_pp 2024-09-17T08:55:39.637 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64683 2024-09-17T08:55:39.637 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_aio_pp on pid 64683' 2024-09-17T08:55:39.637 INFO:tasks.workunit.client.0.smithi078.stdout:test api_aio_pp on pid 64683 2024-09-17T08:55:39.638 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64683 2024-09-17T08:55:39.638 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_io 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_io' 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_io 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_aio_pp 2024-09-17T08:55:39.639 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-09-17T08:55:39.640 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_aio_pp: /' 2024-09-17T08:55:39.640 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_io 2024-09-17T08:55:39.640 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64691 2024-09-17T08:55:39.641 INFO:tasks.workunit.client.0.smithi078.stdout:test api_io on pid 64691 2024-09-17T08:55:39.642 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_io on pid 64691' 2024-09-17T08:55:39.642 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-09-17T08:55:39.642 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64691 2024-09-17T08:55:39.642 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.642 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_io_pp 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_io_pp' 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_io_pp 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_io 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_io.log 2024-09-17T08:55:39.643 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_io: /' 2024-09-17T08:55:39.644 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_io_pp 2024-09-17T08:55:39.645 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64699 2024-09-17T08:55:39.645 INFO:tasks.workunit.client.0.smithi078.stdout:test api_io_pp on pid 64699 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_io_pp on pid 64699' 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64699 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_asio 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_asio' 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_asio 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.646 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.647 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.647 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.647 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.647 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_io_pp 2024-09-17T08:55:39.647 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-09-17T08:55:39.647 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_io_pp: /' 2024-09-17T08:55:39.649 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_asio 2024-09-17T08:55:39.649 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64707 2024-09-17T08:55:39.649 INFO:tasks.workunit.client.0.smithi078.stdout:test api_asio on pid 64707 2024-09-17T08:55:39.649 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_asio on pid 64707' 2024-09-17T08:55:39.650 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64707 2024-09-17T08:55:39.650 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.650 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.650 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-09-17T08:55:39.650 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_list 2024-09-17T08:55:39.650 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_list' 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_list 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_asio 2024-09-17T08:55:39.651 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_asio.log 2024-09-17T08:55:39.652 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_asio: /' 2024-09-17T08:55:39.652 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_list 2024-09-17T08:55:39.653 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64715 2024-09-17T08:55:39.653 INFO:tasks.workunit.client.0.smithi078.stdout:test api_list on pid 64715 2024-09-17T08:55:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_list on pid 64715' 2024-09-17T08:55:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64715 2024-09-17T08:55:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-09-17T08:55:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_lock 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_lock' 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_lock 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_list 2024-09-17T08:55:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_list.log 2024-09-17T08:55:39.656 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_list: /' 2024-09-17T08:55:39.656 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.659 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_lock 2024-09-17T08:55:39.659 INFO:tasks.workunit.client.0.smithi078.stdout:test api_lock on pid 64723 2024-09-17T08:55:39.660 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64723 2024-09-17T08:55:39.660 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_lock on pid 64723' 2024-09-17T08:55:39.660 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64723 2024-09-17T08:55:39.660 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.660 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.660 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-09-17T08:55:39.660 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_lock_pp 2024-09-17T08:55:39.661 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_lock_pp' 2024-09-17T08:55:39.662 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.662 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.662 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.662 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_lock_pp 2024-09-17T08:55:39.662 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.662 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.662 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_lock 2024-09-17T08:55:39.664 INFO:tasks.workunit.client.0.smithi078.stdout:test api_lock_pp on pid 64731 2024-09-17T08:55:39.664 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_lock_pp 2024-09-17T08:55:39.664 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64731 2024-09-17T08:55:39.664 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_lock_pp on pid 64731' 2024-09-17T08:55:39.664 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64731 2024-09-17T08:55:39.665 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.665 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.665 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_lock: /' 2024-09-17T08:55:39.665 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-09-17T08:55:39.667 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.667 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.667 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.667 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.668 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_lock_pp 2024-09-17T08:55:39.672 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-09-17T08:55:39.675 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_misc 2024-09-17T08:55:39.675 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_misc' 2024-09-17T08:55:39.675 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_lock.log 2024-09-17T08:55:39.680 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_lock_pp: /' 2024-09-17T08:55:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_misc 2024-09-17T08:55:39.688 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.691 INFO:tasks.workunit.client.0.smithi078.stdout:test api_misc on pid 64796 2024-09-17T08:55:39.691 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_misc 2024-09-17T08:55:39.691 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64796 2024-09-17T08:55:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_misc on pid 64796' 2024-09-17T08:55:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64796 2024-09-17T08:55:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_misc_pp 2024-09-17T08:55:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_misc_pp' 2024-09-17T08:55:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-09-17T08:55:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_misc_pp 2024-09-17T08:55:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.694 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.694 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.694 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_misc: /' 2024-09-17T08:55:39.694 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_misc 2024-09-17T08:55:39.696 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_misc.log 2024-09-17T08:55:39.697 INFO:tasks.workunit.client.0.smithi078.stdout:test api_misc_pp on pid 64811 2024-09-17T08:55:39.697 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_misc_pp 2024-09-17T08:55:39.697 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64811 2024-09-17T08:55:39.697 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_misc_pp on pid 64811' 2024-09-17T08:55:39.697 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64811 2024-09-17T08:55:39.697 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.697 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.702 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-09-17T08:55:39.705 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.705 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.705 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.705 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.706 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_misc_pp 2024-09-17T08:55:39.706 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_tier_pp 2024-09-17T08:55:39.707 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_tier_pp' 2024-09-17T08:55:39.707 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-09-17T08:55:39.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_tier_pp 2024-09-17T08:55:39.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.710 INFO:tasks.workunit.client.0.smithi078.stdout:test api_tier_pp on pid 64836 2024-09-17T08:55:39.710 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_tier_pp 2024-09-17T08:55:39.710 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64836 2024-09-17T08:55:39.710 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_tier_pp on pid 64836' 2024-09-17T08:55:39.711 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64836 2024-09-17T08:55:39.711 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.711 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.711 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-09-17T08:55:39.711 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_misc_pp: /' 2024-09-17T08:55:39.712 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.712 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.712 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.712 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.713 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_tier_pp 2024-09-17T08:55:39.713 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_tier_pp: /' 2024-09-17T08:55:39.714 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-09-17T08:55:39.716 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_pool 2024-09-17T08:55:39.716 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_pool' 2024-09-17T08:55:39.717 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_pool 2024-09-17T08:55:39.717 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.723 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_pool 2024-09-17T08:55:39.723 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64867 2024-09-17T08:55:39.723 INFO:tasks.workunit.client.0.smithi078.stdout:test api_pool on pid 64867 2024-09-17T08:55:39.724 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_pool on pid 64867' 2024-09-17T08:55:39.724 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64867 2024-09-17T08:55:39.724 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.724 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.725 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-09-17T08:55:39.725 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_snapshots 2024-09-17T08:55:39.725 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_snapshots' 2024-09-17T08:55:39.725 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_snapshots 2024-09-17T08:55:39.725 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.727 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_snapshots 2024-09-17T08:55:39.727 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64879 2024-09-17T08:55:39.727 INFO:tasks.workunit.client.0.smithi078.stdout:test api_snapshots on pid 64879 2024-09-17T08:55:39.728 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_snapshots on pid 64879' 2024-09-17T08:55:39.728 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64879 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_pool 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_pool: /' 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.729 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_pool.log 2024-09-17T08:55:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_snapshots_pp 2024-09-17T08:55:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_snapshots_pp' 2024-09-17T08:55:39.735 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-09-17T08:55:39.743 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_snapshots 2024-09-17T08:55:39.746 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_snapshots_pp 2024-09-17T08:55:39.747 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_snapshots: /' 2024-09-17T08:55:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.753 INFO:tasks.workunit.client.0.smithi078.stdout:test api_snapshots_pp on pid 64910 2024-09-17T08:55:39.753 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_snapshots_pp 2024-09-17T08:55:39.753 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64910 2024-09-17T08:55:39.754 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_snapshots_pp on pid 64910' 2024-09-17T08:55:39.754 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64910 2024-09-17T08:55:39.754 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.754 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.754 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-09-17T08:55:39.755 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.755 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.755 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.755 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.755 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-17T08:55:39.755 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-09-17T08:55:39.756 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_stat 2024-09-17T08:55:39.756 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_stat' 2024-09-17T08:55:39.757 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_stat 2024-09-17T08:55:39.757 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.759 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_stat 2024-09-17T08:55:39.759 INFO:tasks.workunit.client.0.smithi078.stdout:test api_stat on pid 64929 2024-09-17T08:55:39.759 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64929 2024-09-17T08:55:39.760 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_stat on pid 64929' 2024-09-17T08:55:39.760 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64929 2024-09-17T08:55:39.760 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.760 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.760 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-09-17T08:55:39.760 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-09-17T08:55:39.762 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.762 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.762 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.762 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.762 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_stat: /' 2024-09-17T08:55:39.762 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_stat 2024-09-17T08:55:39.763 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_stat_pp 2024-09-17T08:55:39.763 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_stat_pp' 2024-09-17T08:55:39.765 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_stat_pp 2024-09-17T08:55:39.771 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_stat.log 2024-09-17T08:55:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.778 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_stat_pp 2024-09-17T08:55:39.778 INFO:tasks.workunit.client.0.smithi078.stdout:test api_stat_pp on pid 64963 2024-09-17T08:55:39.779 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64963 2024-09-17T08:55:39.779 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_stat_pp on pid 64963' 2024-09-17T08:55:39.779 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64963 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_watch_notify 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_watch_notify' 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_watch_notify 2024-09-17T08:55:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_stat_pp 2024-09-17T08:55:39.781 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_stat_pp: /' 2024-09-17T08:55:39.781 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.783 INFO:tasks.workunit.client.0.smithi078.stdout:test api_watch_notify on pid 64978 2024-09-17T08:55:39.783 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_watch_notify 2024-09-17T08:55:39.783 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64978 2024-09-17T08:55:39.783 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_watch_notify on pid 64978' 2024-09-17T08:55:39.783 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64978 2024-09-17T08:55:39.783 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-09-17T08:55:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_watch_notify_pp 2024-09-17T08:55:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_watch_notify_pp' 2024-09-17T08:55:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_watch_notify_pp 2024-09-17T08:55:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_watch_notify 2024-09-17T08:55:39.786 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-09-17T08:55:39.786 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_watch_notify: /' 2024-09-17T08:55:39.786 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.786 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-09-17T08:55:39.787 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_watch_notify_pp 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stdout:test api_watch_notify_pp on pid 64986 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64986 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_watch_notify_pp on pid 64986' 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64986 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-09-17T08:55:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_cmd 2024-09-17T08:55:39.789 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_cmd' 2024-09-17T08:55:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_cmd 2024-09-17T08:55:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-17T08:55:39.791 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stdout:test api_cmd on pid 64994 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_cmd 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64994 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_cmd on pid 64994' 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=64994 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-09-17T08:55:39.793 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.793 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.793 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.793 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.793 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_cmd 2024-09-17T08:55:39.794 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_cmd_pp 2024-09-17T08:55:39.794 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_cmd_pp' 2024-09-17T08:55:39.794 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-09-17T08:55:39.794 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.795 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_cmd_pp 2024-09-17T08:55:39.797 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_cmd.log 2024-09-17T08:55:39.797 INFO:tasks.workunit.client.0.smithi078.stdout:test api_cmd_pp on pid 65006 2024-09-17T08:55:39.797 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_cmd_pp 2024-09-17T08:55:39.798 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65006 2024-09-17T08:55:39.798 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_cmd_pp on pid 65006' 2024-09-17T08:55:39.798 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65006 2024-09-17T08:55:39.798 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.798 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.798 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-09-17T08:55:39.799 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.799 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.799 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.799 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.799 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_cmd: /' 2024-09-17T08:55:39.800 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-09-17T08:55:39.800 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-09-17T08:55:39.801 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_service 2024-09-17T08:55:39.801 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_service' 2024-09-17T08:55:39.803 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-17T08:55:39.803 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.805 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_service 2024-09-17T08:55:39.806 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_service 2024-09-17T08:55:39.806 INFO:tasks.workunit.client.0.smithi078.stdout:test api_service on pid 65021 2024-09-17T08:55:39.806 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65021 2024-09-17T08:55:39.806 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_service on pid 65021' 2024-09-17T08:55:39.807 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65021 2024-09-17T08:55:39.807 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.807 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.807 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-09-17T08:55:39.808 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.808 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_service_pp 2024-09-17T08:55:39.808 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.808 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.808 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.808 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_service_pp' 2024-09-17T08:55:39.809 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_service.log 2024-09-17T08:55:39.809 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_service: /' 2024-09-17T08:55:39.810 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_service 2024-09-17T08:55:39.818 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.823 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_service_pp 2024-09-17T08:55:39.824 INFO:tasks.workunit.client.0.smithi078.stdout:test api_service_pp on pid 65055 2024-09-17T08:55:39.824 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_service_pp 2024-09-17T08:55:39.825 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65055 2024-09-17T08:55:39.825 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_service_pp on pid 65055' 2024-09-17T08:55:39.825 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65055 2024-09-17T08:55:39.825 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.825 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.831 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-09-17T08:55:39.833 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.833 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.834 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.834 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.834 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_service_pp 2024-09-17T08:55:39.834 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_c_write_operations 2024-09-17T08:55:39.834 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-09-17T08:55:39.835 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_service_pp: /' 2024-09-17T08:55:39.835 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_c_write_operations' 2024-09-17T08:55:39.843 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.843 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_c_write_operations 2024-09-17T08:55:39.845 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_c_write_operations 2024-09-17T08:55:39.845 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65114 2024-09-17T08:55:39.845 INFO:tasks.workunit.client.0.smithi078.stdout:test api_c_write_operations on pid 65114 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_c_write_operations on pid 65114' 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65114 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_c_read_operations 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_c_read_operations' 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.847 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.848 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.848 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-17T08:55:39.848 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-09-17T08:55:39.848 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_c_read_operations 2024-09-17T08:55:39.850 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-09-17T08:55:39.851 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.854 INFO:tasks.workunit.client.0.smithi078.stdout:test api_c_read_operations on pid 65139 2024-09-17T08:55:39.854 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_c_read_operations 2024-09-17T08:55:39.854 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65139 2024-09-17T08:55:39.855 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_c_read_operations on pid 65139' 2024-09-17T08:55:39.855 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65139 2024-09-17T08:55:39.855 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.855 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.855 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s api_cls_remote_reads 2024-09-17T08:55:39.856 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' api_cls_remote_reads' 2024-09-17T08:55:39.856 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-09-17T08:55:39.860 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo api_cls_remote_reads 2024-09-17T08:55:39.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.860 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-17T08:55:39.862 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-09-17T08:55:39.862 INFO:tasks.workunit.client.0.smithi078.stdout:test api_cls_remote_reads on pid 65150 2024-09-17T08:55:39.863 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=api_cls_remote_reads 2024-09-17T08:55:39.863 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65150 2024-09-17T08:55:39.863 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test api_cls_remote_reads on pid 65150' 2024-09-17T08:55:39.863 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65150 2024-09-17T08:55:39.863 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.863 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.863 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s list_parallel 2024-09-17T08:55:39.864 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' list_parallel' 2024-09-17T08:55:39.864 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo list_parallel 2024-09-17T08:55:39.867 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-09-17T08:55:39.868 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.869 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.869 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.869 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.869 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-09-17T08:55:39.870 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-09-17T08:55:39.870 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_api_cls_remote_reads 2024-09-17T08:55:39.874 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-09-17T08:55:39.875 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.878 INFO:tasks.workunit.client.0.smithi078.stdout:test list_parallel on pid 65158 2024-09-17T08:55:39.878 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=list_parallel 2024-09-17T08:55:39.878 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65158 2024-09-17T08:55:39.878 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test list_parallel on pid 65158' 2024-09-17T08:55:39.879 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65158 2024-09-17T08:55:39.879 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.879 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.879 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s open_pools_parallel 2024-09-17T08:55:39.879 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' open_pools_parallel' 2024-09-17T08:55:39.879 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.881 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo open_pools_parallel 2024-09-17T08:55:39.882 INFO:tasks.workunit.client.0.smithi078.stdout:test open_pools_parallel on pid 65163 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=open_pools_parallel 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65163 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test open_pools_parallel on pid 65163' 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65163 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:++ printf %25s delete_pools_parallel 2024-09-17T08:55:39.883 INFO:tasks.workunit.client.0.smithi078.stderr:+ r=' delete_pools_parallel' 2024-09-17T08:55:39.884 INFO:tasks.workunit.client.0.smithi078.stderr:++ echo delete_pools_parallel 2024-09-17T08:55:39.884 INFO:tasks.workunit.client.0.smithi078.stderr:++ awk '{print $1}' 2024-09-17T08:55:39.885 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-09-17T08:55:39.885 INFO:tasks.workunit.client.0.smithi078.stderr:+ ff=delete_pools_parallel 2024-09-17T08:55:39.886 INFO:tasks.workunit.client.0.smithi078.stdout:test delete_pools_parallel on pid 65176 2024-09-17T08:55:39.887 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65176 2024-09-17T08:55:39.887 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-09-17T08:55:39.887 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo 'test delete_pools_parallel on pid 65176' 2024-09-17T08:55:39.887 INFO:tasks.workunit.client.0.smithi078.stderr:+ pids[$f]=65176 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ ret=0 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' 1 -eq 1 ']' 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64836 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64836 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.888 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.889 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.889 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ list_parallel: /' 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z '' ']' 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_list_parallel.log 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ case $- in 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ return 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-09-17T08:55:39.890 INFO:tasks.workunit.client.0.smithi078.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-09-17T08:55:39.891 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-17T08:55:39.895 INFO:tasks.workunit.client.0.smithi078.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-09-17T08:55:39.896 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph_test_rados_list_parallel 2024-09-17T08:55:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:40 smithi078 bash[32124]: cluster 2024-09-17T08:55:38.763838+0000 mgr.y (mgr.14532) 147 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:40.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:40 smithi078 bash[22670]: cluster 2024-09-17T08:55:38.763838+0000 mgr.y (mgr.14532) 147 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:41.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:40 smithi136 bash[24812]: cluster 2024-09-17T08:55:38.763838+0000 mgr.y (mgr.14532) 147 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:45.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:45 smithi136 bash[24812]: audit 2024-09-17T08:55:39.264229+0000 mgr.y (mgr.14532) 148 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:45.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:45 smithi136 bash[24812]: audit 2024-09-17T08:55:39.861347+0000 mon.b (mon.1) 34 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:45.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:45 smithi136 bash[24812]: audit 2024-09-17T08:55:39.866271+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.78:0/4095549851' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-09-17T08:55:45.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:45 smithi136 bash[24812]: audit 2024-09-17T08:55:40.562150+0000 mon.a (mon.0) 895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:45.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[32124]: audit 2024-09-17T08:55:39.264229+0000 mgr.y (mgr.14532) 148 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:45.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[32124]: audit 2024-09-17T08:55:39.861347+0000 mon.b (mon.1) 34 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:45.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[32124]: audit 2024-09-17T08:55:39.866271+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.78:0/4095549851' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-09-17T08:55:45.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[32124]: audit 2024-09-17T08:55:40.562150+0000 mon.a (mon.0) 895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:45.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[22670]: audit 2024-09-17T08:55:39.264229+0000 mgr.y (mgr.14532) 148 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[22670]: audit 2024-09-17T08:55:39.861347+0000 mon.b (mon.1) 34 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[22670]: audit 2024-09-17T08:55:39.866271+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.78:0/4095549851' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-09-17T08:55:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:45 smithi078 bash[22670]: audit 2024-09-17T08:55:40.562150+0000 mon.a (mon.0) 895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:48 smithi078 bash[22670]: audit 2024-09-17T08:55:40.587756+0000 mon.c (mon.2) 32 : audit [INF] from='client.? 172.21.15.78:0/2608436365' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:48 smithi078 bash[22670]: audit 2024-09-17T08:55:42.240024+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:48 smithi078 bash[22670]: cluster 2024-09-17T08:55:45.529310+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-09-17T08:55:48.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:55:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:55:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:55:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:48 smithi078 bash[32124]: audit 2024-09-17T08:55:40.587756+0000 mon.c (mon.2) 32 : audit [INF] from='client.? 172.21.15.78:0/2608436365' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:48 smithi078 bash[32124]: audit 2024-09-17T08:55:42.240024+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:48 smithi078 bash[32124]: cluster 2024-09-17T08:55:45.529310+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-09-17T08:55:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:48 smithi136 bash[24812]: audit 2024-09-17T08:55:40.587756+0000 mon.c (mon.2) 32 : audit [INF] from='client.? 172.21.15.78:0/2608436365' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:48 smithi136 bash[24812]: audit 2024-09-17T08:55:42.240024+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:48 smithi136 bash[24812]: cluster 2024-09-17T08:55:45.529310+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-09-17T08:55:49.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:55:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:55:50.457 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-09-17T08:55:50.457 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [----------] Global test environment set-up. 2024-09-17T08:55:50.457 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [----------] 12 tests from AsioRados 2024-09-17T08:55:50.457 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (2 ms) 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (11 ms) 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (7 ms) 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (4 ms) 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-17T08:55:50.458 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1 ms) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1 ms) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2 ms) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [----------] 12 tests from AsioRados (32 ms total) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [----------] Global test environment tear-down 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (10761 ms total) 2024-09-17T08:55:50.459 INFO:tasks.workunit.client.0.smithi078.stdout: api_asio: [ PASSED ] 12 tests. 2024-09-17T08:55:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: cluster 2024-09-17T08:55:40.764692+0000 mgr.y (mgr.14532) 149 : cluster [DBG] pgmap v96: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: cluster 2024-09-17T08:55:42.765756+0000 mgr.y (mgr.14532) 150 : cluster [DBG] pgmap v97: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: cluster 2024-09-17T08:55:44.767266+0000 mgr.y (mgr.14532) 151 : cluster [DBG] pgmap v98: 196 pgs: 42 creating+peering, 22 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.563666+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.78:0/2231584711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.563969+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.78:0/3978934214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.564233+0000 mon.c (mon.2) 35 : audit [INF] from='client.? 172.21.15.78:0/2097511003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.564558+0000 mon.c (mon.2) 36 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.564823+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.78:0/356944350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.565078+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.78:0/3528070001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.565256+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.78:0/564374788' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.566287+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.78:0/1802833402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:45.567132+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.78:0/1472823033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: cluster 2024-09-17T08:55:46.768442+0000 mgr.y (mgr.14532) 152 : cluster [DBG] pgmap v100: 580 pgs: 42 creating+peering, 406 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: cluster 2024-09-17T08:55:48.107902+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: cluster 2024-09-17T08:55:48.108590+0000 mon.a (mon.0) 898 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.126221+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.126671+0000 mon.a (mon.0) 900 : audit [INF] from='client.? 172.21.15.78:0/1348704341' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi078-64680-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.127383+0000 mon.a (mon.0) 901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.127627+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.127912+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.128207+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.128394+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.128552+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.128760+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.128917+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.129189+0000 mon.a (mon.0) 909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:50 smithi136 bash[24812]: audit 2024-09-17T08:55:48.129451+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: cluster 2024-09-17T08:55:40.764692+0000 mgr.y (mgr.14532) 149 : cluster [DBG] pgmap v96: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: cluster 2024-09-17T08:55:42.765756+0000 mgr.y (mgr.14532) 150 : cluster [DBG] pgmap v97: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: cluster 2024-09-17T08:55:44.767266+0000 mgr.y (mgr.14532) 151 : cluster [DBG] pgmap v98: 196 pgs: 42 creating+peering, 22 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.563666+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.78:0/2231584711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.563969+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.78:0/3978934214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.564233+0000 mon.c (mon.2) 35 : audit [INF] from='client.? 172.21.15.78:0/2097511003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.564558+0000 mon.c (mon.2) 36 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.564823+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.78:0/356944350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.565078+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.78:0/3528070001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.565256+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.78:0/564374788' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.566287+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.78:0/1802833402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:45.567132+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.78:0/1472823033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: cluster 2024-09-17T08:55:46.768442+0000 mgr.y (mgr.14532) 152 : cluster [DBG] pgmap v100: 580 pgs: 42 creating+peering, 406 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: cluster 2024-09-17T08:55:48.107902+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: cluster 2024-09-17T08:55:48.108590+0000 mon.a (mon.0) 898 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.126221+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.126671+0000 mon.a (mon.0) 900 : audit [INF] from='client.? 172.21.15.78:0/1348704341' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi078-64680-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.127383+0000 mon.a (mon.0) 901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.127627+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.127912+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.128207+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.128394+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.128552+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.128760+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.128917+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.129189+0000 mon.a (mon.0) 909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[32124]: audit 2024-09-17T08:55:48.129451+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: cluster 2024-09-17T08:55:40.764692+0000 mgr.y (mgr.14532) 149 : cluster [DBG] pgmap v96: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: cluster 2024-09-17T08:55:42.765756+0000 mgr.y (mgr.14532) 150 : cluster [DBG] pgmap v97: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: cluster 2024-09-17T08:55:44.767266+0000 mgr.y (mgr.14532) 151 : cluster [DBG] pgmap v98: 196 pgs: 42 creating+peering, 22 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.563666+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.78:0/2231584711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.563969+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.78:0/3978934214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.564233+0000 mon.c (mon.2) 35 : audit [INF] from='client.? 172.21.15.78:0/2097511003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.564558+0000 mon.c (mon.2) 36 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.564823+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.78:0/356944350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.565078+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.78:0/3528070001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.565256+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.78:0/564374788' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.566287+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.78:0/1802833402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:45.567132+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.78:0/1472823033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: cluster 2024-09-17T08:55:46.768442+0000 mgr.y (mgr.14532) 152 : cluster [DBG] pgmap v100: 580 pgs: 42 creating+peering, 406 unknown, 132 active+clean; 582 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: cluster 2024-09-17T08:55:48.107902+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: cluster 2024-09-17T08:55:48.108590+0000 mon.a (mon.0) 898 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.126221+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.126671+0000 mon.a (mon.0) 900 : audit [INF] from='client.? 172.21.15.78:0/1348704341' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi078-64680-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.127383+0000 mon.a (mon.0) 901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.127627+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.127912+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.128207+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.128394+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.128552+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.128760+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.128917+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.129189+0000 mon.a (mon.0) 909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:50.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:50 smithi078 bash[22670]: audit 2024-09-17T08:55:48.129451+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:48.168707+0000 mon.c (mon.2) 40 : audit [INF] from='client.? 172.21.15.78:0/2390227296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: cluster 2024-09-17T08:55:48.769738+0000 mgr.y (mgr.14532) 153 : cluster [DBG] pgmap v102: 772 pgs: 303 creating+peering, 337 unknown, 132 active+clean; 582 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:49.272797+0000 mgr.y (mgr.14532) 154 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:49.398261+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: cluster 2024-09-17T08:55:50.211837+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.238107+0000 mon.a (mon.0) 912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.238440+0000 mon.a (mon.0) 913 : audit [INF] from='client.? 172.21.15.78:0/533734073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi078-64983-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.238647+0000 mon.a (mon.0) 914 : audit [INF] from='client.? 172.21.15.78:0/1270889786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi078-65147-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.238816+0000 mon.a (mon.0) 915 : audit [INF] from='client.? 172.21.15.78:0/276985404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65155-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.241162+0000 mon.a (mon.0) 916 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi078-64720-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253101+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253179+0000 mon.a (mon.0) 918 : audit [INF] from='client.? 172.21.15.78:0/1348704341' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi078-64680-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253359+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253423+0000 mon.a (mon.0) 920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253497+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253568+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253646+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253731+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253806+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.253905+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.254006+0000 mon.a (mon.0) 927 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: cluster 2024-09-17T08:55:50.256474+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.271313+0000 mon.a (mon.0) 929 : audit [INF] from='client.? 172.21.15.78:0/2175317033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi078-64852-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.274195+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.280799+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.281395+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.78:0/1588189805' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.300235+0000 mon.c (mon.2) 41 : audit [INF] from='client.? 172.21.15.78:0/3363703481' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.300803+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.301658+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.78:0/3190625151' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.302144+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: cluster 2024-09-17T08:55:50.770992+0000 mgr.y (mgr.14532) 155 : cluster [DBG] pgmap v104: 932 pgs: 303 creating+peering, 497 unknown, 132 active+clean; 582 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[32124]: audit 2024-09-17T08:55:50.951699+0000 mon.c (mon.2) 43 : audit [DBG] from='client.? 172.21.15.78:0/3621016842' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:48.168707+0000 mon.c (mon.2) 40 : audit [INF] from='client.? 172.21.15.78:0/2390227296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: cluster 2024-09-17T08:55:48.769738+0000 mgr.y (mgr.14532) 153 : cluster [DBG] pgmap v102: 772 pgs: 303 creating+peering, 337 unknown, 132 active+clean; 582 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:49.272797+0000 mgr.y (mgr.14532) 154 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:49.398261+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:51.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: cluster 2024-09-17T08:55:50.211837+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.238107+0000 mon.a (mon.0) 912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.238440+0000 mon.a (mon.0) 913 : audit [INF] from='client.? 172.21.15.78:0/533734073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi078-64983-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.238647+0000 mon.a (mon.0) 914 : audit [INF] from='client.? 172.21.15.78:0/1270889786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi078-65147-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.238816+0000 mon.a (mon.0) 915 : audit [INF] from='client.? 172.21.15.78:0/276985404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65155-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.241162+0000 mon.a (mon.0) 916 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi078-64720-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253101+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253179+0000 mon.a (mon.0) 918 : audit [INF] from='client.? 172.21.15.78:0/1348704341' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi078-64680-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253359+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253423+0000 mon.a (mon.0) 920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253497+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253568+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253646+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253731+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253806+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.253905+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.254006+0000 mon.a (mon.0) 927 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: cluster 2024-09-17T08:55:50.256474+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.271313+0000 mon.a (mon.0) 929 : audit [INF] from='client.? 172.21.15.78:0/2175317033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi078-64852-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.274195+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.280799+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.281395+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.78:0/1588189805' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.300235+0000 mon.c (mon.2) 41 : audit [INF] from='client.? 172.21.15.78:0/3363703481' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.300803+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.301658+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.78:0/3190625151' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.302144+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: cluster 2024-09-17T08:55:50.770992+0000 mgr.y (mgr.14532) 155 : cluster [DBG] pgmap v104: 932 pgs: 303 creating+peering, 497 unknown, 132 active+clean; 582 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:51.608 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:51 smithi078 bash[22670]: audit 2024-09-17T08:55:50.951699+0000 mon.c (mon.2) 43 : audit [DBG] from='client.? 172.21.15.78:0/3621016842' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:48.168707+0000 mon.c (mon.2) 40 : audit [INF] from='client.? 172.21.15.78:0/2390227296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: cluster 2024-09-17T08:55:48.769738+0000 mgr.y (mgr.14532) 153 : cluster [DBG] pgmap v102: 772 pgs: 303 creating+peering, 337 unknown, 132 active+clean; 582 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:49.272797+0000 mgr.y (mgr.14532) 154 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:49.398261+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: cluster 2024-09-17T08:55:50.211837+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.238107+0000 mon.a (mon.0) 912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.238440+0000 mon.a (mon.0) 913 : audit [INF] from='client.? 172.21.15.78:0/533734073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi078-64983-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.238647+0000 mon.a (mon.0) 914 : audit [INF] from='client.? 172.21.15.78:0/1270889786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi078-65147-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.238816+0000 mon.a (mon.0) 915 : audit [INF] from='client.? 172.21.15.78:0/276985404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65155-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.241162+0000 mon.a (mon.0) 916 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi078-64720-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253101+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi078-64696-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253179+0000 mon.a (mon.0) 918 : audit [INF] from='client.? 172.21.15.78:0/1348704341' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi078-64680-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253359+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi078-64704-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253423+0000 mon.a (mon.0) 920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi078-64688-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253497+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi078-64969-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253568+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi078-64733-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253646+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253731+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253806+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.253905+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi078-64935-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.254006+0000 mon.a (mon.0) 927 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi078-64912-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: cluster 2024-09-17T08:55:50.256474+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.271313+0000 mon.a (mon.0) 929 : audit [INF] from='client.? 172.21.15.78:0/2175317033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi078-64852-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.274195+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.280799+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.281395+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.78:0/1588189805' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.300235+0000 mon.c (mon.2) 41 : audit [INF] from='client.? 172.21.15.78:0/3363703481' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.300803+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.301658+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.78:0/3190625151' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.302144+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: cluster 2024-09-17T08:55:50.770992+0000 mgr.y (mgr.14532) 155 : cluster [DBG] pgmap v104: 932 pgs: 303 creating+peering, 497 unknown, 132 active+clean; 582 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T08:55:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:51 smithi136 bash[24812]: audit 2024-09-17T08:55:50.951699+0000 mon.c (mon.2) 43 : audit [DBG] from='client.? 172.21.15.78:0/3621016842' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:51.929 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-09-17T08:55:51.929 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] Global test environment set-up. 2024-09-17T08:55:51.929 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] 7 tests from LibRadosList 2024-09-17T08:55:51.930 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-09-17T08:55:51.930 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosList.ListObjects (319 ms) 2024-09-17T08:55:51.930 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-17T08:55:51.930 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (36 ms) 2024-09-17T08:55:51.930 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-09-17T08:55:51.930 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset foo1,foo2,foo3 2024-09-17T08:55:51.931 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo1 2024-09-17T08:55:51.931 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo2 2024-09-17T08:55:51.931 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo3 2024-09-17T08:55:51.931 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset foo1,foo4,foo5 2024-09-17T08:55:51.931 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo4 2024-09-17T08:55:51.932 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo5 2024-09-17T08:55:51.932 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo1 2024-09-17T08:55:51.932 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset foo6,foo7 2024-09-17T08:55:51.932 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo7 2024-09-17T08:55:51.932 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo6 2024-09-17T08:55:51.932 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-17T08:55:51.933 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns1:foo4 2024-09-17T08:55:51.933 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns1:foo5 2024-09-17T08:55:51.933 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns2:foo7 2024-09-17T08:55:51.933 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns2:foo6 2024-09-17T08:55:51.933 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns1:foo1 2024-09-17T08:55:51.934 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: :foo1 2024-09-17T08:55:51.934 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: :foo2 2024-09-17T08:55:51.934 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: :foo3 2024-09-17T08:55:51.934 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (95 ms) 2024-09-17T08:55:51.934 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-09-17T08:55:51.935 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 1 0 2024-09-17T08:55:51.935 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 10 0 2024-09-17T08:55:51.935 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 13 0 2024-09-17T08:55:51.935 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 7 0 2024-09-17T08:55:51.935 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 14 0 2024-09-17T08:55:51.936 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 0 0 2024-09-17T08:55:51.936 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 15 0 2024-09-17T08:55:51.936 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 11 0 2024-09-17T08:55:51.936 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 5 0 2024-09-17T08:55:51.936 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 8 0 2024-09-17T08:55:51.937 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 6 0 2024-09-17T08:55:51.937 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 3 0 2024-09-17T08:55:51.937 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 4 0 2024-09-17T08:55:51.937 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 12 0 2024-09-17T08:55:51.937 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 9 0 2024-09-17T08:55:51.938 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 2 0 2024-09-17T08:55:51.938 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-17T08:55:51.938 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (98 ms) 2024-09-17T08:55:51.938 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-09-17T08:55:51.938 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: x cursor=MIN 2024-09-17T08:55:51.938 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=1 cursor=26:02547ec2:::1:head 2024-09-17T08:55:51.939 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=10 cursor=26:52ea6a34:::10:head 2024-09-17T08:55:51.939 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=13 cursor=26:566253c9:::13:head 2024-09-17T08:55:51.939 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=7 cursor=26:5c6b0b28:::7:head 2024-09-17T08:55:51.939 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=14 cursor=26:62a1935d:::14:head 2024-09-17T08:55:51.939 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=0 cursor=26:6cac518f:::0:head 2024-09-17T08:55:51.940 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=15 cursor=26:863748b0:::15:head 2024-09-17T08:55:51.940 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=11 cursor=26:89d3ae78:::11:head 2024-09-17T08:55:51.940 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=5 cursor=26:b29083e3:::5:head 2024-09-17T08:55:51.940 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=8 cursor=26:bd63b0f1:::8:head 2024-09-17T08:55:51.940 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=6 cursor=26:c4fdafeb:::6:head 2024-09-17T08:55:51.940 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=3 cursor=26:cfc208b3:::3:head 2024-09-17T08:55:51.941 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=4 cursor=26:d83876eb:::4:head 2024-09-17T08:55:51.941 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=12 cursor=26:de5d7c5f:::12:head 2024-09-17T08:55:51.941 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=9 cursor=26:e960b815:::9:head 2024-09-17T08:55:51.941 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > oid=2 cursor=26:f905c69b:::2:head 2024-09-17T08:55:51.941 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: FIRST> seek to MIN oid=1 2024-09-17T08:55:51.942 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=1 cursor=26:02547ec2:::1:head 2024-09-17T08:55:51.942 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:02547ec2:::1:head 2024-09-17T08:55:51.942 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:02547ec2:::1:head -> 1 2024-09-17T08:55:51.942 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=10 cursor=26:52ea6a34:::10:head 2024-09-17T08:55:51.942 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:52ea6a34:::10:head 2024-09-17T08:55:51.942 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:52ea6a34:::10:head -> 10 2024-09-17T08:55:51.943 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=13 cursor=26:566253c9:::13:head 2024-09-17T08:55:51.943 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:566253c9:::13:head 2024-09-17T08:55:51.943 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:566253c9:::13:head -> 13 2024-09-17T08:55:51.943 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=7 cursor=26:5c6b0b28:::7:head 2024-09-17T08:55:51.943 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:5c6b0b28:::7:head 2024-09-17T08:55:51.944 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:5c6b0b28:::7:head -> 7 2024-09-17T08:55:52.008 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=14 cursor=26:62a1935d:::14:head 2024-09-17T08:55:52.008 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:62a1935d:::14:head 2024-09-17T08:55:52.009 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:62a1935d:::14:head -> 14 2024-09-17T08:55:52.009 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=0 cursor=26:6cac518f:::0:head 2024-09-17T08:55:52.009 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:6cac518f:::0:head 2024-09-17T08:55:52.009 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:6cac518f:::0:head -> 0 2024-09-17T08:55:52.009 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=15 cursor=26:863748b0:::15:head 2024-09-17T08:55:52.009 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:863748b0:::15:head 2024-09-17T08:55:52.010 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:863748b0:::15:head -> 15 2024-09-17T08:55:52.010 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=11 cursor=26:89d3ae78:::11:head 2024-09-17T08:55:52.010 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:89d3ae78:::11:head 2024-09-17T08:55:52.010 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:89d3ae78:::11:head -> 11 2024-09-17T08:55:52.010 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=5 cursor=26:b29083e3:::5:head 2024-09-17T08:55:52.010 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:b29083e3:::5:head 2024-09-17T08:55:52.010 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:b29083e3:::5:head -> 5 2024-09-17T08:55:52.011 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=8 cursor=26:bd63b0f1:::8:head 2024-09-17T08:55:52.011 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:bd63b0f1:::8:head 2024-09-17T08:55:52.011 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:bd63b0f1:::8:head -> 8 2024-09-17T08:55:52.011 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=6 cursor=26:c4fdafeb:::6:head 2024-09-17T08:55:52.011 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:c4fdafeb:::6:head 2024-09-17T08:55:52.011 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:c4fdafeb:::6:head -> 6 2024-09-17T08:55:52.011 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=3 cursor=26:cfc208b3:::3:head 2024-09-17T08:55:52.012 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:cfc208b3:::3:head 2024-09-17T08:55:52.012 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:cfc208b3:::3:head -> 3 2024-09-17T08:55:52.012 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=4 cursor=26:d83876eb:::4:head 2024-09-17T08:55:52.012 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:d83876eb:::4:head 2024-09-17T08:55:52.012 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:d83876eb:::4:head -> 4 2024-09-17T08:55:52.012 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=12 cursor=26:de5d7c5f:::12:head 2024-09-17T08:55:52.012 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:de5d7c5f:::12:head 2024-09-17T08:55:52.013 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:de5d7c5f:::12:head -> 12 2024-09-17T08:55:52.013 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=9 cursor=26:e960b815:::9:head 2024-09-17T08:55:52.013 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:e960b815:::9:head 2024-09-17T08:55:52.013 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:e960b815:::9:head -> 9 2024-09-17T08:55:52.013 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : oid=2 cursor=26:f905c69b:::2:head 2024-09-17T08:55:52.013 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:f905c69b:::2:head 2024-09-17T08:55:52.014 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:f905c69b:::2:head -> 2 2024-09-17T08:55:52.014 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:cfc208b3:::3:head 2024-09-17T08:55:52.014 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:cfc208b3:::3:head expected=26:cfc208b3:::3:head 2024-09-17T08:55:52.014 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:cfc208b3:::3:head -> 3 2024-09-17T08:55:52.014 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=3 expected=3 2024-09-17T08:55:52.014 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:f905c69b:::2:head 2024-09-17T08:55:52.014 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:f905c69b:::2:head expected=26:f905c69b:::2:head 2024-09-17T08:55:52.015 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:f905c69b:::2:head -> 2 2024-09-17T08:55:52.015 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=2 expected=2 2024-09-17T08:55:52.015 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:e960b815:::9:head 2024-09-17T08:55:52.015 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:e960b815:::9:head expected=26:e960b815:::9:head 2024-09-17T08:55:52.015 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:e960b815:::9:head -> 9 2024-09-17T08:55:52.015 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=9 expected=9 2024-09-17T08:55:52.016 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:de5d7c5f:::12:head 2024-09-17T08:55:52.016 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:de5d7c5f:::12:head expected=26:de5d7c5f:::12:head 2024-09-17T08:55:52.016 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:de5d7c5f:::12:head -> 12 2024-09-17T08:55:52.016 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=12 expected=12 2024-09-17T08:55:52.016 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:d83876eb:::4:head 2024-09-17T08:55:52.016 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:d83876eb:::4:head expected=26:d83876eb:::4:head 2024-09-17T08:55:52.016 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:d83876eb:::4:head -> 4 2024-09-17T08:55:52.017 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=4 expected=4 2024-09-17T08:55:52.017 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:6cac518f:::0:head 2024-09-17T08:55:52.017 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:6cac518f:::0:head expected=26:6cac518f:::0:head 2024-09-17T08:55:52.017 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:6cac518f:::0:head -> 0 2024-09-17T08:55:52.017 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=0 expected=0 2024-09-17T08:55:52.017 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:62a1935d:::14:head 2024-09-17T08:55:52.018 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:62a1935d:::14:head expected=26:62a1935d:::14:head 2024-09-17T08:55:52.018 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:62a1935d:::14:head -> 14 2024-09-17T08:55:52.018 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=14 expected=14 2024-09-17T08:55:52.018 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:5c6b0b28:::7:head 2024-09-17T08:55:52.018 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:5c6b0b28:::7:head expected=26:5c6b0b28:::7:head 2024-09-17T08:55:52.018 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:5c6b0b28:::7:head -> 7 2024-09-17T08:55:53.721 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=7 api_c_read_operations: Running main() from gmock_main.cc 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (243 ms) 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (28 ms) 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-09-17T08:55:53.722 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (9 ms) 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (30 ms) 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (12 ms) 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (12 ms) 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (22 ms) 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (8 ms) 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (5 ms) 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-09-17T08:55:53.723 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (8 ms) 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (6 ms) 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (7 ms) 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (18 ms) 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (13 ms) 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (9 ms) 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-09-17T08:55:53.724 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (4 ms) 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (435 ms total) 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (13844 ms total) 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-09-17T08:55:53.725 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-09-17T08:55:53.726 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (13822 ms) 2024-09-17T08:55:53.726 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (13822 ms total) 2024-09-17T08:55:53.726 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: 2024-09-17T08:55:53.726 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-09-17T08:55:53.726 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (13822 ms total) 2024-09-17T08:55:53.726 INFO:tasks.workunit.client.0.smithi078.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-09-17T08:55:54.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.264064+0000 mon.a (mon.0) 934 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.264474+0000 mon.a (mon.0) 935 : audit [INF] from='client.? 172.21.15.78:0/533734073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi078-64983-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.264613+0000 mon.a (mon.0) 936 : audit [INF] from='client.? 172.21.15.78:0/1270889786' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi078-65147-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.264750+0000 mon.a (mon.0) 937 : audit [INF] from='client.? 172.21.15.78:0/276985404' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65155-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.264924+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi078-64720-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.265218+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.78:0/2175317033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi078-64852-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.265372+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:54.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.265597+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.265818+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.265992+0000 mon.a (mon.0) 943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: cluster 2024-09-17T08:55:51.266605+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-09-17T08:55:54.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.276973+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:54.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:53 smithi136 bash[24812]: audit 2024-09-17T08:55:51.329291+0000 mon.a (mon.0) 945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:54.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.264064+0000 mon.a (mon.0) 934 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.264474+0000 mon.a (mon.0) 935 : audit [INF] from='client.? 172.21.15.78:0/533734073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi078-64983-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.264613+0000 mon.a (mon.0) 936 : audit [INF] from='client.? 172.21.15.78:0/1270889786' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi078-65147-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.264750+0000 mon.a (mon.0) 937 : audit [INF] from='client.? 172.21.15.78:0/276985404' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65155-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.264924+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi078-64720-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.265218+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.78:0/2175317033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi078-64852-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.265372+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.265597+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.265818+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.265992+0000 mon.a (mon.0) 943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: cluster 2024-09-17T08:55:51.266605+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-09-17T08:55:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.276973+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[32124]: audit 2024-09-17T08:55:51.329291+0000 mon.a (mon.0) 945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.264064+0000 mon.a (mon.0) 934 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi078-64728-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.264474+0000 mon.a (mon.0) 935 : audit [INF] from='client.? 172.21.15.78:0/533734073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi078-64983-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.264613+0000 mon.a (mon.0) 936 : audit [INF] from='client.? 172.21.15.78:0/1270889786' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi078-65147-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.264750+0000 mon.a (mon.0) 937 : audit [INF] from='client.? 172.21.15.78:0/276985404' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65155-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.264924+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi078-64720-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.265218+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.78:0/2175317033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi078-64852-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.265372+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:54.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.265597+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi078-64886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.265818+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64996-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.265992+0000 mon.a (mon.0) 943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65008-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:54.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: cluster 2024-09-17T08:55:51.266605+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-09-17T08:55:54.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.276973+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:54.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:53 smithi078 bash[22670]: audit 2024-09-17T08:55:51.329291+0000 mon.a (mon.0) 945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:54.416 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_1_[65249]: starting. 2024-09-17T08:55:54.416 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_1_[65249]: creating pool ceph_test_rados_list_parallel.smithi078-65178 2024-09-17T08:55:54.416 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_1_[65249]: created object 0... 2024-09-17T08:55:54.416 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_1_[65249]: created object 25... 2024-09-17T08:55:54.416 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_1_[65249]: created object 49... 2024-09-17T08:55:54.416 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_1_[65249]: finishing. 2024-09-17T08:55:54.416 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_1_[65249]: shutting down. 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_2_[65250]: starting. 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_2_[65250]: listing objects. 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_2_[65250]: listed object 0... 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_2_[65250]: listed object 25... 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_2_[65250]: saw 50 objects 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_2_[65250]: shutting down. 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_3_[65971]: starting. 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_3_[65971]: creating pool ceph_test_rados_list_parallel.smithi078-65178 2024-09-17T08:55:54.417 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_3_[65971]: created object 0... 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_3_[65971]: created object 25... 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_3_[65971]: created object 49... 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_3_[65971]: finishing. 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_3_[65971]: shutting down. 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_4_[65972]: starting. 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_4_[65972]: listing objects. 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_4_[65972]: listed object 0... 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_4_[65972]: listed object 25... 2024-09-17T08:55:54.418 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_4_[65972]: saw 44 objects 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_4_[65972]: shutting down. 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_5_[65973]: starting. 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_5_[65973]: removed 25 objects... 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_5_[65973]: removed half of the objects 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_5_[65973]: removed 50 objects... 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_5_[65973]: removed 50 objects 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_5_[65973]: shutting down. 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_6_[66022]: starting. 2024-09-17T08:55:54.419 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_6_[66022]: creating pool ceph_test_rados_list_parallel.smithi078-65178 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_6_[66022]: created object 0... 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_6_[66022]: created object 25... 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_6_[66022]: created object 49... 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_6_[66022]: finishing. 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_6_[66022]: shutting down. 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_8_[66024]: starting. 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_8_[66024]: added 25 objects... 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_8_[66024]: added half of the objects 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_8_[66024]: added 50 objects... 2024-09-17T08:55:54.420 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_8_[66024]: added 50 objects 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_8_[66024]: shutting down. 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: starting. 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: listing objects. 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: listed object 0... 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: listed object 25... 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: listed object 50... 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: listed object 75... 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: saw 100 objects 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_7_[66023]: shutting down. 2024-09-17T08:55:54.421 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:54.748 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ************** api_cmd_pp: Running main() from gmock_main.cc 2024-09-17T08:55:54.748 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-09-17T08:55:54.748 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-09-17T08:55:54.748 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-09-17T08:55:54.748 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-09-17T08:55:54.748 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (45 ms) 2024-09-17T08:55:54.748 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (726 ms) 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (14147 ms) 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (14918 ms total) 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (14918 ms total) 2024-09-17T08:55:54.749 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [----------] Global test environment set-up. 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [----------] 4 tests from LibRadosService 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (10696 ms) 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ OK ] LibRadosService.RegisterLate (217 ms) 2024-09-17T08:55:54.994 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: cluster: 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: id: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: health: HEALTH_WARN 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 14 pool(s) do not have an application enabled 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: services: 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 11m) 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: osd: 8 osds: 8 up (since 4m), 8 in (since 5m) 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.995 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: data: 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: pools: 20 pools, 580 pgs 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: objects: 196 objects, 582 KiB 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: usage: 231 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: pgs: 70.000% pgs unknown 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 7.241% pgs not active 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 406 unknown 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 132 active+clean 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 42 creating+peering 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: io: 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: client: 639 B/s rd, 0 op/s rd, 0 op/s wr 2024-09-17T08:55:54.996 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: cluster: 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: id: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: health: HEALTH_WARN 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 14 pool(s) do not have an application enabled 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: services: 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: osd: 8 osds: 8 up (since 4m), 8 in (since 5m) 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-17T08:55:54.997 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: data: 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: pools: 31 pools, 932 pgs 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: objects: 196 objects, 582 KiB 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: usage: 232 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: pgs: 53.326% pgs unknown 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 32.511% pgs not active 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 497 unknown 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 303 creating+peering 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 132 active+clean 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: io: 2024-09-17T08:55:54.998 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: client: 852 B/s rd, 0 op/s rd, 0 op/s wr 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: cluster: 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: id: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: health: HEALTH_WARN 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 8 pool(s) do not have an application enabled 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: services: 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-09-17T08:55:54.999 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: osd: 8 osds: 8 up (since 4m), 8 in (since 5m) 2024-09-17T08:55:55.000 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-09-17T08:55:55.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:52.345397+0000 mon.a (mon.0) 946 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:55.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: cluster 2024-09-17T08:55:52.774332+0000 mgr.y (mgr.14532) 156 : cluster [DBG] pgmap v107: 868 pgs: 188 creating+peering, 301 unknown, 379 active+clean; 600 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 8.6 KiB/s rd, 40 KiB/s wr, 66 op/s 2024-09-17T08:55:55.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:52.793812+0000 mon.c (mon.2) 44 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:52.796416+0000 mon.c (mon.2) 45 : audit [INF] from='client.? 172.21.15.78:0/3904416284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:52.973435+0000 mon.c (mon.2) 46 : audit [DBG] from='client.? 172.21.15.78:0/1402216202' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: cluster 2024-09-17T08:55:53.667674+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.679405+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.680736+0000 mon.a (mon.0) 949 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.685596+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.692967+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: cluster 2024-09-17T08:55:53.696210+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.701995+0000 mon.c (mon.2) 47 : audit [INF] from='client.? 172.21.15.78:0/2623043711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.721905+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.722901+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.726291+0000 mon.a (mon.0) 955 : audit [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.726511+0000 mon.a (mon.0) 956 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.767456+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.767814+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:54 smithi136 bash[24812]: audit 2024-09-17T08:55:53.770524+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:52.345397+0000 mon.a (mon.0) 946 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: cluster 2024-09-17T08:55:52.774332+0000 mgr.y (mgr.14532) 156 : cluster [DBG] pgmap v107: 868 pgs: 188 creating+peering, 301 unknown, 379 active+clean; 600 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 8.6 KiB/s rd, 40 KiB/s wr, 66 op/s 2024-09-17T08:55:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:52.793812+0000 mon.c (mon.2) 44 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:52.796416+0000 mon.c (mon.2) 45 : audit [INF] from='client.? 172.21.15.78:0/3904416284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:52.973435+0000 mon.c (mon.2) 46 : audit [DBG] from='client.? 172.21.15.78:0/1402216202' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: cluster 2024-09-17T08:55:53.667674+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.679405+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.680736+0000 mon.a (mon.0) 949 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.685596+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.692967+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: cluster 2024-09-17T08:55:53.696210+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.701995+0000 mon.c (mon.2) 47 : audit [INF] from='client.? 172.21.15.78:0/2623043711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.721905+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.722901+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.726291+0000 mon.a (mon.0) 955 : audit [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.726511+0000 mon.a (mon.0) 956 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.767456+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.767814+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[32124]: audit 2024-09-17T08:55:53.770524+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:52.345397+0000 mon.a (mon.0) 946 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:55.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: cluster 2024-09-17T08:55:52.774332+0000 mgr.y (mgr.14532) 156 : cluster [DBG] pgmap v107: 868 pgs: 188 creating+peering, 301 unknown, 379 active+clean; 600 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 8.6 KiB/s rd, 40 KiB/s wr, 66 op/s 2024-09-17T08:55:55.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:52.793812+0000 mon.c (mon.2) 44 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:52.796416+0000 mon.c (mon.2) 45 : audit [INF] from='client.? 172.21.15.78:0/3904416284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:52.973435+0000 mon.c (mon.2) 46 : audit [DBG] from='client.? 172.21.15.78:0/1402216202' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: cluster 2024-09-17T08:55:53.667674+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.679405+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.680736+0000 mon.a (mon.0) 949 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.685596+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.692967+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: cluster 2024-09-17T08:55:53.696210+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.701995+0000 mon.c (mon.2) 47 : audit [INF] from='client.? 172.21.15.78:0/2623043711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.721905+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:55.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.722901+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:55:55.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.726291+0000 mon.a (mon.0) 955 : audit [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.726511+0000 mon.a (mon.0) 956 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:55.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.767456+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.767814+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:54 smithi078 bash[22670]: audit 2024-09-17T08:55:53.770524+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:55.236 INFO:tasks.workunit.client.0.smithi078.stdout: api_servi***************** 2024-09-17T08:55:55.237 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.237 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_9_[66093]: starting. 2024-09-17T08:55:55.237 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_9_[66093]: creating pool ceph_test_rados_list_parallel.smithi078-65178 2024-09-17T08:55:55.237 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_9_[66093]: created object 0... 2024-09-17T08:55:55.237 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_9_[66093]: created object 25... 2024-09-17T08:55:55.237 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_9_[66093]: created object 49... 2024-09-17T08:55:55.237 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_9_[66093]: finishing. 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_9_[66093]: shutting down. 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: starting. 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: listing objects. 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: listed object 0... 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: listed object 25... 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: listed object 50... 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: listed object 75... 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: saw 94 objects 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_10_[66094]: shutting down. 2024-09-17T08:55:55.238 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_13_[66097]: starting. 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_13_[66097]: removed 25 objects... 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_13_[66097]: removed half of the objects 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_13_[66097]: removed 50 objects... 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_13_[66097]: removed 50 objects 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_13_[66097]: shutting down. 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_11_[66095]: starting. 2024-09-17T08:55:55.239 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_11_[66095]: added 25 objects... 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_11_[66095]: added half of the objects 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_11_[66095]: added 50 objects... 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_11_[66095]: added 50 objects 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_11_[66095]: shutting down. 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_12_[66096]: starting. 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_12_[66096]: added 25 objects... 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_12_[66096]: added half of the objects 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_12_[66096]: added 50 objects... 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_12_[66096]: added 50 objects 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_12_[66096]: shutting down. 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.240 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_14_[66174]: starting. 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_14_[66174]: creating pool ceph_test_rados_list_parallel.smithi078-65178 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_14_[66174]: created object 0... 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_14_[66174]: created object 25... 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_14_[66174]: created object 49... 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_14_[66174]: finishing. 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_14_[66174]: shutting down. 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:55.241 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: starting. 2024-09-17T08:55:55.242 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: listing objects. 2024-09-17T08:55:56.079 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: listed object api_cmd: Running main() from gmock_main.cc 2024-09-17T08:55:56.079 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-09-17T08:55:56.079 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [----------] Global test environment set-up. 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (57 ms) 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (718 ms) 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (14154 ms) 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:52.793812+0000 mon.c [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:52.796416+0000 mon.c [INF] from='client.? 172.21.15.78:0/3904416284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.679405+0000 mon.a [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.685596+0000 mon.a [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:56.080 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.692967+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi078-64991-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.701995+0000 mon.c [INF] from='client.? 172.21.15.78:0/2623043711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.721905+0000 mon.a [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.726291+0000 mon.a [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.726511+0000 mon.a [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.767456+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.767814+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:53.770524+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.682377+0000 mon.a [WRN] Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.711643+0000 mon.a [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.711726+0000 mon.a [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.711948+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.081 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.712003+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.712116+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.715301+0000 mon.a [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi078-64696-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.719305+0000 mon.b [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.723396+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:54.815788+0000 mon.b [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.204476+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.205358+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.206127+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.206768+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.207474+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.208114+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:55:56.082 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.208885+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:55:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: cluster 2024-09-17T08:55:54.682377+0000 mon.a (mon.0) 960 : cluster [WRN] Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:55:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.682521+0000 mon.a (mon.0) 961 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.711643+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.711726+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.711948+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.712003+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.712116+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: cluster 2024-09-17T08:55:54.712412+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.715301+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi078-64696-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.719305+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.723396+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: cluster 2024-09-17T08:55:54.775164+0000 mgr.y (mgr.14532) 157 : cluster [DBG] pgmap v110: 588 pgs: 50 creating+peering, 132 unknown, 406 active+clean; 600 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 72 KiB/s wr, 383 op/s 2024-09-17T08:55:56.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.815788+0000 mon.b (mon.1) 42 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:54.998017+0000 mon.b (mon.1) 43 : audit [DBG] from='client.? 172.21.15.78:0/243247346' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: cluster 2024-09-17T08:55:54.682377+0000 mon.a (mon.0) 960 : cluster [WRN] Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.682521+0000 mon.a (mon.0) 961 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.711643+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.711726+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.711948+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.712003+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.712116+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: cluster 2024-09-17T08:55:54.712412+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.715301+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi078-64696-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.719305+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.723396+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: cluster 2024-09-17T08:55:54.775164+0000 mgr.y (mgr.14532) 157 : cluster [DBG] pgmap v110: 588 pgs: 50 creating+peering, 132 unknown, 406 active+clean; 600 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 72 KiB/s wr, 383 op/s 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.815788+0000 mon.b (mon.1) 42 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:54.998017+0000 mon.b (mon.1) 43 : audit [DBG] from='client.? 172.21.15.78:0/243247346' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.204476+0000 mon.c (mon.2) 48 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.205358+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.206127+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.206768+0000 mon.c (mon.2) 51 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:55:56.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.207474+0000 mon.c (mon.2) 52 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.208114+0000 mon.c (mon.2) 53 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.208885+0000 mon.c (mon.2) 54 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.209457+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.210095+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.210784+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.664662+0000 mon.a (mon.0) 970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.669238+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.669459+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[22670]: audit 2024-09-17T08:55:55.669480+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.204476+0000 mon.c (mon.2) 48 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.205358+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.206127+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.206768+0000 mon.c (mon.2) 51 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.207474+0000 mon.c (mon.2) 52 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.208114+0000 mon.c (mon.2) 53 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.208885+0000 mon.c (mon.2) 54 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.209457+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.210095+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.210784+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.664662+0000 mon.a (mon.0) 970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.669238+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.669459+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:56.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:56 smithi078 bash[32124]: audit 2024-09-17T08:55:55.669480+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: cluster 2024-09-17T08:55:54.682377+0000 mon.a (mon.0) 960 : cluster [WRN] Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:55:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.682521+0000 mon.a (mon.0) 961 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.711643+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.78:0/3696588796' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.711726+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi078-64696-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.711948+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.712003+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi078-64680-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.712116+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: cluster 2024-09-17T08:55:54.712412+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.715301+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi078-64696-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.719305+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.723396+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: cluster 2024-09-17T08:55:54.775164+0000 mgr.y (mgr.14532) 157 : cluster [DBG] pgmap v110: 588 pgs: 50 creating+peering, 132 unknown, 406 active+clean; 600 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 72 KiB/s wr, 383 op/s 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.815788+0000 mon.b (mon.1) 42 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:54.998017+0000 mon.b (mon.1) 43 : audit [DBG] from='client.? 172.21.15.78:0/243247346' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.204476+0000 mon.c (mon.2) 48 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.205358+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.206127+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.206768+0000 mon.c (mon.2) 51 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.207474+0000 mon.c (mon.2) 52 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.208114+0000 mon.c (mon.2) 53 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.208885+0000 mon.c (mon.2) 54 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.209457+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.210095+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.210784+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:55:56.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.664662+0000 mon.a (mon.0) 970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:56.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.669238+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:56.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.669459+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:56.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:56 smithi136 bash[24812]: audit 2024-09-17T08:55:55.669480+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.209457+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.210095+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.210784+0000 mon.c [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.664662+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.669238+0000 mon.a [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.669459+0000 mon.a [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.669480+0000 mon.b [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:57.408 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.674141+0000 mon.c [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.674274+0000 client.admin [INF] onexx 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:55.675185+0000 mon.c [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.085388+0000 mon.a [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.085475+0000 mon.a [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.087008+0000 mon.a [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.090189+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.090415+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.513409+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.517039+0000 mon.c [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:57.409 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.520573+0000 mon.c [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.523057+0000 mon.a [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10", "profile": [ "k=2", "m=1", "crush-fa0... 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: listed object 25... 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: listed object 50... 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: listed object 75... 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: listed object 100... 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: listed object 125... 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: saw 150 objects 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_15_[66175]: shutting down. 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.437 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_16_[66176]: starting. 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_16_[66176]: added 25 objects... 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_16_[66176]: added half of the objects 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_16_[66176]: added 50 objects... 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_16_[66176]: added 50 objects 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: process_16_[66176]: shutting down. 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******************************* 2024-09-17T08:55:57.438 INFO:tasks.workunit.client.0.smithi078.stdout: list_parallel: ******* SUCCESS ********** 2024-09-17T08:55:57.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.204726+0000 mgr.y (mgr.14532) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:55:57.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.205579+0000 mgr.y (mgr.14532) 159 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:55:57.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.206278+0000 mgr.y (mgr.14532) 160 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:55:57.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.206968+0000 mgr.y (mgr.14532) 161 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:55:57.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.207603+0000 mgr.y (mgr.14532) 162 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:55:57.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.208292+0000 mgr.y (mgr.14532) 163 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:55:57.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.209039+0000 mgr.y (mgr.14532) 164 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:55:57.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.209608+0000 mgr.y (mgr.14532) 165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:55:57.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.210248+0000 mgr.y (mgr.14532) 166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:55:57.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.210909+0000 mgr.y (mgr.14532) 167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:55:57.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:55.281303+0000 osd.4 (osd.4) 3 : cluster [DBG] 13.5 deep-scrub starts 2024-09-17T08:55:57.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:55.283957+0000 osd.4 (osd.4) 4 : cluster [DBG] 13.5 deep-scrub ok 2024-09-17T08:55:57.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:55.441340+0000 osd.5 (osd.5) 3 : cluster [DBG] 13.9 deep-scrub starts 2024-09-17T08:55:57.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:55.452327+0000 osd.5 (osd.5) 4 : cluster [DBG] 13.9 deep-scrub ok 2024-09-17T08:55:57.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.674141+0000 mon.c (mon.2) 58 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:55.674274+0000 client.admin (client.?) 0 : cluster [INF] onexx 2024-09-17T08:55:57.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:55.675185+0000 mon.c (mon.2) 59 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.795 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:55.902027+0000 osd.0 (osd.0) 3 : cluster [DBG] 13.3 deep-scrub starts 2024-09-17T08:55:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:55.906063+0000 osd.0 (osd.0) 4 : cluster [DBG] 13.3 deep-scrub ok 2024-09-17T08:55:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.084952+0000 mon.a (mon.0) 973 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.085388+0000 mon.a (mon.0) 974 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.085475+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.087008+0000 mon.a (mon.0) 976 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.090189+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.090415+0000 mon.a (mon.0) 978 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.513409+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.517039+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.520573+0000 mon.c (mon.2) 61 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: cluster 2024-09-17T08:55:56.520770+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-09-17T08:55:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.523057+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.523909+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.524353+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.526930+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.527449+0000 mon.a (mon.0) 985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.528375+0000 mon.a (mon.0) 986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.533509+0000 mon.c (mon.2) 62 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.540225+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.967306+0000 mon.a (mon.0) 987 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.969005+0000 mon.a (mon.0) 988 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi078-64935-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:57 smithi136 bash[24812]: audit 2024-09-17T08:55:56.969321+0000 mon.a (mon.0) 989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.204726+0000 mgr.y (mgr.14532) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.205579+0000 mgr.y (mgr.14532) 159 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.206278+0000 mgr.y (mgr.14532) 160 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.206968+0000 mgr.y (mgr.14532) 161 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.207603+0000 mgr.y (mgr.14532) 162 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.208292+0000 mgr.y (mgr.14532) 163 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.209039+0000 mgr.y (mgr.14532) 164 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.209608+0000 mgr.y (mgr.14532) 165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:55:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.210248+0000 mgr.y (mgr.14532) 166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.210909+0000 mgr.y (mgr.14532) 167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:55.281303+0000 osd.4 (osd.4) 3 : cluster [DBG] 13.5 deep-scrub starts 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:55.283957+0000 osd.4 (osd.4) 4 : cluster [DBG] 13.5 deep-scrub ok 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:55.441340+0000 osd.5 (osd.5) 3 : cluster [DBG] 13.9 deep-scrub starts 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:55.452327+0000 osd.5 (osd.5) 4 : cluster [DBG] 13.9 deep-scrub ok 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.674141+0000 mon.c (mon.2) 58 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:55.674274+0000 client.admin (client.?) 0 : cluster [INF] onexx 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:55.675185+0000 mon.c (mon.2) 59 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:55.902027+0000 osd.0 (osd.0) 3 : cluster [DBG] 13.3 deep-scrub starts 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:55.906063+0000 osd.0 (osd.0) 4 : cluster [DBG] 13.3 deep-scrub ok 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.084952+0000 mon.a (mon.0) 973 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:57.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.085388+0000 mon.a (mon.0) 974 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.204726+0000 mgr.y (mgr.14532) 158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.205579+0000 mgr.y (mgr.14532) 159 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.206278+0000 mgr.y (mgr.14532) 160 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.206968+0000 mgr.y (mgr.14532) 161 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.207603+0000 mgr.y (mgr.14532) 162 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.208292+0000 mgr.y (mgr.14532) 163 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.209039+0000 mgr.y (mgr.14532) 164 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.209608+0000 mgr.y (mgr.14532) 165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.210248+0000 mgr.y (mgr.14532) 166 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:55:57.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.210909+0000 mgr.y (mgr.14532) 167 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:55.281303+0000 osd.4 (osd.4) 3 : cluster [DBG] 13.5 deep-scrub starts 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:55.283957+0000 osd.4 (osd.4) 4 : cluster [DBG] 13.5 deep-scrub ok 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:55.441340+0000 osd.5 (osd.5) 3 : cluster [DBG] 13.9 deep-scrub starts 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:55.452327+0000 osd.5 (osd.5) 4 : cluster [DBG] 13.9 deep-scrub ok 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.674141+0000 mon.c (mon.2) 58 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:55.674274+0000 client.admin (client.?) 0 : cluster [INF] onexx 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:55.675185+0000 mon.c (mon.2) 59 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:55.902027+0000 osd.0 (osd.0) 3 : cluster [DBG] 13.3 deep-scrub starts 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:55.906063+0000 osd.0 (osd.0) 4 : cluster [DBG] 13.3 deep-scrub ok 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.084952+0000 mon.a (mon.0) 973 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:57.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.085388+0000 mon.a (mon.0) 974 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.085475+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.087008+0000 mon.a (mon.0) 976 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.090189+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.090415+0000 mon.a (mon.0) 978 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.513409+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.517039+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.520573+0000 mon.c (mon.2) 61 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: cluster 2024-09-17T08:55:56.520770+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-09-17T08:55:57.857 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.523057+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.523909+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.524353+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.526930+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.527449+0000 mon.a (mon.0) 985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.528375+0000 mon.a (mon.0) 986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.533509+0000 mon.c (mon.2) 62 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.085475+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.087008+0000 mon.a (mon.0) 976 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:57.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.090189+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.090415+0000 mon.a (mon.0) 978 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.513409+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.517039+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.520573+0000 mon.c (mon.2) 61 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: cluster 2024-09-17T08:55:56.520770+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.523057+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.523909+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.524353+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.526930+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.527449+0000 mon.a (mon.0) 985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.528375+0000 mon.a (mon.0) 986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:57.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.533509+0000 mon.c (mon.2) 62 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.860 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.540225+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.860 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.967306+0000 mon.a (mon.0) 987 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.860 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.969005+0000 mon.a (mon.0) 988 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi078-64935-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.860 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22670]: audit 2024-09-17T08:55:56.969321+0000 mon.a (mon.0) 989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.860 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.540225+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.860 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.967306+0000 mon.a (mon.0) 987 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.860 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.969005+0000 mon.a (mon.0) 988 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi078-64935-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:57.861 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[32124]: audit 2024-09-17T08:55:56.969321+0000 mon.a (mon.0) 989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:55:58.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:55:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:55:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:55:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: cluster 2024-09-17T08:55:56.776201+0000 mgr.y (mgr.14532) 168 : cluster [DBG] pgmap v112: 588 pgs: 36 creating+peering, 164 unknown, 388 active+clean; 600 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 65 KiB/s wr, 346 op/s 2024-09-17T08:55:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.414066+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-17T08:55:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.415263+0000 mon.a (mon.0) 991 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.416021+0000 mon.c (mon.2) 63 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.421598+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi078-64696-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.421983+0000 mon.a (mon.0) 993 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.422078+0000 mon.a (mon.0) 994 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.422163+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.422345+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.422852+0000 mon.a (mon.0) 996 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.422968+0000 mon.a (mon.0) 997 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi078-64935-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.423063+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.423176+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-09-17T08:55:59.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.423928+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.425244+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.435018+0000 mon.c (mon.2) 66 : audit [INF] from='client.? 172.21.15.78:0/1691654106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.436710+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.443144+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.443399+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi078-64733-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.444505+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.445262+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.875172+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi078-64704-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:57.875512+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi078-64935-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:59.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:58.302526+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:59.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:58.303234+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:58.303492+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-17T08:55:59.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:58.303952+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:55:58 smithi136 bash[24812]: audit 2024-09-17T08:55:58.304866+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: cluster 2024-09-17T08:55:56.776201+0000 mgr.y (mgr.14532) 168 : cluster [DBG] pgmap v112: 588 pgs: 36 creating+peering, 164 unknown, 388 active+clean; 600 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 65 KiB/s wr, 346 op/s 2024-09-17T08:55:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.414066+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.415263+0000 mon.a (mon.0) 991 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.416021+0000 mon.c (mon.2) 63 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.421598+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi078-64696-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.421983+0000 mon.a (mon.0) 993 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.422078+0000 mon.a (mon.0) 994 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.422163+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.422345+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.422852+0000 mon.a (mon.0) 996 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.422968+0000 mon.a (mon.0) 997 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi078-64935-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.423063+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.423176+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-09-17T08:55:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.423928+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:59.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: cluster 2024-09-17T08:55:56.776201+0000 mgr.y (mgr.14532) 168 : cluster [DBG] pgmap v112: 588 pgs: 36 creating+peering, 164 unknown, 388 active+clean; 600 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 65 KiB/s wr, 346 op/s 2024-09-17T08:55:59.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.414066+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-17T08:55:59.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.415263+0000 mon.a (mon.0) 991 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:55:59.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.416021+0000 mon.c (mon.2) 63 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-17T08:55:59.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.421598+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi078-64696-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:55:59.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.421983+0000 mon.a (mon.0) 993 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.422078+0000 mon.a (mon.0) 994 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.422163+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.422345+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.422852+0000 mon.a (mon.0) 996 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.422968+0000 mon.a (mon.0) 997 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi078-64935-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.423063+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.423176+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.423928+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.425244+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-17T08:55:59.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.435018+0000 mon.c (mon.2) 66 : audit [INF] from='client.? 172.21.15.78:0/1691654106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.436710+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.443144+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.443399+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi078-64733-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.444505+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.445262+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.875172+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi078-64704-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:57.875512+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi078-64935-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:58.302526+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:59.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:58.303234+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:58.303492+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:58.303952+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[22670]: audit 2024-09-17T08:55:58.304866+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.425244+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.78:0/3577819260' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.435018+0000 mon.c (mon.2) 66 : audit [INF] from='client.? 172.21.15.78:0/1691654106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.436710+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.443144+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.443399+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi078-64733-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.444505+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.445262+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.875172+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi078-64704-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:57.875512+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi078-64935-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:58.302526+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:58.303234+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:58.303492+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-17T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:58.303952+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:55:58 smithi078 bash[32124]: audit 2024-09-17T08:55:58.304866+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:55:59.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:55:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:56:00.437 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_1_[65243]: starting. 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_1_[65243]: creating pool ceph_test_rados_open_pools_parallel.smithi078-65184 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_1_[65243]: created object 0... 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_1_[65243]: created object 25... 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_1_[65243]: created object 49... 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_1_[65243]: finishing. 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_1_[65243]: shutting down. 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_2_[65244]: starting. 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_2_[65244]: rados_pool_create. 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_2_[65244]: rados_ioctx_create. 2024-09-17T08:56:00.438 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_2_[65244]: shutting down. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: ******************************* 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_3_[66222]: starting. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_3_[66222]: creating pool ceph_test_rados_open_pools_parallel.smithi078-65184 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_3_[66222]: created object 0... 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_3_[66222]: created object 25... 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_3_[66222]: created object 49... 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_3_[66222]: finishing. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_3_[66222]: shutting down. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: ******************************* 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_4_[66223]: starting. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_4_[66223]: rados_pool_create. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_4_[66223]: rados_ioctx_create. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: process_4_[66223]: shutting down. 2024-09-17T08:56:00.439 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: ******************************* 2024-09-17T08:56:00.440 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: ******************************* 2024-09-17T08:56:00.440 INFO:tasks.workunit.client.0.smithi078.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-09-17T08:56:00.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:00 smithi136 bash[24812]: audit 2024-09-17T08:55:58.738441+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:00.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:00 smithi136 bash[24812]: audit 2024-09-17T08:55:58.743726+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-17T08:56:00.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:00 smithi136 bash[24812]: audit 2024-09-17T08:55:58.744952+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:00.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:00 smithi078 bash[32124]: audit 2024-09-17T08:55:58.738441+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:00.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:00 smithi078 bash[32124]: audit 2024-09-17T08:55:58.743726+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-17T08:56:00.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:00 smithi078 bash[32124]: audit 2024-09-17T08:55:58.744952+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:00.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:00 smithi078 bash[22670]: audit 2024-09-17T08:55:58.738441+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:00.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:00 smithi078 bash[22670]: audit 2024-09-17T08:55:58.743726+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-17T08:56:00.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:00 smithi078 bash[22670]: audit 2024-09-17T08:55:58.744952+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:00.877 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_1_[65237]: starting. 2024-09-17T08:56:00.877 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_1_[65237]: creating pool ceph_test_rados_delete_pools_parallel.smithi078-65197 2024-09-17T08:56:00.877 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_1_[65237]: created object 0... 2024-09-17T08:56:00.877 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_1_[65237]: created object 25... 2024-09-17T08:56:00.877 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_1_[65237]: created object 49... 2024-09-17T08:56:00.877 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_1_[65237]: finishing. 2024-09-17T08:56:00.877 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_1_[65237]: shutting down. 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_2_[65238]: starting. 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_2_[65238]: deleting pool ceph_test_rados_delete_pools_parallel.smithi078-65197 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_2_[65238]: shutting down. 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: ******************************* 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_3_[66224]: starting. 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_3_[66224]: creating pool ceph_test_rados_delete_pools_parallel.smithi078-65197 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_3_[66224]: created object 0... 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_3_[66224]: created object 25... 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_3_[66224]: created object 49... 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_3_[66224]: finishing. 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_3_[66224]: shutting down. 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: ******************************* 2024-09-17T08:56:00.878 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_5_[66226]: starting. 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_5_[66226]: listing objects. 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_5_[66226]: listed object 0... 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_5_[66226]: listed object 25... 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_5_[66226]: saw 50 objects 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_5_[66226]: shutting down. 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: ******************************* 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_4_[66225]: starting. 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_4_[66225]: deleting pool ceph_test_rados_delete_pools_parallel.smithi078-65197 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: process_4_[66225]: shutting down. 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: ******************************* 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: ******************************* 2024-09-17T08:56:00.879 INFO:tasks.workunit.client.0.smithi078.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: Running main() from gmock_main.cc 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [----------] Global test environment set-up. 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: seed 64704 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-17T08:56:01.248 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (124 ms) 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (26 ms) 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (1066 ms) 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (6 ms) 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (40 ms) 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (6 ms) 2024-09-17T08:56:01.249 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (4 ms) 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (9 ms) 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (12 ms) 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (3 ms) 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (8 ms) 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (12 ms) 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (9 ms) 2024-09-17T08:56:01.250 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (7 ms) 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (28 ms) 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (9 ms) 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (5 ms) 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (4 ms) 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (7 ms) 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (1385 ms total) 2024-09-17T08:56:01.251 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (337 ms) 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (18 ms) 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (4 ms) 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (5 ms) 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-17T08:56:01.252 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (6 ms) 2024-09-17T08:56:01.607 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ilure-domain=osd"]}]: dispatch 2024-09-17T08:56:01.607 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.523909+0000 mon.a [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:01.607 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.524353+0000 mon.a [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:56:01.607 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.526930+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi078-64688-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.527449+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.528375+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.533509+0000 mon.c [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.540225+0000 mon.b [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.967306+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi078-64728-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.969005+0000 mon.a [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi078-64935-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:56.969321+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:58.743726+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:58.744952+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:55:59.170967+0000 mon.c [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:01.608 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.023794+0000 mon.b [INF] from='client.? 172.21.15.78:0/727021767' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.424242+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.424341+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.424418+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.424514+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.426265+0000 mon.c [INF] from='client.? 172.21.15.78:0/502876506' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.428425+0000 mon.b [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.429904+0000 mon.b [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.448019+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.448201+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.449784+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.449894+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:01.609 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.454273+0000 mon.a [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi078-64733-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:01.610 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.454361+0000 mon.a [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi078-64704-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:01.610 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.454442+0000 mon.a [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi078-64935-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:01.610 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.454505+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.166551+0000 osd.6 (osd.6) 3 : cluster [DBG] 13.1 deep-scrub starts 2024-09-17T08:56:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.170771+0000 osd.6 (osd.6) 4 : cluster [DBG] 13.1 deep-scrub ok 2024-09-17T08:56:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.243923+0000 osd.4 (osd.4) 5 : cluster [DBG] 13.6 deep-scrub starts 2024-09-17T08:56:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.246857+0000 osd.4 (osd.4) 6 : cluster [DBG] 13.6 deep-scrub ok 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.491422+0000 osd.5 (osd.5) 5 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.989932+0000 osd.7 (osd.7) 3 : cluster [DBG] 13.0 deep-scrub starts 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:57.994428+0000 osd.7 (osd.7) 4 : cluster [DBG] 13.0 deep-scrub ok 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:58.167427+0000 osd.6 (osd.6) 5 : cluster [DBG] 13.4 deep-scrub starts 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:58.170384+0000 osd.6 (osd.6) 6 : cluster [DBG] 13.4 deep-scrub ok 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:55:58.777729+0000 mgr.y (mgr.14532) 169 : cluster [DBG] pgmap v115: 652 pgs: 72 creating+peering, 1 active+clean+scrubbing+deep, 96 unknown, 483 active+clean; 145 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 175 op/s 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:55:59.170967+0000 mon.c (mon.2) 67 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:55:59.284214+0000 mgr.y (mgr.14532) 170 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.023794+0000 mon.b (mon.1) 49 : audit [INF] from='client.? 172.21.15.78:0/727021767' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.424242+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.424341+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-17T08:56:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.424418+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.424514+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:02.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.426265+0000 mon.c (mon.2) 68 : audit [INF] from='client.? 172.21.15.78:0/502876506' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:56:00.426894+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-09-17T08:56:02.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.428425+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:02.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.429904+0000 mon.b (mon.1) 51 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.432836+0000 mon.a (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:02.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.448019+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.448201+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.449784+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.449894+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.454273+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi078-64733-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.454361+0000 mon.a (mon.0) 1023 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi078-64704-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.454442+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi078-64935-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.454505+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.748609+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:56:00.748897+0000 client.admin (client.?) 0 : cluster [INF] threexx 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:56:00.779000+0000 mgr.y (mgr.14532) 171 : cluster [DBG] pgmap v117: 652 pgs: 72 creating+peering, 1 active+clean+scrubbing+deep, 128 unknown, 451 active+clean; 145 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 32 MiB/s wr, 142 op/s 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:56:00.874956+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.876596+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:00.878282+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:56:01.079474+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.096170+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.096715+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.096968+0000 mon.a (mon.0) 1032 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.097904+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.098143+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.098354+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: cluster 2024-09-17T08:56:01.098924+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.102050+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.106610+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:01 smithi136 bash[24812]: audit 2024-09-17T08:56:01.117946+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.166551+0000 osd.6 (osd.6) 3 : cluster [DBG] 13.1 deep-scrub starts 2024-09-17T08:56:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.170771+0000 osd.6 (osd.6) 4 : cluster [DBG] 13.1 deep-scrub ok 2024-09-17T08:56:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.243923+0000 osd.4 (osd.4) 5 : cluster [DBG] 13.6 deep-scrub starts 2024-09-17T08:56:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.246857+0000 osd.4 (osd.4) 6 : cluster [DBG] 13.6 deep-scrub ok 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.491422+0000 osd.5 (osd.5) 5 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.989932+0000 osd.7 (osd.7) 3 : cluster [DBG] 13.0 deep-scrub starts 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:57.994428+0000 osd.7 (osd.7) 4 : cluster [DBG] 13.0 deep-scrub ok 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:58.167427+0000 osd.6 (osd.6) 5 : cluster [DBG] 13.4 deep-scrub starts 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:58.170384+0000 osd.6 (osd.6) 6 : cluster [DBG] 13.4 deep-scrub ok 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:55:58.777729+0000 mgr.y (mgr.14532) 169 : cluster [DBG] pgmap v115: 652 pgs: 72 creating+peering, 1 active+clean+scrubbing+deep, 96 unknown, 483 active+clean; 145 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 175 op/s 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:55:59.170967+0000 mon.c (mon.2) 67 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:55:59.284214+0000 mgr.y (mgr.14532) 170 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.023794+0000 mon.b (mon.1) 49 : audit [INF] from='client.? 172.21.15.78:0/727021767' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.424242+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.424341+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-17T08:56:02.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.424418+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.424514+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.426265+0000 mon.c (mon.2) 68 : audit [INF] from='client.? 172.21.15.78:0/502876506' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:56:00.426894+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.428425+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.429904+0000 mon.b (mon.1) 51 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.432836+0000 mon.a (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.448019+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.448201+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.449784+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.449894+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.454273+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi078-64733-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.454361+0000 mon.a (mon.0) 1023 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi078-64704-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:02.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.454442+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi078-64935-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:02.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.454505+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:02.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.748609+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-17T08:56:02.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:56:00.748897+0000 client.admin (client.?) 0 : cluster [INF] threexx 2024-09-17T08:56:02.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:56:00.779000+0000 mgr.y (mgr.14532) 171 : cluster [DBG] pgmap v117: 652 pgs: 72 creating+peering, 1 active+clean+scrubbing+deep, 128 unknown, 451 active+clean; 145 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 32 MiB/s wr, 142 op/s 2024-09-17T08:56:02.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.166551+0000 osd.6 (osd.6) 3 : cluster [DBG] 13.1 deep-scrub starts 2024-09-17T08:56:02.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.170771+0000 osd.6 (osd.6) 4 : cluster [DBG] 13.1 deep-scrub ok 2024-09-17T08:56:02.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.243923+0000 osd.4 (osd.4) 5 : cluster [DBG] 13.6 deep-scrub starts 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.246857+0000 osd.4 (osd.4) 6 : cluster [DBG] 13.6 deep-scrub ok 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.491422+0000 osd.5 (osd.5) 5 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.989932+0000 osd.7 (osd.7) 3 : cluster [DBG] 13.0 deep-scrub starts 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:57.994428+0000 osd.7 (osd.7) 4 : cluster [DBG] 13.0 deep-scrub ok 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:58.167427+0000 osd.6 (osd.6) 5 : cluster [DBG] 13.4 deep-scrub starts 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:58.170384+0000 osd.6 (osd.6) 6 : cluster [DBG] 13.4 deep-scrub ok 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:55:58.777729+0000 mgr.y (mgr.14532) 169 : cluster [DBG] pgmap v115: 652 pgs: 72 creating+peering, 1 active+clean+scrubbing+deep, 96 unknown, 483 active+clean; 145 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 175 op/s 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:55:59.170967+0000 mon.c (mon.2) 67 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:55:59.284214+0000 mgr.y (mgr.14532) 170 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.023794+0000 mon.b (mon.1) 49 : audit [INF] from='client.? 172.21.15.78:0/727021767' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.424242+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.424341+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi078-64688-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.424418+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.107 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.424514+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.426265+0000 mon.c (mon.2) 68 : audit [INF] from='client.? 172.21.15.78:0/502876506' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:56:00.426894+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.428425+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.78:0/1820703542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.429904+0000 mon.b (mon.1) 51 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.432836+0000 mon.a (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.448019+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.448201+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.449784+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.449894+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]: dispatch 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.454273+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi078-64733-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.454361+0000 mon.a (mon.0) 1023 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi078-64704-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.454442+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi078-64935-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:02.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.454505+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi078-64728-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.748609+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:56:00.748897+0000 client.admin (client.?) 0 : cluster [INF] threexx 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:56:00.779000+0000 mgr.y (mgr.14532) 171 : cluster [DBG] pgmap v117: 652 pgs: 72 creating+peering, 1 active+clean+scrubbing+deep, 128 unknown, 451 active+clean; 145 MiB data, 712 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 32 MiB/s wr, 142 op/s 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:56:00.874956+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.876596+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:00.878282+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:56:01.079474+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.096170+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.096715+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.096968+0000 mon.a (mon.0) 1032 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.097904+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.098143+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:02.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.098354+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:02.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: cluster 2024-09-17T08:56:01.098924+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-09-17T08:56:02.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.102050+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:56:02.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.106610+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[32124]: audit 2024-09-17T08:56:01.117946+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.110 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:56:00.874956+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-09-17T08:56:02.110 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.876596+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.110 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:00.878282+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-17T08:56:02.111 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:56:01.079474+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:02.111 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.096170+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:02.111 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.096715+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.111 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.096968+0000 mon.a (mon.0) 1032 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.111 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.097904+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:02.111 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.098143+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:02.111 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.098354+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:02.112 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: cluster 2024-09-17T08:56:01.098924+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-09-17T08:56:02.112 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.102050+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:56:02.112 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.106610+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:02.112 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:01 smithi078 bash[22670]: audit 2024-09-17T08:56:01.117946+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:03.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: cluster 2024-09-17T08:56:00.989627+0000 osd.7 (osd.7) 5 : cluster [DBG] 13.7 deep-scrub starts 2024-09-17T08:56:03.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: cluster 2024-09-17T08:56:00.992905+0000 osd.7 (osd.7) 6 : cluster [DBG] 13.7 deep-scrub ok 2024-09-17T08:56:03.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.158804+0000 mon.c (mon.2) 70 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.237035+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.240104+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.604563+0000 mon.a (mon.0) 1039 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.605456+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.613419+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.615939+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.616769+0000 mon.c (mon.2) 74 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: cluster 2024-09-17T08:56:01.616995+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.623647+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.623999+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.624349+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-17T08:56:03.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.624618+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:03.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:01.625131+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:03.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.101344+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:56:03.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.101862+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:03.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.102965+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.103738+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: cluster 2024-09-17T08:56:02.104780+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.106446+0000 mon.c (mon.2) 76 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.106706+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.107209+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.108090+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2"}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.109068+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.113884+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.114695+0000 mon.a (mon.0) 1053 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.115455+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.116208+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.116437+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:56:03.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.118103+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]: dispatch 2024-09-17T08:56:03.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.118767+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]: dispatch 2024-09-17T08:56:03.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:03 smithi136 bash[24812]: audit 2024-09-17T08:56:02.126080+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? 172.21.15.78:0/636772357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: cluster 2024-09-17T08:56:00.989627+0000 osd.7 (osd.7) 5 : cluster [DBG] 13.7 deep-scrub starts 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: cluster 2024-09-17T08:56:00.992905+0000 osd.7 (osd.7) 6 : cluster [DBG] 13.7 deep-scrub ok 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.158804+0000 mon.c (mon.2) 70 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.237035+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.240104+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.604563+0000 mon.a (mon.0) 1039 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.605456+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.613419+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.615939+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-17T08:56:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.616769+0000 mon.c (mon.2) 74 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: cluster 2024-09-17T08:56:01.616995+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.623647+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.623999+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.624349+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.624618+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:01.625131+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: cluster 2024-09-17T08:56:00.989627+0000 osd.7 (osd.7) 5 : cluster [DBG] 13.7 deep-scrub starts 2024-09-17T08:56:03.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: cluster 2024-09-17T08:56:00.992905+0000 osd.7 (osd.7) 6 : cluster [DBG] 13.7 deep-scrub ok 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.158804+0000 mon.c (mon.2) 70 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.237035+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.240104+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.604563+0000 mon.a (mon.0) 1039 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.605456+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.613419+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.615939+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.616769+0000 mon.c (mon.2) 74 : audit [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: cluster 2024-09-17T08:56:01.616995+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.623647+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.623999+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.624349+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-17T08:56:03.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.624618+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:01.625131+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.101344+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.101862+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.102965+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.103738+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: cluster 2024-09-17T08:56:02.104780+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.106446+0000 mon.c (mon.2) 76 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.106706+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.107209+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:56:03.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.108090+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2"}]: dispatch 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.109068+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.113884+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.114695+0000 mon.a (mon.0) 1053 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.115455+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.116208+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.101344+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.101862+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.102965+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:03.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.103738+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: cluster 2024-09-17T08:56:02.104780+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.106446+0000 mon.c (mon.2) 76 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.106706+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.107209+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.108090+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.109068+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.113884+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.114695+0000 mon.a (mon.0) 1053 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.115455+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.116208+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.116437+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.118103+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.118767+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]: dispatch 2024-09-17T08:56:03.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[32124]: audit 2024-09-17T08:56:02.126080+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? 172.21.15.78:0/636772357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.359 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.116437+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:56:03.359 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.118103+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]: dispatch 2024-09-17T08:56:03.359 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.118767+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]: dispatch 2024-09-17T08:56:03.359 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:03 smithi078 bash[22670]: audit 2024-09-17T08:56:02.126080+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? 172.21.15.78:0/636772357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:03.579 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.748609+0000 mon.c [INF] from='client.? 172.21.15.78:0/3951743712' entity='client.admin' cmd=[{"prefix":"log", "logtext":["t api_io: Running main() from gmock_main.cc 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [----------] Global test environment set-up. 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (138 ms) 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.TooBig (1 ms) 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: no timeout :/ 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: no timeout :/ 2024-09-17T08:56:03.580 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: no timeout :/ 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: no timeout :/ 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: no timeout :/ 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (350 ms) 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (8 ms) 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.Checksum (4 ms) 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (10 ms) 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (4 ms) 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (6 ms) 2024-09-17T08:56:03.581 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.TruncTest (6 ms) 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (3 ms) 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (7 ms) 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.RmXattr (17 ms) 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIo.XattrIter (8 ms) 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [----------] 14 tests from LibRadosIo (565 ms total) 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-09-17T08:56:03.582 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (2668 ms) 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (7 ms) 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (6 ms) 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (6 ms) 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (8 ms) 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (5 ms) 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (4 ms) 2024-09-17T08:56:03.583 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (3 ms) 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (10 ms) 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (4 ms) 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [----------] 10 tests from LibRadosIoEC (2721 ms total) 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [----------] Global test environment tear-down 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [==========] 24 tests from 2 test suites ran. (23917 ms total) 2024-09-17T08:56:03.584 INFO:tasks.workunit.client.0.smithi078.stdout: api_io: [ PASSED ] 24 tests. 2024-09-17T08:56:04.161 INFO:tasks.workunit.client.0.smithi078.stdout: ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (4 ms) 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (6 ms) 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5 ms) 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (7 ms) 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (2 ms) 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-17T08:56:04.162 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (9 ms) 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4 ms) 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (9 ms) 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (5 ms) 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (7 ms) 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (434 ms total) 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [----------] Global test environment tear-down 2024-09-17T08:56:04.163 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (24497 ms total) 2024-09-17T08:56:04.164 INFO:tasks.workunit.client.0.smithi078.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: Running main() from gmock_main.cc 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [----------] Global test environment set-up. 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStat.Stat (1191 ms) 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (75 ms) 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStat.StatNS (19 ms) 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (10 ms) 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-09-17T08:56:04.166 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (6 ms) 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [----------] 5 tests from LibRadosStat (1301 ms total) 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (339 ms) 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (12 ms) 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (374 ms) 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (11 ms) 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (736 ms total) 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: 2024-09-17T08:56:04.167 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [----------] Global test environment tear-down 2024-09-17T08:56:04.168 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (24389 ms total) 2024-09-17T08:56:04.168 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat: [ PASSED ] 9 tests. 2024-09-17T08:56:04.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: cluster 2024-09-17T08:56:01.501934+0000 osd.5 (osd.5) 6 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:04.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: cluster 2024-09-17T08:56:01.506655+0000 osd.5 (osd.5) 7 : cluster [DBG] 13.2 deep-scrub ok 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: cluster 2024-09-17T08:56:02.782440+0000 mgr.y (mgr.14532) 172 : cluster [DBG] pgmap v120: 572 pgs: 63 creating+peering, 20 unknown, 489 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:02.998480+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.016142+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: cluster 2024-09-17T08:56:03.095231+0000 mon.a (mon.0) 1061 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.114948+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.115192+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.192393+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]: dispatch 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.568616+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.568717+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.568773+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:04.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.568836+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]': finished 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.568887+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? 172.21.15.78:0/636772357' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: cluster 2024-09-17T08:56:03.569154+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.571445+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.572120+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.78:0/3237739769' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.572656+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.572814+0000 mon.a (mon.0) 1070 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.573350+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.573474+0000 mon.b (mon.1) 54 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.575515+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.78:0/714457582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:04.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:04 smithi136 bash[24812]: audit 2024-09-17T08:56:03.584778+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]: dispatch 2024-09-17T08:56:04.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: cluster 2024-09-17T08:56:01.501934+0000 osd.5 (osd.5) 6 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: cluster 2024-09-17T08:56:01.506655+0000 osd.5 (osd.5) 7 : cluster [DBG] 13.2 deep-scrub ok 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: cluster 2024-09-17T08:56:02.782440+0000 mgr.y (mgr.14532) 172 : cluster [DBG] pgmap v120: 572 pgs: 63 creating+peering, 20 unknown, 489 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:02.998480+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.016142+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: cluster 2024-09-17T08:56:03.095231+0000 mon.a (mon.0) 1061 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.114948+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.115192+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.192393+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]: dispatch 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.568616+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.568717+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.568773+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.568836+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]': finished 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.568887+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? 172.21.15.78:0/636772357' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: cluster 2024-09-17T08:56:03.569154+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.571445+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: cluster 2024-09-17T08:56:01.501934+0000 osd.5 (osd.5) 6 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: cluster 2024-09-17T08:56:01.506655+0000 osd.5 (osd.5) 7 : cluster [DBG] 13.2 deep-scrub ok 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: cluster 2024-09-17T08:56:02.782440+0000 mgr.y (mgr.14532) 172 : cluster [DBG] pgmap v120: 572 pgs: 63 creating+peering, 20 unknown, 489 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:02.998480+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:04.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.016142+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: cluster 2024-09-17T08:56:03.095231+0000 mon.a (mon.0) 1061 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.114948+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi078-64696-16"}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.115192+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.192393+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]: dispatch 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.568616+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.568717+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.568773+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.568836+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-4-cache", "mode": "writeback"}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.568887+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? 172.21.15.78:0/636772357' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: cluster 2024-09-17T08:56:03.569154+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-09-17T08:56:04.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.571445+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.572120+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.78:0/3237739769' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.572656+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.572814+0000 mon.a (mon.0) 1070 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.573350+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.573474+0000 mon.b (mon.1) 54 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.575515+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.78:0/714457582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[22670]: audit 2024-09-17T08:56:03.584778+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.572120+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.78:0/3237739769' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.572656+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.572814+0000 mon.a (mon.0) 1070 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]: dispatch 2024-09-17T08:56:04.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.573350+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]: dispatch 2024-09-17T08:56:04.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.573474+0000 mon.b (mon.1) 54 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:04.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.575515+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.78:0/714457582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:04.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:04 smithi078 bash[32124]: audit 2024-09-17T08:56:03.584778+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]: dispatch 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout:hreexx"]}]: dispatch 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.748897+0000 client.admin [INF] threexx 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.876596+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:00.878282+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.079474+0000 mon.a [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.096170+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi078-64969-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.096715+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi078-64804-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.096968+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi078-64680-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.097904+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.023 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.098143+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi078-64991-1"}]': finished 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.098354+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.102050+0000 mon.a [INF] from='client.? 172.21.15.78:0/3623185798' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi078-64696-16"}]: dispatch 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.106610+0000 mon.b [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: got: 2024-09-17T08:56:01.117946+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-4", "overlaypool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (10280 ms) 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (25209 ms total) 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [----------] Global test environment tear-down 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (25209 ms total) 2024-09-17T08:56:05.024 INFO:tasks.workunit.client.0.smithi078.stdout: api_cmd: [ PASSED ] 4 tests. 2024-09-17T08:56:05.141 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-09-17T08:56:05.141 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-09-17T08:56:05.141 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-09-17T08:56:05.141 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-09-17T08:56:05.141 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: seed 64969 2024-09-17T08:56:05.141 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (1254 ms) 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (4 ms) 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (4 ms) 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (6 ms) 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (12 ms) 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (1280 ms total) 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-09-17T08:56:05.142 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1079 ms) 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (2 ms) 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (7 ms) 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1089 ms total) 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (25332 ms total) 2024-09-17T08:56:05.143 INFO:tasks.workunit.client.0.smithi078.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-09-17T08:56:05.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:03.602467+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]: dispatch 2024-09-17T08:56:05.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.022272+0000 mon.a (mon.0) 1074 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:05.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.022655+0000 mon.a (mon.0) 1075 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:05.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.022903+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.023882+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.024061+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]: dispatch 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.115299+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.115863+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.116029+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.116301+0000 mon.a (mon.0) 1082 : audit [INF] from='client.? 172.21.15.78:0/714457582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.116765+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.116962+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.117129+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.117353+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.117569+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]': finished 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: cluster 2024-09-17T08:56:04.117715+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-09-17T08:56:05.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.121009+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.122724+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.124224+0000 mon.b (mon.1) 56 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.124589+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.127293+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.132166+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.133620+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.134337+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.134796+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.135096+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:04.135649+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:05 smithi136 bash[24812]: audit 2024-09-17T08:56:05.023588+0000 mon.a (mon.0) 1095 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:05.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:03.602467+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]: dispatch 2024-09-17T08:56:05.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.022272+0000 mon.a (mon.0) 1074 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.022655+0000 mon.a (mon.0) 1075 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.022903+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.023882+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.024061+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]: dispatch 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.115299+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.115863+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.116029+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.116301+0000 mon.a (mon.0) 1082 : audit [INF] from='client.? 172.21.15.78:0/714457582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.116765+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]': finished 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.116962+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.117129+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-17T08:56:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.117353+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:03.602467+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]: dispatch 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.022272+0000 mon.a (mon.0) 1074 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.022655+0000 mon.a (mon.0) 1075 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.022903+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.023882+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.024061+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]: dispatch 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.115299+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi078-64983-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.115863+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.78:0/2372643626' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi078-64704-22"}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.116029+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.78:0/1831723837' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi078-64935-7"}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.116301+0000 mon.a (mon.0) 1082 : audit [INF] from='client.? 172.21.15.78:0/714457582' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.116765+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64991-6", "pg_num": 4}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.116962+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi078-64680-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.117129+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.117353+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.117569+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]': finished 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: cluster 2024-09-17T08:56:04.117715+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-09-17T08:56:05.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.121009+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.122724+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.124224+0000 mon.b (mon.1) 56 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.124589+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.127293+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.132166+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.133620+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.134337+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.134796+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.135096+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:04.135649+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[22670]: audit 2024-09-17T08:56:05.023588+0000 mon.a (mon.0) 1095 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:05.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.117569+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-4"}]': finished 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: cluster 2024-09-17T08:56:04.117715+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.121009+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.122724+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.124224+0000 mon.b (mon.1) 56 : audit [INF] from='client.? 172.21.15.78:0/2410648386' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.124589+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.127293+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.78:0/2187429768' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.132166+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.133620+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.134337+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.134796+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:05.357 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.135096+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]: dispatch 2024-09-17T08:56:05.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:04.135649+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:05.358 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:05 smithi078 bash[32124]: audit 2024-09-17T08:56:05.023588+0000 mon.a (mon.0) 1095 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:06.573 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: Running main() from gmock_main.cc 2024-09-17T08:56:06.573 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-09-17T08:56:06.573 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [----------] Global test environment set-up. 2024-09-17T08:56:06.573 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (222 ms) 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.LockShared (13 ms) 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1008 ms) 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1009 ms) 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (8 ms) 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.Unlock (11 ms) 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (11 ms) 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-09-17T08:56:06.574 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (7 ms) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [----------] 8 tests from LibRadosLock (2289 ms total) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (763 ms) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (10 ms) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1056 ms) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1009 ms) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (8 ms) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (8 ms) 2024-09-17T08:56:06.575 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (14 ms) 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (7 ms) 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (2876 ms total) 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [----------] Global test environment tear-down 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (26884 ms total) 2024-09-17T08:56:06.576 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock: [ PASSED ] 16 tests. 2024-09-17T08:56:06.587 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-09-17T08:56:06.587 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-09-17T08:56:06.587 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-09-17T08:56:06.587 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: seed 64733 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (1286 ms) 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (5 ms) 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1010 ms) 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1009 ms) 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (9 ms) 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (10 ms) 2024-09-17T08:56:06.588 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (10 ms) 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (8 ms) 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (3347 ms total) 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (348 ms) 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (4 ms) 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1043 ms) 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-17T08:56:06.589 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1020 ms) 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (9 ms) 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (12 ms) 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (12 ms) 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (7 ms) 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (2455 ms total) 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (26897 ms total) 2024-09-17T08:56:06.590 INFO:tasks.workunit.client.0.smithi078.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-09-17T08:56:06.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: cluster 2024-09-17T08:56:04.783613+0000 mgr.y (mgr.14532) 173 : cluster [DBG] pgmap v123: 592 pgs: 32 creating+peering, 76 unknown, 484 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-17T08:56:06.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: cluster 2024-09-17T08:56:05.108946+0000 mon.a (mon.0) 1096 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:06.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.118309+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:06.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.118624+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.118854+0000 mon.a (mon.0) 1099 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.119240+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.119449+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.119809+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: cluster 2024-09-17T08:56:05.120520+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.131523+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.133612+0000 mon.c (mon.2) 88 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.135822+0000 mon.a (mon.0) 1104 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.137629+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.138599+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.139010+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.142462+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:06.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:06 smithi136 bash[24812]: audit 2024-09-17T08:56:05.148033+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? 172.21.15.78:0/2327200038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: cluster 2024-09-17T08:56:04.783613+0000 mgr.y (mgr.14532) 173 : cluster [DBG] pgmap v123: 592 pgs: 32 creating+peering, 76 unknown, 484 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-17T08:56:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: cluster 2024-09-17T08:56:05.108946+0000 mon.a (mon.0) 1096 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.118309+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.118624+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.118854+0000 mon.a (mon.0) 1099 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.119240+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.119449+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.119809+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: cluster 2024-09-17T08:56:05.120520+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.131523+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.133612+0000 mon.c (mon.2) 88 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.135822+0000 mon.a (mon.0) 1104 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.137629+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.138599+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.139010+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.142462+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[22670]: audit 2024-09-17T08:56:05.148033+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? 172.21.15.78:0/2327200038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: cluster 2024-09-17T08:56:04.783613+0000 mgr.y (mgr.14532) 173 : cluster [DBG] pgmap v123: 592 pgs: 32 creating+peering, 76 unknown, 484 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: cluster 2024-09-17T08:56:05.108946+0000 mon.a (mon.0) 1096 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.118309+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi078-64969-7"}]': finished 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.118624+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.118854+0000 mon.a (mon.0) 1099 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.119240+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.119449+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-4", "tierpool": "test-rados-api-smithi078-64852-4-cache"}]': finished 2024-09-17T08:56:06.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.119809+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: cluster 2024-09-17T08:56:05.120520+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.131523+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.133612+0000 mon.c (mon.2) 88 : audit [INF] from='client.? 172.21.15.78:0/393178308' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.135822+0000 mon.a (mon.0) 1104 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]: dispatch 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.137629+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.78:0/3141340196' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.138599+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.139010+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.142462+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]: dispatch 2024-09-17T08:56:06.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:06 smithi078 bash[32124]: audit 2024-09-17T08:56:05.148033+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? 172.21.15.78:0/2327200038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: cluster 2024-09-17T08:56:05.576996+0000 osd.2 (osd.2) 3 : cluster [DBG] 13.8 deep-scrub starts 2024-09-17T08:56:07.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: cluster 2024-09-17T08:56:05.581274+0000 osd.2 (osd.2) 4 : cluster [DBG] 13.8 deep-scrub ok 2024-09-17T08:56:07.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.080191+0000 mon.a (mon.0) 1109 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:07.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: cluster 2024-09-17T08:56:06.515408+0000 mon.a (mon.0) 1110 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:07.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: cluster 2024-09-17T08:56:06.515945+0000 mon.a (mon.0) 1111 : cluster [WRN] pool 'PoolQuotaPP_smithi078-64688-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: cluster 2024-09-17T08:56:06.519267+0000 mon.a (mon.0) 1112 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.535411+0000 mon.a (mon.0) 1113 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.535567+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]': finished 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.535638+0000 mon.a (mon.0) 1115 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]': finished 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.535717+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.535794+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? 172.21.15.78:0/2327200038' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: cluster 2024-09-17T08:56:06.535985+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.552103+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]: dispatch 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.560552+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.561345+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.78:0/2679579878' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.561621+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.78:0/1825408807' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.569759+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]: dispatch 2024-09-17T08:56:07.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.570401+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:07.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.570721+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.570974+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:06.573305+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.78:0/1552355124' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi078-64680-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: cluster 2024-09-17T08:56:06.784251+0000 mgr.y (mgr.14532) 174 : cluster [DBG] pgmap v126: 584 pgs: 32 creating+peering, 132 unknown, 420 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:07.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:07 smithi136 bash[24812]: audit 2024-09-17T08:56:07.081718+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: cluster 2024-09-17T08:56:05.576996+0000 osd.2 (osd.2) 3 : cluster [DBG] 13.8 deep-scrub starts 2024-09-17T08:56:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: cluster 2024-09-17T08:56:05.581274+0000 osd.2 (osd.2) 4 : cluster [DBG] 13.8 deep-scrub ok 2024-09-17T08:56:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.080191+0000 mon.a (mon.0) 1109 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: cluster 2024-09-17T08:56:06.515408+0000 mon.a (mon.0) 1110 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: cluster 2024-09-17T08:56:06.515945+0000 mon.a (mon.0) 1111 : cluster [WRN] pool 'PoolQuotaPP_smithi078-64688-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: cluster 2024-09-17T08:56:06.519267+0000 mon.a (mon.0) 1112 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.535411+0000 mon.a (mon.0) 1113 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.535567+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]': finished 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.535638+0000 mon.a (mon.0) 1115 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]': finished 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.535717+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.535794+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? 172.21.15.78:0/2327200038' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: cluster 2024-09-17T08:56:06.535985+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.552103+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]: dispatch 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.560552+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.561345+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.78:0/2679579878' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.561621+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.78:0/1825408807' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.569759+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]: dispatch 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.570401+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.570721+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.570974+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:06.573305+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.78:0/1552355124' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi078-64680-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: cluster 2024-09-17T08:56:06.784251+0000 mgr.y (mgr.14532) 174 : cluster [DBG] pgmap v126: 584 pgs: 32 creating+peering, 132 unknown, 420 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22670]: audit 2024-09-17T08:56:07.081718+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: cluster 2024-09-17T08:56:05.576996+0000 osd.2 (osd.2) 3 : cluster [DBG] 13.8 deep-scrub starts 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: cluster 2024-09-17T08:56:05.581274+0000 osd.2 (osd.2) 4 : cluster [DBG] 13.8 deep-scrub ok 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.080191+0000 mon.a (mon.0) 1109 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: cluster 2024-09-17T08:56:06.515408+0000 mon.a (mon.0) 1110 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:07.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: cluster 2024-09-17T08:56:06.515945+0000 mon.a (mon.0) 1111 : cluster [WRN] pool 'PoolQuotaPP_smithi078-64688-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: cluster 2024-09-17T08:56:06.519267+0000 mon.a (mon.0) 1112 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.535411+0000 mon.a (mon.0) 1113 : audit [INF] from='client.? 172.21.15.78:0/1079400908' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi078-64733-10"}]': finished 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.535567+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "overlaypool": "test-rados-api-smithi078-64991-6"}]': finished 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.535638+0000 mon.a (mon.0) 1115 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi078-64804-1","app":"app1","key":"key1"}]': finished 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.535717+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi078-64728-10"}]': finished 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.535794+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? 172.21.15.78:0/2327200038' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: cluster 2024-09-17T08:56:06.535985+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.552103+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]: dispatch 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.560552+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.561345+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.78:0/2679579878' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.561621+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.78:0/1825408807' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.569759+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]: dispatch 2024-09-17T08:56:07.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.570401+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.570721+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.570974+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:06.573305+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.78:0/1552355124' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi078-64680-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: cluster 2024-09-17T08:56:06.784251+0000 mgr.y (mgr.14532) 174 : cluster [DBG] pgmap v126: 584 pgs: 32 creating+peering, 132 unknown, 420 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[32124]: audit 2024-09-17T08:56:07.081718+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:08.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:56:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:56:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:56:08.727 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-09-17T08:56:08.727 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-09-17T08:56:08.727 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-09-17T08:56:08.727 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify_test_cb 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (262 ms) 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94115004038272 err -107 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (11 ms) 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94115004049840 err -107 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (13 ms) 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-17T08:56:08.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 343597383680 cookie 94115004049840 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (16 ms) 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 343597383680 cookie 94115004083584 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (10 ms) 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 343597383680 cookie 94115004083584 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (9 ms) 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 343597383681 cookie 94115004083584 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 343597383681 cookie 94115004100528 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (52 ms) 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-17T08:56:08.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 343597383681 cookie 94115004083584 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 347892350978 cookie 94115004083584 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3024 ms) 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94115004083584 err -107 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_cb from 14769 notify_id 369367187457 cookie 94115004083584 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5025 ms) 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94115004100400 err -107 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1010 ms) 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (9432 ms total) 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: 2024-09-17T08:56:08.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-09-17T08:56:08.731 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-17T08:56:08.731 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: watch_notify_test_cb 2024-09-17T08:56:08.731 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1093 ms) 2024-09-17T08:56:08.731 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1093 ms total) 2024-09-17T08:56:08.731 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: 2024-09-17T08:56:08.731 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-09-17T08:56:08.731 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (28927 ms total) 2024-09-17T08:56:08.735 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-09-17T08:56:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: cluster 2024-09-17T08:56:07.531776+0000 mon.a (mon.0) 1125 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:07.545451+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]': finished 2024-09-17T08:56:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:07.545604+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:07.545686+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:07.545761+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:07.545836+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? 172.21.15.78:0/1552355124' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi078-64680-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: cluster 2024-09-17T08:56:07.545939+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-09-17T08:56:09.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:07.567828+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:09.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:07.570603+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:09.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:08 smithi136 bash[24812]: audit 2024-09-17T08:56:08.177615+0000 mon.a (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:09.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: cluster 2024-09-17T08:56:07.531776+0000 mon.a (mon.0) 1125 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:09.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:07.545451+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]': finished 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:07.545604+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:07.545686+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:07.545761+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:07.545836+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? 172.21.15.78:0/1552355124' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi078-64680-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: cluster 2024-09-17T08:56:07.545939+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:07.567828+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:07.570603+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[22670]: audit 2024-09-17T08:56:08.177615+0000 mon.a (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:09.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: cluster 2024-09-17T08:56:07.531776+0000 mon.a (mon.0) 1125 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:07.545451+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64991-6", "mode": "writeback"}]': finished 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:07.545604+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:07.545686+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi078-64886-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:07.545761+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:07.545836+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? 172.21.15.78:0/1552355124' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi078-64680-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: cluster 2024-09-17T08:56:07.545939+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:07.567828+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.78:0/1732897483' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:07.570603+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]: dispatch 2024-09-17T08:56:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:08 smithi078 bash[32124]: audit 2024-09-17T08:56:08.177615+0000 mon.a (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:09.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:56:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:56:10.093 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-09-17T08:56:10.093 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [----------] Global test environment set-up. 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5050 ms) 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (58 ms) 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20019 ms) 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: attempt 0 of 20 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: failed to deregister: 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: { 2024-09-17T08:56:10.094 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "epoch": 21, 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "modified": "2024-09-17T08:56:06.783899+0000", 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "services": { 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "laundry": { 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "daemons": { 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "summary": "", 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "close-test-pid65085": { 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "start_epoch": 21, 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "start_stamp": "2024-09-17T08:56:05.037538+0000", 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "gid": 25121, 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "addr": "172.21.15.78:0/1601642273", 2024-09-17T08:56:10.095 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "metadata": { 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "arch": "x86_64", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_release": "reef", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_version_short": "18.2.4-855-g19e2a2be", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro": "ubuntu", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro_version": "22.04", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "foo": "bar", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "hostname": "smithi078", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "kernel_description": "#132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "kernel_version": "5.15.0-122-generic", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-09-17T08:56:10.096 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "mem_total_kb": "32746704", 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "os": "Linux", 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "this": "that" 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: }, 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "task_status": {} 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: }, 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "pid65025": { 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "start_epoch": 20, 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "start_stamp": "2024-09-17T08:55:55.676623+0000", 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "gid": 25058, 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "addr": "172.21.15.78:0/2742200118", 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "metadata": { 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "arch": "x86_64", 2024-09-17T08:56:10.097 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_release": "reef", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_version_short": "18.2.4-855-g19e2a2be", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro": "ubuntu", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro_version": "22.04", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "foo": "bar", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "hostname": "smithi078", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "kernel_description": "#132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "kernel_version": "5.15.0-122-generic", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "mem_total_kb": "32746704", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "os": "Linux", 2024-09-17T08:56:10.098 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "this": "that" 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: }, 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "task_status": {} 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: } 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: } 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: }, 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "rgw": { 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "daemons": { 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "summary": "", 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "24359": { 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "start_epoch": 13, 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "start_stamp": "2024-09-17T08:51:48.929560+0000", 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "gid": 24359, 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "addr": "172.21.15.78:0/2867000391", 2024-09-17T08:56:10.099 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "metadata": { 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "arch": "x86_64", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_release": "reef", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "ceph_version_short": "18.2.4-855-g19e2a2be", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "container_hostname": "smithi078", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "container_image": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro": "centos", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "distro_version": "9", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "frontend_config#0": "beast port=80", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "frontend_type#0": "beast", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "hostname": "smithi078", 2024-09-17T08:56:10.100 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "id": "foo.a", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "kernel_description": "#132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "kernel_version": "5.15.0-122-generic", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "mem_total_kb": "32746704", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "num_handles": "1", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "os": "Linux", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "pid": "7", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "realm_id": "", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "realm_name": "", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "zone_id": "886147d5-ed95-4d1d-954e-dc910dfdf16d", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "zone_name": "default", 2024-09-17T08:56:10.101 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "zonegroup_id": "8ee3d6b8-fd28-44ae-a088-7648ad4508e6", 2024-09-17T08:56:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[32124]: audit 2024-09-17T08:56:08.703507+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[32124]: cluster 2024-09-17T08:56:08.703651+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-09-17T08:56:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[32124]: audit 2024-09-17T08:56:08.706969+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? 172.21.15.78:0/2332818748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[32124]: audit 2024-09-17T08:56:08.717937+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.78:0/4137449630' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[32124]: audit 2024-09-17T08:56:08.721714+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[32124]: audit 2024-09-17T08:56:09.288031+0000 mon.a (mon.0) 1138 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:10.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[22670]: audit 2024-09-17T08:56:08.703507+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[22670]: cluster 2024-09-17T08:56:08.703651+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-09-17T08:56:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[22670]: audit 2024-09-17T08:56:08.706969+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? 172.21.15.78:0/2332818748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[22670]: audit 2024-09-17T08:56:08.717937+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.78:0/4137449630' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[22670]: audit 2024-09-17T08:56:08.721714+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:09 smithi078 bash[22670]: audit 2024-09-17T08:56:09.288031+0000 mon.a (mon.0) 1138 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:09 smithi136 bash[24812]: audit 2024-09-17T08:56:08.703507+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi078-64983-12"}]': finished 2024-09-17T08:56:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:09 smithi136 bash[24812]: cluster 2024-09-17T08:56:08.703651+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-09-17T08:56:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:09 smithi136 bash[24812]: audit 2024-09-17T08:56:08.706969+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? 172.21.15.78:0/2332818748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:09 smithi136 bash[24812]: audit 2024-09-17T08:56:08.717937+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.78:0/4137449630' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:09 smithi136 bash[24812]: audit 2024-09-17T08:56:08.721714+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:09 smithi136 bash[24812]: audit 2024-09-17T08:56:09.288031+0000 mon.a (mon.0) 1138 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "zonegroup_name": "defaul api_watch_notify_pp: Running main() from gmock_main.cc 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: notify 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1216 ms) 2024-09-17T08:56:10.835 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (71 ms) 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1287 ms total) 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: notify 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (74 ms) 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: notify 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4471 ms) 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-17T08:56:10.836 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (22 ms) 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (25 ms) 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750055072 notify_id 403726925826 notifier_gid 25091 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (10 ms) 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750055072 notify_id 403726925825 notifier_gid 25091 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (18 ms) 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750069328 notify_id 403726925825 notifier_gid 25091 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (21 ms) 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-17T08:56:10.837 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750073632 notify_id 403726925826 notifier_gid 25091 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (33 ms) 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750073632 notify_id 403726925828 notifier_gid 25091 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (10 ms) 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750073632 notify_id 403726925827 notifier_gid 25091 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (28 ms) 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: trying... 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750069328 notify_id 403726925828 notifier_gid 25091 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: timed out 2024-09-17T08:56:10.838 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: flushing 2024-09-17T08:56:11.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: cluster 2024-09-17T08:56:08.785148+0000 mgr.y (mgr.14532) 175 : cluster [DBG] pgmap v129: 456 pgs: 64 unknown, 392 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:09.295581+0000 mgr.y (mgr.14532) 176 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:09.827121+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:09.835488+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:09.856986+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? 172.21.15.78:0/2332818748' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:09.857610+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:09.885689+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.78:0/1211472432' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:10.091716+0000 mon.b (mon.1) 60 : audit [DBG] from='client.? 172.21.15.78:0/1759486059' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: cluster 2024-09-17T08:56:10.396461+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:10.399612+0000 mon.a (mon.0) 1144 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:10.403040+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[22670]: audit 2024-09-17T08:56:10.404126+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: cluster 2024-09-17T08:56:08.785148+0000 mgr.y (mgr.14532) 175 : cluster [DBG] pgmap v129: 456 pgs: 64 unknown, 392 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:09.295581+0000 mgr.y (mgr.14532) 176 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:09.827121+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:09.835488+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:09.856986+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? 172.21.15.78:0/2332818748' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:09.857610+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:09.885689+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.78:0/1211472432' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:10.091716+0000 mon.b (mon.1) 60 : audit [DBG] from='client.? 172.21.15.78:0/1759486059' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:11.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: cluster 2024-09-17T08:56:10.396461+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-09-17T08:56:11.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:10.399612+0000 mon.a (mon.0) 1144 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:11.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:10.403040+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:10 smithi078 bash[32124]: audit 2024-09-17T08:56:10.404126+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: cluster 2024-09-17T08:56:08.785148+0000 mgr.y (mgr.14532) 175 : cluster [DBG] pgmap v129: 456 pgs: 64 unknown, 392 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:09.295581+0000 mgr.y (mgr.14532) 176 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:09.827121+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:09.835488+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:09.856986+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? 172.21.15.78:0/2332818748' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:09.857610+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi078-64912-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:09.885689+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.78:0/1211472432' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:10.091716+0000 mon.b (mon.1) 60 : audit [DBG] from='client.? 172.21.15.78:0/1759486059' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: cluster 2024-09-17T08:56:10.396461+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:10.399612+0000 mon.a (mon.0) 1144 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:10.403040+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:10 smithi136 bash[24812]: audit 2024-09-17T08:56:10.404126+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: audit 2024-09-17T08:56:10.090005+0000 mgr.y (mgr.14532) 177 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: cluster 2024-09-17T08:56:10.785804+0000 mgr.y (mgr.14532) 178 : cluster [DBG] pgmap v131: 520 pgs: 128 unknown, 392 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 963 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-17T08:56:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: audit 2024-09-17T08:56:10.871297+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: audit 2024-09-17T08:56:10.871384+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: cluster 2024-09-17T08:56:10.871562+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-09-17T08:56:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: audit 2024-09-17T08:56:10.877838+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.78:0/3284633544' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: audit 2024-09-17T08:56:10.879631+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[22670]: audit 2024-09-17T08:56:11.532717+0000 mon.a (mon.0) 1151 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: audit 2024-09-17T08:56:10.090005+0000 mgr.y (mgr.14532) 177 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: cluster 2024-09-17T08:56:10.785804+0000 mgr.y (mgr.14532) 178 : cluster [DBG] pgmap v131: 520 pgs: 128 unknown, 392 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 963 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: audit 2024-09-17T08:56:10.871297+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: audit 2024-09-17T08:56:10.871384+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: cluster 2024-09-17T08:56:10.871562+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: audit 2024-09-17T08:56:10.877838+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.78:0/3284633544' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: audit 2024-09-17T08:56:10.879631+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:12 smithi078 bash[32124]: audit 2024-09-17T08:56:11.532717+0000 mon.a (mon.0) 1151 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: audit 2024-09-17T08:56:10.090005+0000 mgr.y (mgr.14532) 177 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: cluster 2024-09-17T08:56:10.785804+0000 mgr.y (mgr.14532) 178 : cluster [DBG] pgmap v131: 520 pgs: 128 unknown, 392 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 963 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-17T08:56:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: audit 2024-09-17T08:56:10.871297+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: audit 2024-09-17T08:56:10.871384+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: cluster 2024-09-17T08:56:10.871562+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-09-17T08:56:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: audit 2024-09-17T08:56:10.877838+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.78:0/3284633544' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: audit 2024-09-17T08:56:10.879631+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:12.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:12 smithi136 bash[24812]: audit 2024-09-17T08:56:11.532717+0000 mon.a (mon.0) 1151 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:13.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: audit 2024-09-17T08:56:12.070227+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: cluster 2024-09-17T08:56:12.070694+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-09-17T08:56:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: audit 2024-09-17T08:56:12.094815+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: audit 2024-09-17T08:56:12.535565+0000 mon.a (mon.0) 1155 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: cluster 2024-09-17T08:56:12.787640+0000 mgr.y (mgr.14532) 179 : cluster [DBG] pgmap v134: 584 pgs: 46 creating+peering, 52 unknown, 486 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T08:56:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: cluster 2024-09-17T08:56:13.061949+0000 mon.a (mon.0) 1156 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T08:56:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: audit 2024-09-17T08:56:13.080183+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:13 smithi136 bash[24812]: cluster 2024-09-17T08:56:13.080428+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: audit 2024-09-17T08:56:12.070227+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: cluster 2024-09-17T08:56:12.070694+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: audit 2024-09-17T08:56:12.094815+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: audit 2024-09-17T08:56:12.535565+0000 mon.a (mon.0) 1155 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: cluster 2024-09-17T08:56:12.787640+0000 mgr.y (mgr.14532) 179 : cluster [DBG] pgmap v134: 584 pgs: 46 creating+peering, 52 unknown, 486 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: cluster 2024-09-17T08:56:13.061949+0000 mon.a (mon.0) 1156 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: audit 2024-09-17T08:56:13.080183+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[22670]: cluster 2024-09-17T08:56:13.080428+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: audit 2024-09-17T08:56:12.070227+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi078-64680-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: cluster 2024-09-17T08:56:12.070694+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: audit 2024-09-17T08:56:12.094815+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: audit 2024-09-17T08:56:12.535565+0000 mon.a (mon.0) 1155 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: cluster 2024-09-17T08:56:12.787640+0000 mgr.y (mgr.14532) 179 : cluster [DBG] pgmap v134: 584 pgs: 46 creating+peering, 52 unknown, 486 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: cluster 2024-09-17T08:56:13.061949+0000 mon.a (mon.0) 1156 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: audit 2024-09-17T08:56:13.080183+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:13 smithi078 bash[32124]: cluster 2024-09-17T08:56:13.080428+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-09-17T08:56:14.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:14 smithi136 bash[24812]: audit 2024-09-17T08:56:13.170889+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:14.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:14 smithi078 bash[22670]: audit 2024-09-17T08:56:13.170889+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:14.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:14 smithi078 bash[32124]: audit 2024-09-17T08:56:13.170889+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:15.522 INFO:tasks.workunit.client.0.smithi078.stdout: t" 2024-09-17T08:56:15.522 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: }, 2024-09-17T08:56:15.522 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: "task_status": {} 2024-09-17T08:56:15.522 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: } 2024-09-17T08:56:15.522 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: } 2024-09-17T08:56:15.522 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: } 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: } 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: } 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: attempt 1 of 20 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10531 ms) 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35658 ms total) 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [----------] Global test environment tear-down 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35658 ms total) 2024-09-17T08:56:15.523 INFO:tasks.workunit.client.0.smithi078.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-09-17T08:56:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: audit 2024-09-17T08:56:14.220807+0000 mon.a (mon.0) 1160 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: audit 2024-09-17T08:56:14.248893+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: audit 2024-09-17T08:56:14.259655+0000 mon.c (mon.2) 96 : audit [INF] from='client.? 172.21.15.78:0/3788572939' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: audit 2024-09-17T08:56:14.289355+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.78:0/2697490471' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: cluster 2024-09-17T08:56:14.805481+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: audit 2024-09-17T08:56:14.810163+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-7"}]: dispatch 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: audit 2024-09-17T08:56:14.812453+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[22670]: audit 2024-09-17T08:56:14.814484+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: audit 2024-09-17T08:56:14.220807+0000 mon.a (mon.0) 1160 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: audit 2024-09-17T08:56:14.248893+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: audit 2024-09-17T08:56:14.259655+0000 mon.c (mon.2) 96 : audit [INF] from='client.? 172.21.15.78:0/3788572939' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: audit 2024-09-17T08:56:14.289355+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.78:0/2697490471' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: cluster 2024-09-17T08:56:14.805481+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-09-17T08:56:15.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: audit 2024-09-17T08:56:14.810163+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-7"}]: dispatch 2024-09-17T08:56:15.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: audit 2024-09-17T08:56:14.812453+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:15 smithi078 bash[32124]: audit 2024-09-17T08:56:14.814484+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.711 INFO:tasks.workunit.client.0.smithi078.stdout:ce: laundry: 1 daemon active (1 hosts) 2024-09-17T08:56:15.711 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-17T08:56:15.711 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:56:15.711 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: data: 2024-09-17T08:56:15.711 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: pools: 29 pools, 868 pgs 2024-09-17T08:56:15.711 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: objects: 309 objects, 600 KiB 2024-09-17T08:56:15.711 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: usage: 245 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: pgs: 34.677% pgs unknown 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 21.659% pgs not active 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 379 active+clean 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 301 unknown 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 188 creating+peering 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: io: 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: client: 8.6 KiB/s rd, 40 KiB/s wr, 12 op/s rd, 54 op/s wr 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ OK ] LibRadosService.StatusFormat (4256 ms) 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ RUN ] LibRadosService.Status 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ OK ] LibRadosService.Status (20679 ms) 2024-09-17T08:56:15.712 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [----------] 4 tests from LibRadosService (35848 ms total) 2024-09-17T08:56:15.713 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: 2024-09-17T08:56:15.713 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [----------] Global test environment tear-down 2024-09-17T08:56:15.713 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [==========] 4 tests from 1 test suite ran. (35848 ms total) 2024-09-17T08:56:15.713 INFO:tasks.workunit.client.0.smithi078.stdout: api_service: [ PASSED ] 4 tests. 2024-09-17T08:56:15.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: audit 2024-09-17T08:56:14.220807+0000 mon.a (mon.0) 1160 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: audit 2024-09-17T08:56:14.248893+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: audit 2024-09-17T08:56:14.259655+0000 mon.c (mon.2) 96 : audit [INF] from='client.? 172.21.15.78:0/3788572939' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: audit 2024-09-17T08:56:14.289355+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.78:0/2697490471' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: cluster 2024-09-17T08:56:14.805481+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-09-17T08:56:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: audit 2024-09-17T08:56:14.810163+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-7"}]: dispatch 2024-09-17T08:56:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: audit 2024-09-17T08:56:14.812453+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:15 smithi136 bash[24812]: audit 2024-09-17T08:56:14.814484+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: cluster 2024-09-17T08:56:14.788304+0000 mgr.y (mgr.14532) 180 : cluster [DBG] pgmap v137: 488 pgs: 64 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T08:56:16.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.335366+0000 mon.a (mon.0) 1166 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:16.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.370180+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-7"}]': finished 2024-09-17T08:56:16.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.370279+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.370459+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: cluster 2024-09-17T08:56:15.370715+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.387011+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.78:0/4100242676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.401150+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.402020+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.78:0/938275249' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.407235+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.517963+0000 mgr.y (mgr.14532) 181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.520077+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.78:0/2782801414' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[22670]: audit 2024-09-17T08:56:15.989966+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:16.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: cluster 2024-09-17T08:56:14.788304+0000 mgr.y (mgr.14532) 180 : cluster [DBG] pgmap v137: 488 pgs: 64 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.335366+0000 mon.a (mon.0) 1166 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.370180+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-7"}]': finished 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.370279+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.370459+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: cluster 2024-09-17T08:56:15.370715+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.387011+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.78:0/4100242676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.401150+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.402020+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.78:0/938275249' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.407235+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.517963+0000 mgr.y (mgr.14532) 181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.520077+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.78:0/2782801414' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:16.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:16 smithi078 bash[32124]: audit 2024-09-17T08:56:15.989966+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: cluster 2024-09-17T08:56:14.788304+0000 mgr.y (mgr.14532) 180 : cluster [DBG] pgmap v137: 488 pgs: 64 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.335366+0000 mon.a (mon.0) 1166 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.370180+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-7"}]': finished 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.370279+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi078-64680-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.370459+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: cluster 2024-09-17T08:56:15.370715+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.387011+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.78:0/4100242676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.401150+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.402020+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.78:0/938275249' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.407235+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:16.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.517963+0000 mgr.y (mgr.14532) 181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:16.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.520077+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.78:0/2782801414' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-17T08:56:16.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:16 smithi136 bash[24812]: audit 2024-09-17T08:56:15.989966+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:17.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:16.344417+0000 mon.a (mon.0) 1174 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:17.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:16.377459+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:17.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:16.377586+0000 mon.a (mon.0) 1176 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:17.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:16.377727+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:17.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: cluster 2024-09-17T08:56:16.377802+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-09-17T08:56:17.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:16.382963+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7"}]: dispatch 2024-09-17T08:56:17.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: cluster 2024-09-17T08:56:16.788954+0000 mgr.y (mgr.14532) 182 : cluster [DBG] pgmap v140: 552 pgs: 128 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T08:56:17.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:17.032667+0000 mon.a (mon.0) 1180 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7"}]': finished 2024-09-17T08:56:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: cluster 2024-09-17T08:56:17.033034+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-09-17T08:56:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:17.061306+0000 mon.b (mon.1) 64 : audit [INF] from='client.? 172.21.15.78:0/1519075260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:17.062370+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:17.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22670]: audit 2024-09-17T08:56:17.668826+0000 mon.a (mon.0) 1183 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:17.922 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:56:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:56:17.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:16.344417+0000 mon.a (mon.0) 1174 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:17.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:16.377459+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:16.377586+0000 mon.a (mon.0) 1176 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:16.377727+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: cluster 2024-09-17T08:56:16.377802+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:16.382963+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7"}]: dispatch 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: cluster 2024-09-17T08:56:16.788954+0000 mgr.y (mgr.14532) 182 : cluster [DBG] pgmap v140: 552 pgs: 128 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:17.032667+0000 mon.a (mon.0) 1180 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7"}]': finished 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: cluster 2024-09-17T08:56:17.033034+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:17.061306+0000 mon.b (mon.1) 64 : audit [INF] from='client.? 172.21.15.78:0/1519075260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:17.062370+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:17.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:17 smithi078 bash[32124]: audit 2024-09-17T08:56:17.668826+0000 mon.a (mon.0) 1183 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:18.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:16.344417+0000 mon.a (mon.0) 1174 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:18.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:16.377459+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:18.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:16.377586+0000 mon.a (mon.0) 1176 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-65117-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:16.377727+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: cluster 2024-09-17T08:56:16.377802+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:16.382963+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7"}]: dispatch 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: cluster 2024-09-17T08:56:16.788954+0000 mgr.y (mgr.14532) 182 : cluster [DBG] pgmap v140: 552 pgs: 128 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 743 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:17.032667+0000 mon.a (mon.0) 1180 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-7"}]': finished 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: cluster 2024-09-17T08:56:17.033034+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:17.061306+0000 mon.b (mon.1) 64 : audit [INF] from='client.? 172.21.15.78:0/1519075260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:17.062370+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:18.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:17 smithi136 bash[24812]: audit 2024-09-17T08:56:17.668826+0000 mon.a (mon.0) 1183 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: 2024-09-17T08:56:18.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (11408 ms) 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (5248 ms) 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (5594 ms) 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3021 ms) 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3582 ms) 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (4389 ms) 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-09-17T08:56:18.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (4932 ms) 2024-09-17T08:56:18.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (38175 ms total) 2024-09-17T08:56:18.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: 2024-09-17T08:56:18.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-09-17T08:56:18.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (38175 ms total) 2024-09-17T08:56:18.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-09-17T08:56:19.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:56:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:56:19.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:19 smithi136 bash[24812]: cluster 2024-09-17T08:56:17.670739+0000 mon.a (mon.0) 1184 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:19.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:19 smithi136 bash[24812]: audit 2024-09-17T08:56:18.035557+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:19.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:19 smithi136 bash[24812]: cluster 2024-09-17T08:56:18.035746+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-09-17T08:56:19.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:19 smithi136 bash[24812]: audit 2024-09-17T08:56:18.063457+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.78:0/3866080437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:19.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:19 smithi136 bash[24812]: audit 2024-09-17T08:56:18.621835+0000 mon.a (mon.0) 1187 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:56:19.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:19 smithi136 bash[24812]: audit 2024-09-17T08:56:18.629006+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[32124]: cluster 2024-09-17T08:56:17.670739+0000 mon.a (mon.0) 1184 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[32124]: audit 2024-09-17T08:56:18.035557+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[32124]: cluster 2024-09-17T08:56:18.035746+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[32124]: audit 2024-09-17T08:56:18.063457+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.78:0/3866080437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[32124]: audit 2024-09-17T08:56:18.621835+0000 mon.a (mon.0) 1187 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[32124]: audit 2024-09-17T08:56:18.629006+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[22670]: cluster 2024-09-17T08:56:17.670739+0000 mon.a (mon.0) 1184 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[22670]: audit 2024-09-17T08:56:18.035557+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi078-64680-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:19.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[22670]: cluster 2024-09-17T08:56:18.035746+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-09-17T08:56:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[22670]: audit 2024-09-17T08:56:18.063457+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.78:0/3866080437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[22670]: audit 2024-09-17T08:56:18.621835+0000 mon.a (mon.0) 1187 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:56:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:19 smithi078 bash[22670]: audit 2024-09-17T08:56:18.629006+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: cluster 2024-09-17T08:56:18.789628+0000 mgr.y (mgr.14532) 183 : cluster [DBG] pgmap v143: 456 pgs: 32 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-17T08:56:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.167079+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.192978+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: cluster 2024-09-17T08:56:19.193138+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-09-17T08:56:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.199113+0000 mon.a (mon.0) 1192 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.230060+0000 mon.b (mon.1) 66 : audit [INF] from='client.? 172.21.15.78:0/1058009147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.231541+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.306681+0000 mgr.y (mgr.14532) 184 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.806744+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:56:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.812994+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:56:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.825124+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.882784+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]: dispatch 2024-09-17T08:56:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:19.883411+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]: dispatch 2024-09-17T08:56:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:20 smithi136 bash[24812]: audit 2024-09-17T08:56:20.168111+0000 mon.a (mon.0) 1198 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: cluster 2024-09-17T08:56:18.789628+0000 mgr.y (mgr.14532) 183 : cluster [DBG] pgmap v143: 456 pgs: 32 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-17T08:56:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.167079+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.192978+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: cluster 2024-09-17T08:56:19.193138+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-09-17T08:56:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.199113+0000 mon.a (mon.0) 1192 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.230060+0000 mon.b (mon.1) 66 : audit [INF] from='client.? 172.21.15.78:0/1058009147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.231541+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.306681+0000 mgr.y (mgr.14532) 184 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.806744+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:56:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.812994+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:56:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.825124+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.882784+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]: dispatch 2024-09-17T08:56:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:19.883411+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]: dispatch 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[22670]: audit 2024-09-17T08:56:20.168111+0000 mon.a (mon.0) 1198 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: cluster 2024-09-17T08:56:18.789628+0000 mgr.y (mgr.14532) 183 : cluster [DBG] pgmap v143: 456 pgs: 32 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.167079+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.192978+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi078-64688-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: cluster 2024-09-17T08:56:19.193138+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.199113+0000 mon.a (mon.0) 1192 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.230060+0000 mon.b (mon.1) 66 : audit [INF] from='client.? 172.21.15.78:0/1058009147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.231541+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:20.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.306681+0000 mgr.y (mgr.14532) 184 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:20.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.806744+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:56:20.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.812994+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:56:20.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.825124+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:20.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.882784+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]: dispatch 2024-09-17T08:56:20.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:19.883411+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]: dispatch 2024-09-17T08:56:20.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:20 smithi078 bash[32124]: audit 2024-09-17T08:56:20.168111+0000 mon.a (mon.0) 1198 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.197331+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.197644+0000 mon.a (mon.0) 1200 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.197798+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]': finished 2024-09-17T08:56:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: cluster 2024-09-17T08:56:20.197867+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-09-17T08:56:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.209334+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.211128+0000 mon.a (mon.0) 1203 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.229357+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.229757+0000 mon.b (mon.1) 67 : audit [INF] from='client.? 172.21.15.78:0/3941284661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: cluster 2024-09-17T08:56:20.790250+0000 mgr.y (mgr.14532) 185 : cluster [DBG] pgmap v146: 488 pgs: 96 unknown, 392 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-17T08:56:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:20.814137+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:21 smithi136 bash[24812]: audit 2024-09-17T08:56:21.341925+0000 mon.a (mon.0) 1206 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:21.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.197331+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:21.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.197644+0000 mon.a (mon.0) 1200 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.197798+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]': finished 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: cluster 2024-09-17T08:56:20.197867+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.209334+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.211128+0000 mon.a (mon.0) 1203 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.229357+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.229757+0000 mon.b (mon.1) 67 : audit [INF] from='client.? 172.21.15.78:0/3941284661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: cluster 2024-09-17T08:56:20.790250+0000 mgr.y (mgr.14532) 185 : cluster [DBG] pgmap v146: 488 pgs: 96 unknown, 392 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:20.814137+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[22670]: audit 2024-09-17T08:56:21.341925+0000 mon.a (mon.0) 1206 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:21.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.197331+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.197644+0000 mon.a (mon.0) 1200 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.197798+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4"}]': finished 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: cluster 2024-09-17T08:56:20.197867+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.209334+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.211128+0000 mon.a (mon.0) 1203 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]: dispatch 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.229357+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.229757+0000 mon.b (mon.1) 67 : audit [INF] from='client.? 172.21.15.78:0/3941284661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: cluster 2024-09-17T08:56:20.790250+0000 mgr.y (mgr.14532) 185 : cluster [DBG] pgmap v146: 488 pgs: 96 unknown, 392 active+clean; 145 MiB data, 766 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:20.814137+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:21 smithi078 bash[32124]: audit 2024-09-17T08:56:21.341925+0000 mon.a (mon.0) 1206 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:23.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: cluster 2024-09-17T08:56:21.348218+0000 mon.a (mon.0) 1207 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:23.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.384389+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]': finished 2024-09-17T08:56:23.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.384566+0000 mon.a (mon.0) 1209 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:23.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.384690+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:23.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: cluster 2024-09-17T08:56:21.384776+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.394288+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.395354+0000 mon.b (mon.1) 68 : audit [INF] from='client.? 172.21.15.78:0/1234537021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.395544+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.395884+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:21.408728+0000 mon.a (mon.0) 1214 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-9"}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:22.028277+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:22.028363+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:22.028458+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-9"}]': finished 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: cluster 2024-09-17T08:56:22.028662+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:22.030433+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-9", "mode": "writeback"}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:22.140630+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:22.142383+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:23.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:22 smithi136 bash[24812]: audit 2024-09-17T08:56:22.142932+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout:api_watch_notify_pp: flushed 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3008 ms) 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: trying... 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750069328 notify_id 412316860421 notifier_gid 25091 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: timed out 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: flushing 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: flushed 2024-09-17T08:56:23.044 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3014 ms) 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: List watches 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: notify2 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750069328 notify_id 425201762307 notifier_gid 25091 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: notify2 done 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: watch_check 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: unwatch2 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: flushing 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: done 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3014 ms) 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-17T08:56:23.045 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: List watches 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: notify2 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: handle_notify cookie 94728750073632 notify_id 438086664196 notifier_gid 25091 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: notify2 done 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: watch_check 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: unwatch2 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: flushing 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: done 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3016 ms) 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16764 ms total) 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (43228 ms total) 2024-09-17T08:56:23.046 INFO:tasks.workunit.client.0.smithi078.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-09-17T08:56:23.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: cluster 2024-09-17T08:56:21.348218+0000 mon.a (mon.0) 1207 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:23.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.384389+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]': finished 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.384566+0000 mon.a (mon.0) 1209 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.384690+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: cluster 2024-09-17T08:56:21.384776+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.394288+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.395354+0000 mon.b (mon.1) 68 : audit [INF] from='client.? 172.21.15.78:0/1234537021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.395544+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.395884+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:21.408728+0000 mon.a (mon.0) 1214 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-9"}]: dispatch 2024-09-17T08:56:23.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:22.028277+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T08:56:23.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:22.028363+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:23.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:22.028458+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-9"}]': finished 2024-09-17T08:56:23.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: cluster 2024-09-17T08:56:22.028662+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-09-17T08:56:23.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:22.030433+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-9", "mode": "writeback"}]: dispatch 2024-09-17T08:56:23.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:22.140630+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:23.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:22.142383+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:23.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[22670]: audit 2024-09-17T08:56:22.142932+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: cluster 2024-09-17T08:56:21.348218+0000 mon.a (mon.0) 1207 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.384389+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi078-64991-4", "tierpool": "test-rados-api-smithi078-64991-6"}]': finished 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.384566+0000 mon.a (mon.0) 1209 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi078-64680-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.384690+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: cluster 2024-09-17T08:56:21.384776+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.394288+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.78:0/1894151200' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.395354+0000 mon.b (mon.1) 68 : audit [INF] from='client.? 172.21.15.78:0/1234537021' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.108 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.395544+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.395884+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:21.408728+0000 mon.a (mon.0) 1214 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-9"}]: dispatch 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:22.028277+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi078-64991-6", "pool2": "test-rados-api-smithi078-64991-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:22.028363+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi078-64688-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:22.028458+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-9"}]': finished 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: cluster 2024-09-17T08:56:22.028662+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:22.030433+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-9", "mode": "writeback"}]: dispatch 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:22.140630+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:22.142383+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:23.109 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:22 smithi078 bash[32124]: audit 2024-09-17T08:56:22.142932+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: audit 2024-09-17T08:56:22.698158+0000 mon.a (mon.0) 1223 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: cluster 2024-09-17T08:56:22.791799+0000 mgr.y (mgr.14532) 186 : cluster [DBG] pgmap v149: 452 pgs: 18 unknown, 434 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: cluster 2024-09-17T08:56:23.024546+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: audit 2024-09-17T08:56:23.034688+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-9", "mode": "writeback"}]': finished 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: audit 2024-09-17T08:56:23.034841+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: cluster 2024-09-17T08:56:23.034924+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: audit 2024-09-17T08:56:23.038204+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.78:0/2524486457' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: audit 2024-09-17T08:56:23.071427+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi078-64886-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:24 smithi136 bash[24812]: audit 2024-09-17T08:56:23.072126+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: audit 2024-09-17T08:56:22.698158+0000 mon.a (mon.0) 1223 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: cluster 2024-09-17T08:56:22.791799+0000 mgr.y (mgr.14532) 186 : cluster [DBG] pgmap v149: 452 pgs: 18 unknown, 434 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: cluster 2024-09-17T08:56:23.024546+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: audit 2024-09-17T08:56:23.034688+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-9", "mode": "writeback"}]': finished 2024-09-17T08:56:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: audit 2024-09-17T08:56:23.034841+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: cluster 2024-09-17T08:56:23.034924+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: audit 2024-09-17T08:56:23.038204+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.78:0/2524486457' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: audit 2024-09-17T08:56:23.071427+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi078-64886-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[22670]: audit 2024-09-17T08:56:23.072126+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: audit 2024-09-17T08:56:22.698158+0000 mon.a (mon.0) 1223 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: cluster 2024-09-17T08:56:22.791799+0000 mgr.y (mgr.14532) 186 : cluster [DBG] pgmap v149: 452 pgs: 18 unknown, 434 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: cluster 2024-09-17T08:56:23.024546+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: audit 2024-09-17T08:56:23.034688+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-9", "mode": "writeback"}]': finished 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: audit 2024-09-17T08:56:23.034841+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: cluster 2024-09-17T08:56:23.034924+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-09-17T08:56:24.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: audit 2024-09-17T08:56:23.038204+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.78:0/2524486457' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:24.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: audit 2024-09-17T08:56:23.071427+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi078-64886-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:24.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:24 smithi078 bash[32124]: audit 2024-09-17T08:56:23.072126+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: cluster 2024-09-17T08:56:23.748932+0000 mon.a (mon.0) 1230 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.278868+0000 mon.a (mon.0) 1231 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.279168+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: cluster 2024-09-17T08:56:24.792410+0000 mgr.y (mgr.14532) 187 : cluster [DBG] pgmap v152: 452 pgs: 96 unknown, 356 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.856522+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: cluster 2024-09-17T08:56:24.856789+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.858784+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.861032+0000 mon.b (mon.1) 69 : audit [INF] from='client.? 172.21.15.78:0/1783054263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.868585+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.868767+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.882743+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:24.883912+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:25 smithi136 bash[24812]: audit 2024-09-17T08:56:25.280023+0000 mon.a (mon.0) 1239 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: cluster 2024-09-17T08:56:23.748932+0000 mon.a (mon.0) 1230 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.278868+0000 mon.a (mon.0) 1231 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.279168+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: cluster 2024-09-17T08:56:24.792410+0000 mgr.y (mgr.14532) 187 : cluster [DBG] pgmap v152: 452 pgs: 96 unknown, 356 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.856522+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: cluster 2024-09-17T08:56:24.856789+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.858784+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.861032+0000 mon.b (mon.1) 69 : audit [INF] from='client.? 172.21.15.78:0/1783054263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.868585+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.868767+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.882743+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:24.883912+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[22670]: audit 2024-09-17T08:56:25.280023+0000 mon.a (mon.0) 1239 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: cluster 2024-09-17T08:56:23.748932+0000 mon.a (mon.0) 1230 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.278868+0000 mon.a (mon.0) 1231 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.279168+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: cluster 2024-09-17T08:56:24.792410+0000 mgr.y (mgr.14532) 187 : cluster [DBG] pgmap v152: 452 pgs: 96 unknown, 356 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.856522+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi078-64680-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: cluster 2024-09-17T08:56:24.856789+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.858784+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.861032+0000 mon.b (mon.1) 69 : audit [INF] from='client.? 172.21.15.78:0/1783054263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.868585+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.868767+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:25.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.882743+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:25.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:24.883912+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:25.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:25 smithi078 bash[32124]: audit 2024-09-17T08:56:25.280023+0000 mon.a (mon.0) 1239 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.348853+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi078-64886-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.348911+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.349036+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.349076+0000 mon.a (mon.0) 1243 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: cluster 2024-09-17T08:56:25.349148+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.655947+0000 mon.c (mon.2) 103 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.659604+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.663588+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:56:26.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.665408+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:56:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.669684+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:56:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.674731+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:56:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.693800+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:56:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.695953+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:56:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.697783+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:56:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.699137+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:56:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:26 smithi136 bash[24812]: audit 2024-09-17T08:56:25.912425+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9"}]: dispatch 2024-09-17T08:56:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.348853+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi078-64886-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.348911+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.349036+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.349076+0000 mon.a (mon.0) 1243 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: cluster 2024-09-17T08:56:25.349148+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.655947+0000 mon.c (mon.2) 103 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.659604+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.663588+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.665408+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.669684+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.674731+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.693800+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.695953+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.697783+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.699137+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[22670]: audit 2024-09-17T08:56:25.912425+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9"}]: dispatch 2024-09-17T08:56:26.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.348853+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi078-64886-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.348911+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.349036+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi078-64688-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.349076+0000 mon.a (mon.0) 1243 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64883-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: cluster 2024-09-17T08:56:25.349148+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.655947+0000 mon.c (mon.2) 103 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.659604+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.663588+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.665408+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.669684+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.674731+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.693800+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.695953+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.697783+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:56:26.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.699137+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:56:26.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:26 smithi078 bash[32124]: audit 2024-09-17T08:56:25.912425+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9"}]: dispatch 2024-09-17T08:56:27.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.656201+0000 mgr.y (mgr.14532) 188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:56:27.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.661509+0000 mgr.y (mgr.14532) 189 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:56:27.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.664063+0000 mgr.y (mgr.14532) 190 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.665716+0000 mgr.y (mgr.14532) 191 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.673129+0000 mgr.y (mgr.14532) 192 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.678519+0000 mgr.y (mgr.14532) 193 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.694087+0000 mgr.y (mgr.14532) 194 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.696198+0000 mgr.y (mgr.14532) 195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.698084+0000 mgr.y (mgr.14532) 196 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:25.699401+0000 mgr.y (mgr.14532) 197 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:25.999035+0000 osd.0 (osd.0) 5 : cluster [DBG] 13.3 deep-scrub starts 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.004172+0000 osd.0 (osd.0) 6 : cluster [DBG] 13.3 deep-scrub ok 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.412064+0000 osd.4 (osd.4) 7 : cluster [DBG] 13.5 deep-scrub starts 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.415464+0000 osd.4 (osd.4) 8 : cluster [DBG] 13.5 deep-scrub ok 2024-09-17T08:56:27.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.442560+0000 mon.a (mon.0) 1246 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:26.444498+0000 mon.a (mon.0) 1247 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:26.478370+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9"}]': finished 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.478639+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:26.486097+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]: dispatch 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:26.487806+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]: dispatch 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:26.488723+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? 172.21.15.78:0/862641518' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi078-64680-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.649222+0000 osd.2 (osd.2) 5 : cluster [DBG] 13.8 deep-scrub starts 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.658115+0000 osd.2 (osd.2) 6 : cluster [DBG] 13.8 deep-scrub ok 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:26.792986+0000 mgr.y (mgr.14532) 198 : cluster [DBG] pgmap v155: 460 pgs: 104 unknown, 356 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:27.165264+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]': finished 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:27.165342+0000 mon.a (mon.0) 1253 : audit [INF] from='client.? 172.21.15.78:0/862641518' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi078-64680-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: cluster 2024-09-17T08:56:27.165639+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-09-17T08:56:27.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:27.166953+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:27.171771+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:27.184898+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.78:0/2264767790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:27.187244+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:27 smithi136 bash[24812]: audit 2024-09-17T08:56:27.447722+0000 mon.a (mon.0) 1257 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.656201+0000 mgr.y (mgr.14532) 188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.661509+0000 mgr.y (mgr.14532) 189 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.664063+0000 mgr.y (mgr.14532) 190 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.665716+0000 mgr.y (mgr.14532) 191 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.673129+0000 mgr.y (mgr.14532) 192 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.678519+0000 mgr.y (mgr.14532) 193 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.694087+0000 mgr.y (mgr.14532) 194 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.696198+0000 mgr.y (mgr.14532) 195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:56:27.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.698084+0000 mgr.y (mgr.14532) 196 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:25.699401+0000 mgr.y (mgr.14532) 197 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:25.999035+0000 osd.0 (osd.0) 5 : cluster [DBG] 13.3 deep-scrub starts 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.004172+0000 osd.0 (osd.0) 6 : cluster [DBG] 13.3 deep-scrub ok 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.412064+0000 osd.4 (osd.4) 7 : cluster [DBG] 13.5 deep-scrub starts 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.415464+0000 osd.4 (osd.4) 8 : cluster [DBG] 13.5 deep-scrub ok 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.442560+0000 mon.a (mon.0) 1246 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:26.444498+0000 mon.a (mon.0) 1247 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:26.478370+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9"}]': finished 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.478639+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:26.486097+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]: dispatch 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:26.487806+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]: dispatch 2024-09-17T08:56:27.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:26.488723+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? 172.21.15.78:0/862641518' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi078-64680-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.649222+0000 osd.2 (osd.2) 5 : cluster [DBG] 13.8 deep-scrub starts 2024-09-17T08:56:27.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.658115+0000 osd.2 (osd.2) 6 : cluster [DBG] 13.8 deep-scrub ok 2024-09-17T08:56:27.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:26.792986+0000 mgr.y (mgr.14532) 198 : cluster [DBG] pgmap v155: 460 pgs: 104 unknown, 356 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:27.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:27.165264+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]': finished 2024-09-17T08:56:27.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:27.165342+0000 mon.a (mon.0) 1253 : audit [INF] from='client.? 172.21.15.78:0/862641518' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi078-64680-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:27.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: cluster 2024-09-17T08:56:27.165639+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-09-17T08:56:27.859 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:27.166953+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.860 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:27.171771+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.860 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:27.184898+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.78:0/2264767790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.860 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:27.187244+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.860 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[32124]: audit 2024-09-17T08:56:27.447722+0000 mon.a (mon.0) 1257 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.656201+0000 mgr.y (mgr.14532) 188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.661509+0000 mgr.y (mgr.14532) 189 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.664063+0000 mgr.y (mgr.14532) 190 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.665716+0000 mgr.y (mgr.14532) 191 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.673129+0000 mgr.y (mgr.14532) 192 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.678519+0000 mgr.y (mgr.14532) 193 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.694087+0000 mgr.y (mgr.14532) 194 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.696198+0000 mgr.y (mgr.14532) 195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-09-17T08:56:27.865 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.698084+0000 mgr.y (mgr.14532) 196 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:25.699401+0000 mgr.y (mgr.14532) 197 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:25.999035+0000 osd.0 (osd.0) 5 : cluster [DBG] 13.3 deep-scrub starts 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.004172+0000 osd.0 (osd.0) 6 : cluster [DBG] 13.3 deep-scrub ok 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.412064+0000 osd.4 (osd.4) 7 : cluster [DBG] 13.5 deep-scrub starts 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.415464+0000 osd.4 (osd.4) 8 : cluster [DBG] 13.5 deep-scrub ok 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.442560+0000 mon.a (mon.0) 1246 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:26.444498+0000 mon.a (mon.0) 1247 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:26.478370+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-9"}]': finished 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.478639+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:26.486097+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]: dispatch 2024-09-17T08:56:27.866 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:26.487806+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]: dispatch 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:26.488723+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? 172.21.15.78:0/862641518' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi078-64680-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.649222+0000 osd.2 (osd.2) 5 : cluster [DBG] 13.8 deep-scrub starts 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.658115+0000 osd.2 (osd.2) 6 : cluster [DBG] 13.8 deep-scrub ok 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:26.792986+0000 mgr.y (mgr.14532) 198 : cluster [DBG] pgmap v155: 460 pgs: 104 unknown, 356 active+clean; 145 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:27.165264+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache", "force_nonempty":""}]': finished 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:27.165342+0000 mon.a (mon.0) 1253 : audit [INF] from='client.? 172.21.15.78:0/862641518' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi078-64680-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: cluster 2024-09-17T08:56:27.165639+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:27.166953+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:27.171771+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:27.184898+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.78:0/2264767790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:27.187244+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:27.867 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22670]: audit 2024-09-17T08:56:27.447722+0000 mon.a (mon.0) 1257 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:28.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:56:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:56:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:56:29.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: cluster 2024-09-17T08:56:27.653850+0000 osd.7 (osd.7) 7 : cluster [DBG] 13.0 deep-scrub starts 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: cluster 2024-09-17T08:56:27.659436+0000 osd.7 (osd.7) 8 : cluster [DBG] 13.0 deep-scrub ok 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: audit 2024-09-17T08:56:28.155139+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: audit 2024-09-17T08:56:28.155303+0000 mon.a (mon.0) 1259 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: cluster 2024-09-17T08:56:28.155430+0000 mon.a (mon.0) 1260 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: audit 2024-09-17T08:56:28.170247+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]: dispatch 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: audit 2024-09-17T08:56:28.695356+0000 mon.a (mon.0) 1261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]: dispatch 2024-09-17T08:56:29.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:29 smithi136 bash[24812]: audit 2024-09-17T08:56:28.695725+0000 mon.a (mon.0) 1262 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: cluster 2024-09-17T08:56:27.653850+0000 osd.7 (osd.7) 7 : cluster [DBG] 13.0 deep-scrub starts 2024-09-17T08:56:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: cluster 2024-09-17T08:56:27.659436+0000 osd.7 (osd.7) 8 : cluster [DBG] 13.0 deep-scrub ok 2024-09-17T08:56:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: audit 2024-09-17T08:56:28.155139+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:29.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: audit 2024-09-17T08:56:28.155303+0000 mon.a (mon.0) 1259 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: cluster 2024-09-17T08:56:28.155430+0000 mon.a (mon.0) 1260 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: audit 2024-09-17T08:56:28.170247+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]: dispatch 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: audit 2024-09-17T08:56:28.695356+0000 mon.a (mon.0) 1261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]: dispatch 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[22670]: audit 2024-09-17T08:56:28.695725+0000 mon.a (mon.0) 1262 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: cluster 2024-09-17T08:56:27.653850+0000 osd.7 (osd.7) 7 : cluster [DBG] 13.0 deep-scrub starts 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: cluster 2024-09-17T08:56:27.659436+0000 osd.7 (osd.7) 8 : cluster [DBG] 13.0 deep-scrub ok 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: audit 2024-09-17T08:56:28.155139+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64883-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: audit 2024-09-17T08:56:28.155303+0000 mon.a (mon.0) 1259 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi078-64688-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: cluster 2024-09-17T08:56:28.155430+0000 mon.a (mon.0) 1260 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: audit 2024-09-17T08:56:28.170247+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.78:0/3524110462' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]: dispatch 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: audit 2024-09-17T08:56:28.695356+0000 mon.a (mon.0) 1261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]: dispatch 2024-09-17T08:56:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:29 smithi078 bash[32124]: audit 2024-09-17T08:56:28.695725+0000 mon.a (mon.0) 1262 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:30.310 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-09-17T08:56:30.310 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] Global test environment set-up. 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: 2024-09-17T08:55:40.585+0000 7fbf8c546880 -1 failed for service _ceph-mon._tcp 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: 2024-09-17T08:55:40.585+0000 7fbf8c546880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (859 ms) 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-17T08:56:30.311 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5014 ms) 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5873 ms total) 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: started 0x55bfa48d3cc0 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: started 0x55bfa4bf5340 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: started 2 aios 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: waiting 0x55bfa48d3cc0 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: waiting 0x55bfa4bf5340 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: done. 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (10916 ms) 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (10916 ms total) 2024-09-17T08:56:30.312 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.Exec (108 ms) 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (10 ms) 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (3 ms) 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5317 ms) 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-17T08:56:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (23430 ms) 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] 8 tests from LibRadosMisc (28868 ms total) 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [----------] Global test environment tear-down 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (50557 ms total) 2024-09-17T08:56:30.314 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc: [ PASSED ] 12 tests. 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: cluster 2024-09-17T08:56:28.624628+0000 osd.7 (osd.7) 9 : cluster [DBG] 13.7 deep-scrub starts 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: cluster 2024-09-17T08:56:28.628106+0000 osd.7 (osd.7) 10 : cluster [DBG] 13.7 deep-scrub ok 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: cluster 2024-09-17T08:56:28.793492+0000 mgr.y (mgr.14532) 199 : cluster [DBG] pgmap v158: 428 pgs: 32 creating+peering, 396 active+clean; 218 MiB data, 1018 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 3 op/s 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: audit 2024-09-17T08:56:29.269177+0000 mon.a (mon.0) 1263 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]': finished 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: cluster 2024-09-17T08:56:29.269295+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: audit 2024-09-17T08:56:29.278127+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.78:0/1112820526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: audit 2024-09-17T08:56:29.281445+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: audit 2024-09-17T08:56:29.281772+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: cluster 2024-09-17T08:56:29.302676+0000 mon.a (mon.0) 1267 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:30.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: audit 2024-09-17T08:56:29.314617+0000 mgr.y (mgr.14532) 200 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:30.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: cluster 2024-09-17T08:56:29.586146+0000 osd.6 (osd.6) 7 : cluster [DBG] 13.1 deep-scrub starts 2024-09-17T08:56:30.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: cluster 2024-09-17T08:56:29.592261+0000 osd.6 (osd.6) 8 : cluster [DBG] 13.1 deep-scrub ok 2024-09-17T08:56:30.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:30 smithi136 bash[24812]: audit 2024-09-17T08:56:29.847291+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: cluster 2024-09-17T08:56:28.624628+0000 osd.7 (osd.7) 9 : cluster [DBG] 13.7 deep-scrub starts 2024-09-17T08:56:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: cluster 2024-09-17T08:56:28.628106+0000 osd.7 (osd.7) 10 : cluster [DBG] 13.7 deep-scrub ok 2024-09-17T08:56:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: cluster 2024-09-17T08:56:28.793492+0000 mgr.y (mgr.14532) 199 : cluster [DBG] pgmap v158: 428 pgs: 32 creating+peering, 396 active+clean; 218 MiB data, 1018 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 3 op/s 2024-09-17T08:56:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: audit 2024-09-17T08:56:29.269177+0000 mon.a (mon.0) 1263 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]': finished 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: cluster 2024-09-17T08:56:29.269295+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: audit 2024-09-17T08:56:29.278127+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.78:0/1112820526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: audit 2024-09-17T08:56:29.281445+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: audit 2024-09-17T08:56:29.281772+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: cluster 2024-09-17T08:56:29.302676+0000 mon.a (mon.0) 1267 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: audit 2024-09-17T08:56:29.314617+0000 mgr.y (mgr.14532) 200 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: cluster 2024-09-17T08:56:29.586146+0000 osd.6 (osd.6) 7 : cluster [DBG] 13.1 deep-scrub starts 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: cluster 2024-09-17T08:56:29.592261+0000 osd.6 (osd.6) 8 : cluster [DBG] 13.1 deep-scrub ok 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[22670]: audit 2024-09-17T08:56:29.847291+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: cluster 2024-09-17T08:56:28.624628+0000 osd.7 (osd.7) 9 : cluster [DBG] 13.7 deep-scrub starts 2024-09-17T08:56:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: cluster 2024-09-17T08:56:28.628106+0000 osd.7 (osd.7) 10 : cluster [DBG] 13.7 deep-scrub ok 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: cluster 2024-09-17T08:56:28.793492+0000 mgr.y (mgr.14532) 199 : cluster [DBG] pgmap v158: 428 pgs: 32 creating+peering, 396 active+clean; 218 MiB data, 1018 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 3 op/s 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: audit 2024-09-17T08:56:29.269177+0000 mon.a (mon.0) 1263 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64883-10", "tierpool":"test-rados-api-smithi078-64883-10-cache"}]': finished 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: cluster 2024-09-17T08:56:29.269295+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: audit 2024-09-17T08:56:29.278127+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.78:0/1112820526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: audit 2024-09-17T08:56:29.281445+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: audit 2024-09-17T08:56:29.281772+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: cluster 2024-09-17T08:56:29.302676+0000 mon.a (mon.0) 1267 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: audit 2024-09-17T08:56:29.314617+0000 mgr.y (mgr.14532) 200 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: cluster 2024-09-17T08:56:29.586146+0000 osd.6 (osd.6) 7 : cluster [DBG] 13.1 deep-scrub starts 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: cluster 2024-09-17T08:56:29.592261+0000 osd.6 (osd.6) 8 : cluster [DBG] 13.1 deep-scrub ok 2024-09-17T08:56:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:30 smithi078 bash[32124]: audit 2024-09-17T08:56:29.847291+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:31.302 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: Running main() from gmock_main.cc 2024-09-17T08:56:31.302 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-09-17T08:56:31.302 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [----------] Global test environment set-up. 2024-09-17T08:56:31.302 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-09-17T08:56:31.302 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-09-17T08:56:31.302 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolList (11574 ms) 2024-09-17T08:56:31.302 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (5199 ms) 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (4599 ms) 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3020 ms) 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3468 ms) 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5511 ms) 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4964 ms) 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (4991 ms) 2024-09-17T08:56:31.303 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-17T08:56:31.304 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8226 ms) 2024-09-17T08:56:31.304 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [----------] 9 tests from LibRadosPools (51552 ms total) 2024-09-17T08:56:31.304 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: 2024-09-17T08:56:31.304 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [----------] Global test environment tear-down 2024-09-17T08:56:31.304 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (51552 ms total) 2024-09-17T08:56:31.304 INFO:tasks.workunit.client.0.smithi078.stdout: api_pool: [ PASSED ] 9 tests. 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: cluster 2024-09-17T08:56:29.492685+0000 osd.5 (osd.5) 8 : cluster [DBG] 13.9 deep-scrub starts 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: cluster 2024-09-17T08:56:29.555153+0000 osd.5 (osd.5) 9 : cluster [DBG] 13.9 deep-scrub ok 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: audit 2024-09-17T08:56:30.275355+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: audit 2024-09-17T08:56:30.275551+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: cluster 2024-09-17T08:56:30.276359+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: audit 2024-09-17T08:56:30.284566+0000 mon.b (mon.1) 72 : audit [INF] from='client.? 172.21.15.78:0/2121183613' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: audit 2024-09-17T08:56:30.289551+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: cluster 2024-09-17T08:56:30.595056+0000 osd.6 (osd.6) 9 : cluster [DBG] 13.4 deep-scrub starts 2024-09-17T08:56:31.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: cluster 2024-09-17T08:56:30.598462+0000 osd.6 (osd.6) 10 : cluster [DBG] 13.4 deep-scrub ok 2024-09-17T08:56:31.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: cluster 2024-09-17T08:56:30.794411+0000 mgr.y (mgr.14532) 201 : cluster [DBG] pgmap v161: 428 pgs: 96 unknown, 332 active+clean; 218 MiB data, 1018 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 1 op/s 2024-09-17T08:56:31.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:31 smithi136 bash[24812]: audit 2024-09-17T08:56:30.848951+0000 mon.a (mon.0) 1273 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: cluster 2024-09-17T08:56:29.492685+0000 osd.5 (osd.5) 8 : cluster [DBG] 13.9 deep-scrub starts 2024-09-17T08:56:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: cluster 2024-09-17T08:56:29.555153+0000 osd.5 (osd.5) 9 : cluster [DBG] 13.9 deep-scrub ok 2024-09-17T08:56:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: audit 2024-09-17T08:56:30.275355+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: audit 2024-09-17T08:56:30.275551+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: cluster 2024-09-17T08:56:30.276359+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: audit 2024-09-17T08:56:30.284566+0000 mon.b (mon.1) 72 : audit [INF] from='client.? 172.21.15.78:0/2121183613' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: audit 2024-09-17T08:56:30.289551+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: cluster 2024-09-17T08:56:30.595056+0000 osd.6 (osd.6) 9 : cluster [DBG] 13.4 deep-scrub starts 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: cluster 2024-09-17T08:56:30.598462+0000 osd.6 (osd.6) 10 : cluster [DBG] 13.4 deep-scrub ok 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: cluster 2024-09-17T08:56:30.794411+0000 mgr.y (mgr.14532) 201 : cluster [DBG] pgmap v161: 428 pgs: 96 unknown, 332 active+clean; 218 MiB data, 1018 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 1 op/s 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[32124]: audit 2024-09-17T08:56:30.848951+0000 mon.a (mon.0) 1273 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: cluster 2024-09-17T08:56:29.492685+0000 osd.5 (osd.5) 8 : cluster [DBG] 13.9 deep-scrub starts 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: cluster 2024-09-17T08:56:29.555153+0000 osd.5 (osd.5) 9 : cluster [DBG] 13.9 deep-scrub ok 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: audit 2024-09-17T08:56:30.275355+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: audit 2024-09-17T08:56:30.275551+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi078-64680-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: cluster 2024-09-17T08:56:30.276359+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-17T08:56:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: audit 2024-09-17T08:56:30.284566+0000 mon.b (mon.1) 72 : audit [INF] from='client.? 172.21.15.78:0/2121183613' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: audit 2024-09-17T08:56:30.289551+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: cluster 2024-09-17T08:56:30.595056+0000 osd.6 (osd.6) 9 : cluster [DBG] 13.4 deep-scrub starts 2024-09-17T08:56:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: cluster 2024-09-17T08:56:30.598462+0000 osd.6 (osd.6) 10 : cluster [DBG] 13.4 deep-scrub ok 2024-09-17T08:56:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: cluster 2024-09-17T08:56:30.794411+0000 mgr.y (mgr.14532) 201 : cluster [DBG] pgmap v161: 428 pgs: 96 unknown, 332 active+clean; 218 MiB data, 1018 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 1 op/s 2024-09-17T08:56:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:31 smithi078 bash[22670]: audit 2024-09-17T08:56:30.848951+0000 mon.a (mon.0) 1273 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:33.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: cluster 2024-09-17T08:56:30.478586+0000 osd.5 (osd.5) 10 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:33.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: cluster 2024-09-17T08:56:30.485105+0000 osd.5 (osd.5) 11 : cluster [DBG] 13.2 deep-scrub ok 2024-09-17T08:56:33.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: audit 2024-09-17T08:56:31.286898+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:33.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: cluster 2024-09-17T08:56:31.287566+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-17T08:56:33.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: cluster 2024-09-17T08:56:31.441579+0000 osd.4 (osd.4) 9 : cluster [DBG] 13.6 deep-scrub starts 2024-09-17T08:56:33.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: cluster 2024-09-17T08:56:31.444926+0000 osd.4 (osd.4) 10 : cluster [DBG] 13.6 deep-scrub ok 2024-09-17T08:56:33.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: audit 2024-09-17T08:56:31.791762+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:33.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: audit 2024-09-17T08:56:31.850551+0000 mon.a (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:33.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: audit 2024-09-17T08:56:32.154013+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:33.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: cluster 2024-09-17T08:56:32.155491+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-09-17T08:56:33.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: audit 2024-09-17T08:56:32.162283+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-11"}]: dispatch 2024-09-17T08:56:33.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: audit 2024-09-17T08:56:32.164775+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.78:0/3874356291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:33.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:32 smithi136 bash[24812]: audit 2024-09-17T08:56:32.165440+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:33.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: cluster 2024-09-17T08:56:30.478586+0000 osd.5 (osd.5) 10 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:33.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: cluster 2024-09-17T08:56:30.485105+0000 osd.5 (osd.5) 11 : cluster [DBG] 13.2 deep-scrub ok 2024-09-17T08:56:33.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: audit 2024-09-17T08:56:31.286898+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:33.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: cluster 2024-09-17T08:56:31.287566+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: cluster 2024-09-17T08:56:31.441579+0000 osd.4 (osd.4) 9 : cluster [DBG] 13.6 deep-scrub starts 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: cluster 2024-09-17T08:56:31.444926+0000 osd.4 (osd.4) 10 : cluster [DBG] 13.6 deep-scrub ok 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: audit 2024-09-17T08:56:31.791762+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: audit 2024-09-17T08:56:31.850551+0000 mon.a (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: audit 2024-09-17T08:56:32.154013+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: cluster 2024-09-17T08:56:32.155491+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: audit 2024-09-17T08:56:32.162283+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-11"}]: dispatch 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: audit 2024-09-17T08:56:32.164775+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.78:0/3874356291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:33.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[32124]: audit 2024-09-17T08:56:32.165440+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: cluster 2024-09-17T08:56:30.478586+0000 osd.5 (osd.5) 10 : cluster [DBG] 13.2 deep-scrub starts 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: cluster 2024-09-17T08:56:30.485105+0000 osd.5 (osd.5) 11 : cluster [DBG] 13.2 deep-scrub ok 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: audit 2024-09-17T08:56:31.286898+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: cluster 2024-09-17T08:56:31.287566+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: cluster 2024-09-17T08:56:31.441579+0000 osd.4 (osd.4) 9 : cluster [DBG] 13.6 deep-scrub starts 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: cluster 2024-09-17T08:56:31.444926+0000 osd.4 (osd.4) 10 : cluster [DBG] 13.6 deep-scrub ok 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: audit 2024-09-17T08:56:31.791762+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: audit 2024-09-17T08:56:31.850551+0000 mon.a (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: audit 2024-09-17T08:56:32.154013+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:33.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: cluster 2024-09-17T08:56:32.155491+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-09-17T08:56:33.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: audit 2024-09-17T08:56:32.162283+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-11"}]: dispatch 2024-09-17T08:56:33.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: audit 2024-09-17T08:56:32.164775+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.78:0/3874356291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:33.107 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:32 smithi078 bash[22670]: audit 2024-09-17T08:56:32.165440+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:34.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: cluster 2024-09-17T08:56:32.796729+0000 mgr.y (mgr.14532) 202 : cluster [DBG] pgmap v164: 364 pgs: 23 creating+peering, 15 unknown, 326 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:56:34.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: audit 2024-09-17T08:56:32.852306+0000 mon.a (mon.0) 1282 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:34.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: audit 2024-09-17T08:56:33.158172+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-11"}]': finished 2024-09-17T08:56:34.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: audit 2024-09-17T08:56:33.158711+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:34.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: cluster 2024-09-17T08:56:33.159702+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-09-17T08:56:34.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: audit 2024-09-17T08:56:33.168972+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.78:0/906763353' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:34.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: audit 2024-09-17T08:56:33.170969+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-11", "mode": "writeback"}]: dispatch 2024-09-17T08:56:34.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:33 smithi136 bash[24812]: audit 2024-09-17T08:56:33.178510+0000 mon.a (mon.0) 1287 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: cluster 2024-09-17T08:56:32.796729+0000 mgr.y (mgr.14532) 202 : cluster [DBG] pgmap v164: 364 pgs: 23 creating+peering, 15 unknown, 326 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:56:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: audit 2024-09-17T08:56:32.852306+0000 mon.a (mon.0) 1282 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: audit 2024-09-17T08:56:33.158172+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-11"}]': finished 2024-09-17T08:56:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: audit 2024-09-17T08:56:33.158711+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: cluster 2024-09-17T08:56:33.159702+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: audit 2024-09-17T08:56:33.168972+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.78:0/906763353' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: audit 2024-09-17T08:56:33.170969+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-11", "mode": "writeback"}]: dispatch 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[22670]: audit 2024-09-17T08:56:33.178510+0000 mon.a (mon.0) 1287 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: cluster 2024-09-17T08:56:32.796729+0000 mgr.y (mgr.14532) 202 : cluster [DBG] pgmap v164: 364 pgs: 23 creating+peering, 15 unknown, 326 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: audit 2024-09-17T08:56:32.852306+0000 mon.a (mon.0) 1282 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: audit 2024-09-17T08:56:33.158172+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-11"}]': finished 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: audit 2024-09-17T08:56:33.158711+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi078-64680-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: cluster 2024-09-17T08:56:33.159702+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: audit 2024-09-17T08:56:33.168972+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.78:0/906763353' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: audit 2024-09-17T08:56:33.170969+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-11", "mode": "writeback"}]: dispatch 2024-09-17T08:56:34.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:33 smithi078 bash[32124]: audit 2024-09-17T08:56:33.178510+0000 mon.a (mon.0) 1287 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:34 smithi136 bash[24812]: audit 2024-09-17T08:56:33.854089+0000 mon.a (mon.0) 1288 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:34 smithi136 bash[24812]: cluster 2024-09-17T08:56:34.150609+0000 mon.a (mon.0) 1289 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:34 smithi136 bash[24812]: audit 2024-09-17T08:56:34.161654+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-11", "mode": "writeback"}]': finished 2024-09-17T08:56:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:34 smithi136 bash[24812]: audit 2024-09-17T08:56:34.161913+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:34 smithi136 bash[24812]: cluster 2024-09-17T08:56:34.162370+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-09-17T08:56:35.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[22670]: audit 2024-09-17T08:56:33.854089+0000 mon.a (mon.0) 1288 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:35.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[22670]: cluster 2024-09-17T08:56:34.150609+0000 mon.a (mon.0) 1289 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:35.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[22670]: audit 2024-09-17T08:56:34.161654+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-11", "mode": "writeback"}]': finished 2024-09-17T08:56:35.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[22670]: audit 2024-09-17T08:56:34.161913+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:35.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[22670]: cluster 2024-09-17T08:56:34.162370+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-09-17T08:56:35.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[32124]: audit 2024-09-17T08:56:33.854089+0000 mon.a (mon.0) 1288 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:35.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[32124]: cluster 2024-09-17T08:56:34.150609+0000 mon.a (mon.0) 1289 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:35.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[32124]: audit 2024-09-17T08:56:34.161654+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-11", "mode": "writeback"}]': finished 2024-09-17T08:56:35.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[32124]: audit 2024-09-17T08:56:34.161913+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi078-64688-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:35.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:34 smithi078 bash[32124]: cluster 2024-09-17T08:56:34.162370+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-09-17T08:56:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:35 smithi136 bash[24812]: cluster 2024-09-17T08:56:34.797662+0000 mgr.y (mgr.14532) 203 : cluster [DBG] pgmap v167: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1012 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-09-17T08:56:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:35 smithi136 bash[24812]: audit 2024-09-17T08:56:34.855744+0000 mon.a (mon.0) 1293 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:35 smithi136 bash[24812]: cluster 2024-09-17T08:56:35.166422+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-17T08:56:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:35 smithi136 bash[24812]: audit 2024-09-17T08:56:35.173615+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? 172.21.15.78:0/3732520372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi078-64680-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:35 smithi136 bash[24812]: audit 2024-09-17T08:56:35.176666+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[22670]: cluster 2024-09-17T08:56:34.797662+0000 mgr.y (mgr.14532) 203 : cluster [DBG] pgmap v167: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1012 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-09-17T08:56:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[22670]: audit 2024-09-17T08:56:34.855744+0000 mon.a (mon.0) 1293 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[22670]: cluster 2024-09-17T08:56:35.166422+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-17T08:56:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[22670]: audit 2024-09-17T08:56:35.173615+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? 172.21.15.78:0/3732520372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi078-64680-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:36.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[22670]: audit 2024-09-17T08:56:35.176666+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:36.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[32124]: cluster 2024-09-17T08:56:34.797662+0000 mgr.y (mgr.14532) 203 : cluster [DBG] pgmap v167: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1012 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-09-17T08:56:36.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[32124]: audit 2024-09-17T08:56:34.855744+0000 mon.a (mon.0) 1293 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:36.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[32124]: cluster 2024-09-17T08:56:35.166422+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-17T08:56:36.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[32124]: audit 2024-09-17T08:56:35.173615+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? 172.21.15.78:0/3732520372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi078-64680-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:36.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:35 smithi078 bash[32124]: audit 2024-09-17T08:56:35.176666+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: cluster 2024-09-17T08:56:35.646131+0000 mon.a (mon.0) 1297 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:35.646515+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:35.857402+0000 mon.a (mon.0) 1299 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:36.170334+0000 mon.a (mon.0) 1300 : audit [INF] from='client.? 172.21.15.78:0/3732520372' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi078-64680-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:36.170647+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:36.171195+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: cluster 2024-09-17T08:56:36.171330+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-17T08:56:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:36.173165+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:37.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:36.173524+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11"}]: dispatch 2024-09-17T08:56:37.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:36.186876+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.78:0/254566022' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:37.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:36 smithi136 bash[24812]: audit 2024-09-17T08:56:36.188056+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:37.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: cluster 2024-09-17T08:56:35.646131+0000 mon.a (mon.0) 1297 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:37.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:35.646515+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:37.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:35.857402+0000 mon.a (mon.0) 1299 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:36.170334+0000 mon.a (mon.0) 1300 : audit [INF] from='client.? 172.21.15.78:0/3732520372' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi078-64680-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:36.170647+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:36.171195+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: cluster 2024-09-17T08:56:36.171330+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:36.173165+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:36.173524+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11"}]: dispatch 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:36.186876+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.78:0/254566022' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[22670]: audit 2024-09-17T08:56:36.188056+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: cluster 2024-09-17T08:56:35.646131+0000 mon.a (mon.0) 1297 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:37.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:35.646515+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:35.857402+0000 mon.a (mon.0) 1299 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:36.170334+0000 mon.a (mon.0) 1300 : audit [INF] from='client.? 172.21.15.78:0/3732520372' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi078-64680-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:36.170647+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:36.171195+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: cluster 2024-09-17T08:56:36.171330+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:36.173165+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]: dispatch 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:36.173524+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11"}]: dispatch 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:36.186876+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.78:0/254566022' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:37.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:36 smithi078 bash[32124]: audit 2024-09-17T08:56:36.188056+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:37.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: cluster 2024-09-17T08:56:36.798529+0000 mgr.y (mgr.14532) 204 : cluster [DBG] pgmap v170: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1012 MiB used, 714 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-09-17T08:56:37.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: audit 2024-09-17T08:56:36.859092+0000 mon.a (mon.0) 1307 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:37.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: cluster 2024-09-17T08:56:37.146277+0000 mon.a (mon.0) 1308 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:37.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: audit 2024-09-17T08:56:37.158910+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:37.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: audit 2024-09-17T08:56:37.159140+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11"}]': finished 2024-09-17T08:56:37.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: audit 2024-09-17T08:56:37.159557+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: cluster 2024-09-17T08:56:37.160018+0000 mon.a (mon.0) 1312 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: audit 2024-09-17T08:56:37.211645+0000 mon.c (mon.2) 119 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22670]: audit 2024-09-17T08:56:37.212920+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: cluster 2024-09-17T08:56:36.798529+0000 mgr.y (mgr.14532) 204 : cluster [DBG] pgmap v170: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1012 MiB used, 714 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: audit 2024-09-17T08:56:36.859092+0000 mon.a (mon.0) 1307 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: cluster 2024-09-17T08:56:37.146277+0000 mon.a (mon.0) 1308 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: audit 2024-09-17T08:56:37.158910+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: audit 2024-09-17T08:56:37.159140+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11"}]': finished 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: audit 2024-09-17T08:56:37.159557+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: cluster 2024-09-17T08:56:37.160018+0000 mon.a (mon.0) 1312 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-09-17T08:56:37.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: audit 2024-09-17T08:56:37.211645+0000 mon.c (mon.2) 119 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:37.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[32124]: audit 2024-09-17T08:56:37.212920+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: cluster 2024-09-17T08:56:36.798529+0000 mgr.y (mgr.14532) 204 : cluster [DBG] pgmap v170: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 1012 MiB used, 714 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: audit 2024-09-17T08:56:36.859092+0000 mon.a (mon.0) 1307 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: cluster 2024-09-17T08:56:37.146277+0000 mon.a (mon.0) 1308 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: audit 2024-09-17T08:56:37.158910+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? 172.21.15.78:0/1018440871' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi078-64886-10"}]': finished 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: audit 2024-09-17T08:56:37.159140+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-11"}]': finished 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: audit 2024-09-17T08:56:37.159557+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi078-64688-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: cluster 2024-09-17T08:56:37.160018+0000 mon.a (mon.0) 1312 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: audit 2024-09-17T08:56:37.211645+0000 mon.c (mon.2) 119 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:37 smithi136 bash[24812]: audit 2024-09-17T08:56:37.212920+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:56:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:56:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:56:39.324 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:37.218771+0000 mon.c (mon.2) 120 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:37.662524+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:37.663604+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:37.669389+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:37.860773+0000 mon.a (mon.0) 1316 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:38.160797+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: cluster 2024-09-17T08:56:38.161035+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:38.163383+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.78:0/851769167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:38.163827+0000 mon.c (mon.2) 123 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:38.165309+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:39.325 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[24812]: audit 2024-09-17T08:56:38.165714+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:37.218771+0000 mon.c (mon.2) 120 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:37.662524+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:37.663604+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:37.669389+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:37.860773+0000 mon.a (mon.0) 1316 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:38.160797+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: cluster 2024-09-17T08:56:38.161035+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:38.163383+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.78:0/851769167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:38.163827+0000 mon.c (mon.2) 123 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:38.165309+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[22670]: audit 2024-09-17T08:56:38.165714+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:37.218771+0000 mon.c (mon.2) 120 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:37.662524+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:37.663604+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:37.669389+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:37.860773+0000 mon.a (mon.0) 1316 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:38.160797+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: cluster 2024-09-17T08:56:38.161035+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:38.163383+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.78:0/851769167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:38.163827+0000 mon.c (mon.2) 123 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:38.165309+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:39 smithi078 bash[32124]: audit 2024-09-17T08:56:38.165714+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:39.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:56:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: cluster 2024-09-17T08:56:38.799376+0000 mgr.y (mgr.14532) 205 : cluster [DBG] pgmap v173: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 1001 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:39.064280+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:39.170421+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:39.325923+0000 mgr.y (mgr.14532) 206 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: cluster 2024-09-17T08:56:39.617870+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:39.620377+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:39.621057+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? 172.21.15.78:0/886331161' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi078-64688-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:39.910877+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:39.913270+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[32124]: audit 2024-09-17T08:56:40.065967+0000 mon.a (mon.0) 1328 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: cluster 2024-09-17T08:56:38.799376+0000 mgr.y (mgr.14532) 205 : cluster [DBG] pgmap v173: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 1001 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:39.064280+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:39.170421+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:39.325923+0000 mgr.y (mgr.14532) 206 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: cluster 2024-09-17T08:56:39.617870+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:39.620377+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:39.621057+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? 172.21.15.78:0/886331161' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi078-64688-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:40.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:39.910877+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:40.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:39.913270+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:40.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:40 smithi078 bash[22670]: audit 2024-09-17T08:56:40.065967+0000 mon.a (mon.0) 1328 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:40.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: cluster 2024-09-17T08:56:38.799376+0000 mgr.y (mgr.14532) 205 : cluster [DBG] pgmap v173: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 1001 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T08:56:40.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:39.064280+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:40.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:39.170421+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi078-64680-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:40.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:39.325923+0000 mgr.y (mgr.14532) 206 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:40.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: cluster 2024-09-17T08:56:39.617870+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-09-17T08:56:40.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:39.620377+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:40.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:39.621057+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? 172.21.15.78:0/886331161' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi078-64688-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:40.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:39.910877+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:40.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:39.913270+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:40.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:40 smithi136 bash[24812]: audit 2024-09-17T08:56:40.065967+0000 mon.a (mon.0) 1328 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:41 smithi136 bash[24812]: audit 2024-09-17T08:56:40.174201+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:41 smithi136 bash[24812]: audit 2024-09-17T08:56:40.174527+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:41 smithi136 bash[24812]: audit 2024-09-17T08:56:40.174712+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? 172.21.15.78:0/886331161' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi078-64688-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:41 smithi136 bash[24812]: cluster 2024-09-17T08:56:40.175228+0000 mon.a (mon.0) 1332 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-17T08:56:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:41 smithi136 bash[24812]: cluster 2024-09-17T08:56:40.800274+0000 mgr.y (mgr.14532) 207 : cluster [DBG] pgmap v176: 364 pgs: 72 unknown, 292 active+clean; 217 MiB data, 1001 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T08:56:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:41 smithi136 bash[24812]: audit 2024-09-17T08:56:41.067562+0000 mon.a (mon.0) 1333 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[22670]: audit 2024-09-17T08:56:40.174201+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[22670]: audit 2024-09-17T08:56:40.174527+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[22670]: audit 2024-09-17T08:56:40.174712+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? 172.21.15.78:0/886331161' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi078-64688-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[22670]: cluster 2024-09-17T08:56:40.175228+0000 mon.a (mon.0) 1332 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-17T08:56:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[22670]: cluster 2024-09-17T08:56:40.800274+0000 mgr.y (mgr.14532) 207 : cluster [DBG] pgmap v176: 364 pgs: 72 unknown, 292 active+clean; 217 MiB data, 1001 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T08:56:41.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[22670]: audit 2024-09-17T08:56:41.067562+0000 mon.a (mon.0) 1333 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[32124]: audit 2024-09-17T08:56:40.174201+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi078-64886-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[32124]: audit 2024-09-17T08:56:40.174527+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[32124]: audit 2024-09-17T08:56:40.174712+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? 172.21.15.78:0/886331161' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi078-64688-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[32124]: cluster 2024-09-17T08:56:40.175228+0000 mon.a (mon.0) 1332 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-17T08:56:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[32124]: cluster 2024-09-17T08:56:40.800274+0000 mgr.y (mgr.14532) 207 : cluster [DBG] pgmap v176: 364 pgs: 72 unknown, 292 active+clean; 217 MiB data, 1001 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T08:56:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:41 smithi078 bash[32124]: audit 2024-09-17T08:56:41.067562+0000 mon.a (mon.0) 1333 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:42 smithi136 bash[24812]: cluster 2024-09-17T08:56:41.181491+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-17T08:56:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:42 smithi136 bash[24812]: audit 2024-09-17T08:56:41.193452+0000 mon.c (mon.2) 124 : audit [INF] from='client.? 172.21.15.78:0/3075025199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:42 smithi136 bash[24812]: audit 2024-09-17T08:56:41.204140+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:42 smithi136 bash[24812]: audit 2024-09-17T08:56:42.069212+0000 mon.a (mon.0) 1336 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:42 smithi136 bash[24812]: audit 2024-09-17T08:56:42.171546+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:42 smithi136 bash[24812]: cluster 2024-09-17T08:56:42.172031+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-09-17T08:56:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:42 smithi136 bash[24812]: audit 2024-09-17T08:56:42.176279+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? 172.21.15.78:0/3318729512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi078-64688-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[22670]: cluster 2024-09-17T08:56:41.181491+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-17T08:56:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[22670]: audit 2024-09-17T08:56:41.193452+0000 mon.c (mon.2) 124 : audit [INF] from='client.? 172.21.15.78:0/3075025199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[22670]: audit 2024-09-17T08:56:41.204140+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[22670]: audit 2024-09-17T08:56:42.069212+0000 mon.a (mon.0) 1336 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[22670]: audit 2024-09-17T08:56:42.171546+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[22670]: cluster 2024-09-17T08:56:42.172031+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[22670]: audit 2024-09-17T08:56:42.176279+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? 172.21.15.78:0/3318729512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi078-64688-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[32124]: cluster 2024-09-17T08:56:41.181491+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[32124]: audit 2024-09-17T08:56:41.193452+0000 mon.c (mon.2) 124 : audit [INF] from='client.? 172.21.15.78:0/3075025199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[32124]: audit 2024-09-17T08:56:41.204140+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[32124]: audit 2024-09-17T08:56:42.069212+0000 mon.a (mon.0) 1336 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[32124]: audit 2024-09-17T08:56:42.171546+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi078-64680-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[32124]: cluster 2024-09-17T08:56:42.172031+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-09-17T08:56:42.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:42 smithi078 bash[32124]: audit 2024-09-17T08:56:42.176279+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? 172.21.15.78:0/3318729512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi078-64688-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:43.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:43 smithi136 bash[24812]: cluster 2024-09-17T08:56:42.803066+0000 mgr.y (mgr.14532) 208 : cluster [DBG] pgmap v179: 396 pgs: 26 creating+peering, 31 unknown, 339 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 62 KiB/s wr, 60 op/s 2024-09-17T08:56:43.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:43 smithi136 bash[24812]: audit 2024-09-17T08:56:43.070953+0000 mon.a (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:43.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:43 smithi136 bash[24812]: audit 2024-09-17T08:56:43.170052+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? 172.21.15.78:0/3318729512' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi078-64688-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:43.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:43 smithi136 bash[24812]: cluster 2024-09-17T08:56:43.170820+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-09-17T08:56:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[32124]: cluster 2024-09-17T08:56:42.803066+0000 mgr.y (mgr.14532) 208 : cluster [DBG] pgmap v179: 396 pgs: 26 creating+peering, 31 unknown, 339 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 62 KiB/s wr, 60 op/s 2024-09-17T08:56:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[32124]: audit 2024-09-17T08:56:43.070953+0000 mon.a (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[32124]: audit 2024-09-17T08:56:43.170052+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? 172.21.15.78:0/3318729512' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi078-64688-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[32124]: cluster 2024-09-17T08:56:43.170820+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-09-17T08:56:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[22670]: cluster 2024-09-17T08:56:42.803066+0000 mgr.y (mgr.14532) 208 : cluster [DBG] pgmap v179: 396 pgs: 26 creating+peering, 31 unknown, 339 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 62 KiB/s wr, 60 op/s 2024-09-17T08:56:43.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[22670]: audit 2024-09-17T08:56:43.070953+0000 mon.a (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:43.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[22670]: audit 2024-09-17T08:56:43.170052+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? 172.21.15.78:0/3318729512' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi078-64688-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:43.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:43 smithi078 bash[22670]: cluster 2024-09-17T08:56:43.170820+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-09-17T08:56:45.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:44 smithi136 bash[24812]: cluster 2024-09-17T08:56:43.200514+0000 mon.a (mon.0) 1343 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:45.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:44 smithi136 bash[24812]: audit 2024-09-17T08:56:44.072601+0000 mon.a (mon.0) 1344 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:45.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:44 smithi136 bash[24812]: cluster 2024-09-17T08:56:44.174939+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-09-17T08:56:45.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:44 smithi136 bash[24812]: audit 2024-09-17T08:56:44.175948+0000 mon.c (mon.2) 125 : audit [INF] from='client.? 172.21.15.78:0/957746567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:45.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:44 smithi136 bash[24812]: audit 2024-09-17T08:56:44.184492+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:45.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[32124]: cluster 2024-09-17T08:56:43.200514+0000 mon.a (mon.0) 1343 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:45.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[32124]: audit 2024-09-17T08:56:44.072601+0000 mon.a (mon.0) 1344 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:45.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[32124]: cluster 2024-09-17T08:56:44.174939+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-09-17T08:56:45.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[32124]: audit 2024-09-17T08:56:44.175948+0000 mon.c (mon.2) 125 : audit [INF] from='client.? 172.21.15.78:0/957746567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:45.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[32124]: audit 2024-09-17T08:56:44.184492+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:45.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[22670]: cluster 2024-09-17T08:56:43.200514+0000 mon.a (mon.0) 1343 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:45.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[22670]: audit 2024-09-17T08:56:44.072601+0000 mon.a (mon.0) 1344 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:45.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[22670]: cluster 2024-09-17T08:56:44.174939+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-09-17T08:56:45.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[22670]: audit 2024-09-17T08:56:44.175948+0000 mon.c (mon.2) 125 : audit [INF] from='client.? 172.21.15.78:0/957746567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:45.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:44 smithi078 bash[22670]: audit 2024-09-17T08:56:44.184492+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: audit 2024-09-17T08:56:44.650424+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: cluster 2024-09-17T08:56:44.803952+0000 mgr.y (mgr.14532) 209 : cluster [DBG] pgmap v182: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 79 KiB/s wr, 76 op/s 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: audit 2024-09-17T08:56:45.074375+0000 mon.a (mon.0) 1348 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: audit 2024-09-17T08:56:45.174348+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: audit 2024-09-17T08:56:45.175412+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: cluster 2024-09-17T08:56:45.175568+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: audit 2024-09-17T08:56:45.180989+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-13"}]: dispatch 2024-09-17T08:56:46.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: audit 2024-09-17T08:56:45.188543+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.78:0/2804941263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:46.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:45 smithi136 bash[24812]: audit 2024-09-17T08:56:45.192218+0000 mon.a (mon.0) 1353 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:46.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: audit 2024-09-17T08:56:44.650424+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:46.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: cluster 2024-09-17T08:56:44.803952+0000 mgr.y (mgr.14532) 209 : cluster [DBG] pgmap v182: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 79 KiB/s wr, 76 op/s 2024-09-17T08:56:46.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: audit 2024-09-17T08:56:45.074375+0000 mon.a (mon.0) 1348 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: audit 2024-09-17T08:56:45.174348+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: audit 2024-09-17T08:56:45.175412+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: cluster 2024-09-17T08:56:45.175568+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: audit 2024-09-17T08:56:45.180989+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-13"}]: dispatch 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: audit 2024-09-17T08:56:45.188543+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.78:0/2804941263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[22670]: audit 2024-09-17T08:56:45.192218+0000 mon.a (mon.0) 1353 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: audit 2024-09-17T08:56:44.650424+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: cluster 2024-09-17T08:56:44.803952+0000 mgr.y (mgr.14532) 209 : cluster [DBG] pgmap v182: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 79 KiB/s wr, 76 op/s 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: audit 2024-09-17T08:56:45.074375+0000 mon.a (mon.0) 1348 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: audit 2024-09-17T08:56:45.174348+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi078-64680-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:46.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: audit 2024-09-17T08:56:45.175412+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:56:46.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: cluster 2024-09-17T08:56:45.175568+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-17T08:56:46.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: audit 2024-09-17T08:56:45.180989+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-13"}]: dispatch 2024-09-17T08:56:46.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: audit 2024-09-17T08:56:45.188543+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.78:0/2804941263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:46.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:45 smithi078 bash[32124]: audit 2024-09-17T08:56:45.192218+0000 mon.a (mon.0) 1353 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:47.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:46 smithi136 bash[24812]: audit 2024-09-17T08:56:46.075970+0000 mon.a (mon.0) 1354 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:47.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:46 smithi136 bash[24812]: audit 2024-09-17T08:56:46.178496+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-13"}]': finished 2024-09-17T08:56:47.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:46 smithi136 bash[24812]: audit 2024-09-17T08:56:46.179011+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:47.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:46 smithi136 bash[24812]: cluster 2024-09-17T08:56:46.179490+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-17T08:56:47.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:46 smithi136 bash[24812]: audit 2024-09-17T08:56:46.191381+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-13", "mode": "writeback"}]: dispatch 2024-09-17T08:56:47.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[22670]: audit 2024-09-17T08:56:46.075970+0000 mon.a (mon.0) 1354 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:47.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[22670]: audit 2024-09-17T08:56:46.178496+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-13"}]': finished 2024-09-17T08:56:47.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[22670]: audit 2024-09-17T08:56:46.179011+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:47.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[22670]: cluster 2024-09-17T08:56:46.179490+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-17T08:56:47.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[22670]: audit 2024-09-17T08:56:46.191381+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-13", "mode": "writeback"}]: dispatch 2024-09-17T08:56:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[32124]: audit 2024-09-17T08:56:46.075970+0000 mon.a (mon.0) 1354 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[32124]: audit 2024-09-17T08:56:46.178496+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-13"}]': finished 2024-09-17T08:56:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[32124]: audit 2024-09-17T08:56:46.179011+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi078-64688-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[32124]: cluster 2024-09-17T08:56:46.179490+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-17T08:56:47.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:46 smithi078 bash[32124]: audit 2024-09-17T08:56:46.191381+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-13", "mode": "writeback"}]: dispatch 2024-09-17T08:56:48.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:47 smithi136 bash[24812]: cluster 2024-09-17T08:56:46.804842+0000 mgr.y (mgr.14532) 210 : cluster [DBG] pgmap v185: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s wr, 16 op/s 2024-09-17T08:56:48.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:47 smithi136 bash[24812]: audit 2024-09-17T08:56:47.077581+0000 mon.a (mon.0) 1359 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:48.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:47 smithi136 bash[24812]: cluster 2024-09-17T08:56:47.171476+0000 mon.a (mon.0) 1360 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:48.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:47 smithi136 bash[24812]: audit 2024-09-17T08:56:47.191451+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-13", "mode": "writeback"}]': finished 2024-09-17T08:56:48.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:47 smithi136 bash[24812]: cluster 2024-09-17T08:56:47.191819+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-09-17T08:56:48.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:47 smithi136 bash[24812]: audit 2024-09-17T08:56:47.199116+0000 mon.c (mon.2) 127 : audit [INF] from='client.? 172.21.15.78:0/3372725250' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:48.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:47 smithi136 bash[24812]: audit 2024-09-17T08:56:47.200036+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:48.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:56:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:56:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[32124]: cluster 2024-09-17T08:56:46.804842+0000 mgr.y (mgr.14532) 210 : cluster [DBG] pgmap v185: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s wr, 16 op/s 2024-09-17T08:56:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[32124]: audit 2024-09-17T08:56:47.077581+0000 mon.a (mon.0) 1359 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[32124]: cluster 2024-09-17T08:56:47.171476+0000 mon.a (mon.0) 1360 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[32124]: audit 2024-09-17T08:56:47.191451+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-13", "mode": "writeback"}]': finished 2024-09-17T08:56:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[32124]: cluster 2024-09-17T08:56:47.191819+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-09-17T08:56:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[32124]: audit 2024-09-17T08:56:47.199116+0000 mon.c (mon.2) 127 : audit [INF] from='client.? 172.21.15.78:0/3372725250' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[32124]: audit 2024-09-17T08:56:47.200036+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22670]: cluster 2024-09-17T08:56:46.804842+0000 mgr.y (mgr.14532) 210 : cluster [DBG] pgmap v185: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 1013 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s wr, 16 op/s 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22670]: audit 2024-09-17T08:56:47.077581+0000 mon.a (mon.0) 1359 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22670]: cluster 2024-09-17T08:56:47.171476+0000 mon.a (mon.0) 1360 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22670]: audit 2024-09-17T08:56:47.191451+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-13", "mode": "writeback"}]': finished 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22670]: cluster 2024-09-17T08:56:47.191819+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22670]: audit 2024-09-17T08:56:47.199116+0000 mon.c (mon.2) 127 : audit [INF] from='client.? 172.21.15.78:0/3372725250' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:48.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:47 smithi078 bash[22670]: audit 2024-09-17T08:56:47.200036+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:49.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.079184+0000 mon.a (mon.0) 1364 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:49.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.187494+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:49.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.188144+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-09-17T08:56:49.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.192772+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.78:0/2551225221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:49.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.213188+0000 mon.a (mon.0) 1367 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.304107+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.0"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.305129+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.1"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.305869+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.2"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.306567+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.3"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.307236+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.4"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.307999+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.5"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.308685+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.6"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.309374+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.7"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.310060+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.8"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: audit 2024-09-17T08:56:48.310774+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.9"}]: dispatch 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.358406+0000 osd.4 (osd.4) 11 : cluster [DBG] 97.3 scrub starts 2024-09-17T08:56:49.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:48 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.363496+0000 osd.4 (osd.4) 12 : cluster [DBG] 97.3 scrub ok 2024-09-17T08:56:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.079184+0000 mon.a (mon.0) 1364 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.187494+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.188144+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.192772+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.78:0/2551225221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.213188+0000 mon.a (mon.0) 1367 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.304107+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.0"}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.305129+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.1"}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.305869+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.2"}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.306567+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.3"}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.307236+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.4"}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.307999+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.5"}]: dispatch 2024-09-17T08:56:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.308685+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.6"}]: dispatch 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.309374+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.7"}]: dispatch 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.310060+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.8"}]: dispatch 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: audit 2024-09-17T08:56:48.310774+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.9"}]: dispatch 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.358406+0000 osd.4 (osd.4) 11 : cluster [DBG] 97.3 scrub starts 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.363496+0000 osd.4 (osd.4) 12 : cluster [DBG] 97.3 scrub ok 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.079184+0000 mon.a (mon.0) 1364 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.187494+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi078-64680-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.188144+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-09-17T08:56:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.192772+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.78:0/2551225221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.213188+0000 mon.a (mon.0) 1367 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.304107+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.0"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.305129+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.1"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.305869+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.2"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.306567+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.3"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.307236+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.4"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.307999+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.5"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.308685+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.6"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.309374+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.7"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.310060+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.8"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: audit 2024-09-17T08:56:48.310774+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "97.9"}]: dispatch 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.358406+0000 osd.4 (osd.4) 11 : cluster [DBG] 97.3 scrub starts 2024-09-17T08:56:49.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:48 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.363496+0000 osd.4 (osd.4) 12 : cluster [DBG] 97.3 scrub ok 2024-09-17T08:56:49.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:56:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:56:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.304378+0000 mgr.y (mgr.14532) 211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.0"}]: dispatch 2024-09-17T08:56:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.305300+0000 mgr.y (mgr.14532) 212 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.1"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.306037+0000 mgr.y (mgr.14532) 213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.2"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.306740+0000 mgr.y (mgr.14532) 214 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.3"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.307394+0000 mgr.y (mgr.14532) 215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.4"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.308167+0000 mgr.y (mgr.14532) 216 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.5"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.308850+0000 mgr.y (mgr.14532) 217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.6"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.309546+0000 mgr.y (mgr.14532) 218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.7"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.310226+0000 mgr.y (mgr.14532) 219 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.8"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:48.310925+0000 mgr.y (mgr.14532) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.9"}]: dispatch 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.534843+0000 osd.3 (osd.3) 3 : cluster [DBG] 97.6 scrub starts 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.539111+0000 osd.3 (osd.3) 4 : cluster [DBG] 97.6 scrub ok 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.805825+0000 mgr.y (mgr.14532) 221 : cluster [DBG] pgmap v188: 396 pgs: 32 unknown, 32 creating+peering, 332 active+clean; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 54 KiB/s wr, 101 op/s 2024-09-17T08:56:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:49.080986+0000 mon.a (mon.0) 1378 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:49.190312+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.191351+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-09-17T08:56:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:49.193960+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:50 smithi136 bash[24812]: audit 2024-09-17T08:56:49.198341+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.304378+0000 mgr.y (mgr.14532) 211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.0"}]: dispatch 2024-09-17T08:56:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.305300+0000 mgr.y (mgr.14532) 212 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.1"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.306037+0000 mgr.y (mgr.14532) 213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.2"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.306740+0000 mgr.y (mgr.14532) 214 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.3"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.307394+0000 mgr.y (mgr.14532) 215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.4"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.308167+0000 mgr.y (mgr.14532) 216 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.5"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.308850+0000 mgr.y (mgr.14532) 217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.6"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.309546+0000 mgr.y (mgr.14532) 218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.7"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.310226+0000 mgr.y (mgr.14532) 219 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.8"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:48.310925+0000 mgr.y (mgr.14532) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.9"}]: dispatch 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.534843+0000 osd.3 (osd.3) 3 : cluster [DBG] 97.6 scrub starts 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.539111+0000 osd.3 (osd.3) 4 : cluster [DBG] 97.6 scrub ok 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.805825+0000 mgr.y (mgr.14532) 221 : cluster [DBG] pgmap v188: 396 pgs: 32 unknown, 32 creating+peering, 332 active+clean; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 54 KiB/s wr, 101 op/s 2024-09-17T08:56:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:49.080986+0000 mon.a (mon.0) 1378 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:49.190312+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.191351+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:49.193960+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[22670]: audit 2024-09-17T08:56:49.198341+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.304378+0000 mgr.y (mgr.14532) 211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.0"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.305300+0000 mgr.y (mgr.14532) 212 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.1"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.306037+0000 mgr.y (mgr.14532) 213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.2"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.306740+0000 mgr.y (mgr.14532) 214 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.3"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.307394+0000 mgr.y (mgr.14532) 215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.4"}]: dispatch 2024-09-17T08:56:50.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.308167+0000 mgr.y (mgr.14532) 216 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.5"}]: dispatch 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.308850+0000 mgr.y (mgr.14532) 217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.6"}]: dispatch 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.309546+0000 mgr.y (mgr.14532) 218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.7"}]: dispatch 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.310226+0000 mgr.y (mgr.14532) 219 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.8"}]: dispatch 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:48.310925+0000 mgr.y (mgr.14532) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "97.9"}]: dispatch 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.534843+0000 osd.3 (osd.3) 3 : cluster [DBG] 97.6 scrub starts 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.539111+0000 osd.3 (osd.3) 4 : cluster [DBG] 97.6 scrub ok 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.805825+0000 mgr.y (mgr.14532) 221 : cluster [DBG] pgmap v188: 396 pgs: 32 unknown, 32 creating+peering, 332 active+clean; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 54 KiB/s wr, 101 op/s 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:49.080986+0000 mon.a (mon.0) 1378 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:49.190312+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi078-64688-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.191351+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:49.193960+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:50.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:50 smithi078 bash[32124]: audit 2024-09-17T08:56:49.198341+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: Running main() from gmock_main.cc 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] Global test environment set-up. 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (5185 ms) 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-09-17T08:56:51.208 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (3911 ms) 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (1692 ms) 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2004 ms) 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (12793 ms total) 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4583 ms) 2024-09-17T08:56:51.209 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (4355 ms) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4966 ms) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (13904 ms total) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2782 ms) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (1583 ms) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1883 ms) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2002 ms) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8251 ms total) 2024-09-17T08:56:51.210 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: 2024-09-17T08:56:51.211 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-17T08:56:51.211 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-17T08:56:51.211 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4045 ms) 2024-09-17T08:56:51.211 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-17T08:56:51.211 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4017 ms) 2024-09-17T08:56:51.211 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8062 ms total) 2024-09-17T08:56:51.212 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: 2024-09-17T08:56:51.212 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [----------] Global test environment tear-down 2024-09-17T08:56:51.212 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (71446 ms total) 2024-09-17T08:56:51.212 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-09-17T08:56:51.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.777975+0000 osd.7 (osd.7) 11 : cluster [DBG] 97.1 deep-scrub starts 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:48.791524+0000 osd.7 (osd.7) 12 : cluster [DBG] 97.1 deep-scrub ok 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.149763+0000 osd.0 (osd.0) 7 : cluster [DBG] 97.2 scrub starts 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.152974+0000 osd.0 (osd.0) 8 : cluster [DBG] 97.2 scrub ok 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:49.334651+0000 mgr.y (mgr.14532) 222 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.575032+0000 osd.3 (osd.3) 5 : cluster [DBG] 97.5 deep-scrub starts 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.595343+0000 osd.3 (osd.3) 6 : cluster [DBG] 97.5 deep-scrub ok 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.601709+0000 osd.1 (osd.1) 3 : cluster [DBG] 97.8 scrub starts 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.605111+0000 osd.1 (osd.1) 4 : cluster [DBG] 97.8 scrub ok 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:49.705373+0000 mon.a (mon.0) 1382 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.150249+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.193854+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:50.194562+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.198051+0000 mon.c (mon.2) 130 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.198430+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.78:0/1031875357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.198621+0000 mon.c (mon.2) 132 : audit [INF] from='client.? 172.21.15.78:0/3846846614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.202495+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.202981+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: audit 2024-09-17T08:56:50.203296+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:50.457831+0000 osd.6 (osd.6) 11 : cluster [DBG] 97.0 deep-scrub starts 2024-09-17T08:56:51.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:50.474799+0000 osd.6 (osd.6) 12 : cluster [DBG] 97.0 deep-scrub ok 2024-09-17T08:56:51.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:50.535295+0000 osd.2 (osd.2) 7 : cluster [DBG] 97.7 scrub starts 2024-09-17T08:56:51.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:50.540983+0000 osd.2 (osd.2) 8 : cluster [DBG] 97.7 scrub ok 2024-09-17T08:56:51.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:51 smithi136 bash[24812]: cluster 2024-09-17T08:56:50.806762+0000 mgr.y (mgr.14532) 223 : cluster [DBG] pgmap v191: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.777975+0000 osd.7 (osd.7) 11 : cluster [DBG] 97.1 deep-scrub starts 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:48.791524+0000 osd.7 (osd.7) 12 : cluster [DBG] 97.1 deep-scrub ok 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.149763+0000 osd.0 (osd.0) 7 : cluster [DBG] 97.2 scrub starts 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.152974+0000 osd.0 (osd.0) 8 : cluster [DBG] 97.2 scrub ok 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:49.334651+0000 mgr.y (mgr.14532) 222 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.575032+0000 osd.3 (osd.3) 5 : cluster [DBG] 97.5 deep-scrub starts 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.595343+0000 osd.3 (osd.3) 6 : cluster [DBG] 97.5 deep-scrub ok 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.601709+0000 osd.1 (osd.1) 3 : cluster [DBG] 97.8 scrub starts 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.605111+0000 osd.1 (osd.1) 4 : cluster [DBG] 97.8 scrub ok 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:49.705373+0000 mon.a (mon.0) 1382 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.150249+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.193854+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:50.194562+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.198051+0000 mon.c (mon.2) 130 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.198430+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.78:0/1031875357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.198621+0000 mon.c (mon.2) 132 : audit [INF] from='client.? 172.21.15.78:0/3846846614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.202495+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.202981+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: audit 2024-09-17T08:56:50.203296+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:50.457831+0000 osd.6 (osd.6) 11 : cluster [DBG] 97.0 deep-scrub starts 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.777975+0000 osd.7 (osd.7) 11 : cluster [DBG] 97.1 deep-scrub starts 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:48.791524+0000 osd.7 (osd.7) 12 : cluster [DBG] 97.1 deep-scrub ok 2024-09-17T08:56:51.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.149763+0000 osd.0 (osd.0) 7 : cluster [DBG] 97.2 scrub starts 2024-09-17T08:56:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.152974+0000 osd.0 (osd.0) 8 : cluster [DBG] 97.2 scrub ok 2024-09-17T08:56:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:49.334651+0000 mgr.y (mgr.14532) 222 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:56:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.575032+0000 osd.3 (osd.3) 5 : cluster [DBG] 97.5 deep-scrub starts 2024-09-17T08:56:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.595343+0000 osd.3 (osd.3) 6 : cluster [DBG] 97.5 deep-scrub ok 2024-09-17T08:56:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.601709+0000 osd.1 (osd.1) 3 : cluster [DBG] 97.8 scrub starts 2024-09-17T08:56:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.605111+0000 osd.1 (osd.1) 4 : cluster [DBG] 97.8 scrub ok 2024-09-17T08:56:51.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:49.705373+0000 mon.a (mon.0) 1382 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.150249+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.193854+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:50.194562+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.198051+0000 mon.c (mon.2) 130 : audit [INF] from='client.? 172.21.15.78:0/1676227101' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.198430+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.78:0/1031875357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.198621+0000 mon.c (mon.2) 132 : audit [INF] from='client.? 172.21.15.78:0/3846846614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.202495+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]: dispatch 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.202981+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: audit 2024-09-17T08:56:50.203296+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:51.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:50.457831+0000 osd.6 (osd.6) 11 : cluster [DBG] 97.0 deep-scrub starts 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:50.474799+0000 osd.6 (osd.6) 12 : cluster [DBG] 97.0 deep-scrub ok 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:50.535295+0000 osd.2 (osd.2) 7 : cluster [DBG] 97.7 scrub starts 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:50.540983+0000 osd.2 (osd.2) 8 : cluster [DBG] 97.7 scrub ok 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[22670]: cluster 2024-09-17T08:56:50.806762+0000 mgr.y (mgr.14532) 223 : cluster [DBG] pgmap v191: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:50.474799+0000 osd.6 (osd.6) 12 : cluster [DBG] 97.0 deep-scrub ok 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:50.535295+0000 osd.2 (osd.2) 7 : cluster [DBG] 97.7 scrub starts 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:50.540983+0000 osd.2 (osd.2) 8 : cluster [DBG] 97.7 scrub ok 2024-09-17T08:56:51.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:51 smithi078 bash[32124]: cluster 2024-09-17T08:56:50.806762+0000 mgr.y (mgr.14532) 223 : cluster [DBG] pgmap v191: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-17T08:56:52.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:52 smithi136 bash[24812]: audit 2024-09-17T08:56:51.152655+0000 mon.a (mon.0) 1389 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:52.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:52 smithi136 bash[24812]: audit 2024-09-17T08:56:51.200507+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:52.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:52 smithi136 bash[24812]: audit 2024-09-17T08:56:51.201291+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:52.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:52 smithi136 bash[24812]: audit 2024-09-17T08:56:51.201610+0000 mon.a (mon.0) 1392 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:52.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:52 smithi136 bash[24812]: cluster 2024-09-17T08:56:51.202460+0000 mon.a (mon.0) 1393 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-17T08:56:52.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:52 smithi136 bash[24812]: audit 2024-09-17T08:56:51.205160+0000 mon.c (mon.2) 133 : audit [INF] from='client.? 172.21.15.78:0/2444928810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:52.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:52 smithi136 bash[24812]: audit 2024-09-17T08:56:51.216418+0000 mon.a (mon.0) 1394 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[32124]: audit 2024-09-17T08:56:51.152655+0000 mon.a (mon.0) 1389 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[32124]: audit 2024-09-17T08:56:51.200507+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[32124]: audit 2024-09-17T08:56:51.201291+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[32124]: audit 2024-09-17T08:56:51.201610+0000 mon.a (mon.0) 1392 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[32124]: cluster 2024-09-17T08:56:51.202460+0000 mon.a (mon.0) 1393 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[32124]: audit 2024-09-17T08:56:51.205160+0000 mon.c (mon.2) 133 : audit [INF] from='client.? 172.21.15.78:0/2444928810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[32124]: audit 2024-09-17T08:56:51.216418+0000 mon.a (mon.0) 1394 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[22670]: audit 2024-09-17T08:56:51.152655+0000 mon.a (mon.0) 1389 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[22670]: audit 2024-09-17T08:56:51.200507+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi078-64886-15"}]': finished 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[22670]: audit 2024-09-17T08:56:51.201291+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64912-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[22670]: audit 2024-09-17T08:56:51.201610+0000 mon.a (mon.0) 1392 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi078-64680-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[22670]: cluster 2024-09-17T08:56:51.202460+0000 mon.a (mon.0) 1393 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[22670]: audit 2024-09-17T08:56:51.205160+0000 mon.c (mon.2) 133 : audit [INF] from='client.? 172.21.15.78:0/2444928810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:52 smithi078 bash[22670]: audit 2024-09-17T08:56:51.216418+0000 mon.a (mon.0) 1394 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:53 smithi136 bash[24812]: audit 2024-09-17T08:56:52.154775+0000 mon.a (mon.0) 1395 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:53 smithi136 bash[24812]: audit 2024-09-17T08:56:52.205045+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:53 smithi136 bash[24812]: cluster 2024-09-17T08:56:52.205699+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-09-17T08:56:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:53 smithi136 bash[24812]: cluster 2024-09-17T08:56:52.809087+0000 mgr.y (mgr.14532) 224 : cluster [DBG] pgmap v194: 356 pgs: 13 unknown, 343 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 KiB/s rd, 16 op/s 2024-09-17T08:56:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:53 smithi136 bash[24812]: audit 2024-09-17T08:56:53.156440+0000 mon.a (mon.0) 1398 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[32124]: audit 2024-09-17T08:56:52.154775+0000 mon.a (mon.0) 1395 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[32124]: audit 2024-09-17T08:56:52.205045+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[32124]: cluster 2024-09-17T08:56:52.205699+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[32124]: cluster 2024-09-17T08:56:52.809087+0000 mgr.y (mgr.14532) 224 : cluster [DBG] pgmap v194: 356 pgs: 13 unknown, 343 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 KiB/s rd, 16 op/s 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[32124]: audit 2024-09-17T08:56:53.156440+0000 mon.a (mon.0) 1398 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[22670]: audit 2024-09-17T08:56:52.154775+0000 mon.a (mon.0) 1395 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[22670]: audit 2024-09-17T08:56:52.205045+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi078-64688-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[22670]: cluster 2024-09-17T08:56:52.205699+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-09-17T08:56:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[22670]: cluster 2024-09-17T08:56:52.809087+0000 mgr.y (mgr.14532) 224 : cluster [DBG] pgmap v194: 356 pgs: 13 unknown, 343 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 KiB/s rd, 16 op/s 2024-09-17T08:56:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:53 smithi078 bash[22670]: audit 2024-09-17T08:56:53.156440+0000 mon.a (mon.0) 1398 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:54 smithi136 bash[24812]: cluster 2024-09-17T08:56:53.211275+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-09-17T08:56:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:54 smithi136 bash[24812]: audit 2024-09-17T08:56:53.214432+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? 172.21.15.78:0/1672322752' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64680-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:54 smithi136 bash[24812]: cluster 2024-09-17T08:56:53.430159+0000 osd.4 (osd.4) 13 : cluster [DBG] 97.9 scrub starts 2024-09-17T08:56:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:54 smithi136 bash[24812]: cluster 2024-09-17T08:56:53.436833+0000 osd.4 (osd.4) 14 : cluster [DBG] 97.9 scrub ok 2024-09-17T08:56:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:54 smithi136 bash[24812]: audit 2024-09-17T08:56:54.158149+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[22670]: cluster 2024-09-17T08:56:53.211275+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-09-17T08:56:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[22670]: audit 2024-09-17T08:56:53.214432+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? 172.21.15.78:0/1672322752' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64680-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[22670]: cluster 2024-09-17T08:56:53.430159+0000 osd.4 (osd.4) 13 : cluster [DBG] 97.9 scrub starts 2024-09-17T08:56:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[22670]: cluster 2024-09-17T08:56:53.436833+0000 osd.4 (osd.4) 14 : cluster [DBG] 97.9 scrub ok 2024-09-17T08:56:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[22670]: audit 2024-09-17T08:56:54.158149+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:54.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[32124]: cluster 2024-09-17T08:56:53.211275+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-09-17T08:56:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[32124]: audit 2024-09-17T08:56:53.214432+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? 172.21.15.78:0/1672322752' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64680-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[32124]: cluster 2024-09-17T08:56:53.430159+0000 osd.4 (osd.4) 13 : cluster [DBG] 97.9 scrub starts 2024-09-17T08:56:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[32124]: cluster 2024-09-17T08:56:53.436833+0000 osd.4 (osd.4) 14 : cluster [DBG] 97.9 scrub ok 2024-09-17T08:56:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:54 smithi078 bash[32124]: audit 2024-09-17T08:56:54.158149+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.213567+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.78:0/1672322752' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64680-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: cluster 2024-09-17T08:56:54.214365+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.234252+0000 mon.c (mon.2) 134 : audit [INF] from='client.? 172.21.15.78:0/3870361674' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.235582+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.293464+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.293782+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.294909+0000 mon.c (mon.2) 136 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.295204+0000 mon.a (mon.0) 1406 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.295646+0000 mon.c (mon.2) 137 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.295901+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: cluster 2024-09-17T08:56:54.810103+0000 mgr.y (mgr.14532) 225 : cluster [DBG] pgmap v197: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 26 op/s 2024-09-17T08:56:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.950145+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:54.952408+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:55.159935+0000 mon.a (mon.0) 1410 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:55.217648+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:55.218278+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: cluster 2024-09-17T08:56:55.218473+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-17T08:56:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:55.224472+0000 mon.c (mon.2) 138 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:55 smithi136 bash[24812]: audit 2024-09-17T08:56:55.226483+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.213567+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.78:0/1672322752' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64680-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:55.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: cluster 2024-09-17T08:56:54.214365+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-09-17T08:56:55.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.234252+0000 mon.c (mon.2) 134 : audit [INF] from='client.? 172.21.15.78:0/3870361674' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.235582+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.293464+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.293782+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.294909+0000 mon.c (mon.2) 136 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.295204+0000 mon.a (mon.0) 1406 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.295646+0000 mon.c (mon.2) 137 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.295901+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: cluster 2024-09-17T08:56:54.810103+0000 mgr.y (mgr.14532) 225 : cluster [DBG] pgmap v197: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 26 op/s 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.950145+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:54.952408+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:55.159935+0000 mon.a (mon.0) 1410 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:55.217648+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.213567+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.78:0/1672322752' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64680-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: cluster 2024-09-17T08:56:54.214365+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.234252+0000 mon.c (mon.2) 134 : audit [INF] from='client.? 172.21.15.78:0/3870361674' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.235582+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.293464+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.293782+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.294909+0000 mon.c (mon.2) 136 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.295204+0000 mon.a (mon.0) 1406 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.295646+0000 mon.c (mon.2) 137 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.295901+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: cluster 2024-09-17T08:56:54.810103+0000 mgr.y (mgr.14532) 225 : cluster [DBG] pgmap v197: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 26 op/s 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.950145+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:54.952408+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:55.159935+0000 mon.a (mon.0) 1410 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:55.217648+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:55.218278+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: cluster 2024-09-17T08:56:55.218473+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-17T08:56:55.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:55.224472+0000 mon.c (mon.2) 138 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[32124]: audit 2024-09-17T08:56:55.226483+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:55.218278+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:56:55.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: cluster 2024-09-17T08:56:55.218473+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-17T08:56:55.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:55.224472+0000 mon.c (mon.2) 138 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:55.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:55 smithi078 bash[22670]: audit 2024-09-17T08:56:55.226483+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:56:57.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:56 smithi136 bash[24812]: cluster 2024-09-17T08:56:55.228842+0000 mon.a (mon.0) 1415 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:57.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:56 smithi136 bash[24812]: cluster 2024-09-17T08:56:55.492532+0000 osd.6 (osd.6) 13 : cluster [DBG] 97.4 scrub starts 2024-09-17T08:56:57.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:56 smithi136 bash[24812]: cluster 2024-09-17T08:56:55.498587+0000 osd.6 (osd.6) 14 : cluster [DBG] 97.4 scrub ok 2024-09-17T08:56:57.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:56 smithi136 bash[24812]: audit 2024-09-17T08:56:55.714264+0000 mon.c (mon.2) 139 : audit [DBG] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-17T08:56:57.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:56 smithi136 bash[24812]: audit 2024-09-17T08:56:55.719217+0000 mon.c (mon.2) 140 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:56 smithi136 bash[24812]: audit 2024-09-17T08:56:55.719835+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:56 smithi136 bash[24812]: audit 2024-09-17T08:56:56.161512+0000 mon.a (mon.0) 1417 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[22670]: cluster 2024-09-17T08:56:55.228842+0000 mon.a (mon.0) 1415 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[22670]: cluster 2024-09-17T08:56:55.492532+0000 osd.6 (osd.6) 13 : cluster [DBG] 97.4 scrub starts 2024-09-17T08:56:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[22670]: cluster 2024-09-17T08:56:55.498587+0000 osd.6 (osd.6) 14 : cluster [DBG] 97.4 scrub ok 2024-09-17T08:56:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[22670]: audit 2024-09-17T08:56:55.714264+0000 mon.c (mon.2) 139 : audit [DBG] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-17T08:56:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[22670]: audit 2024-09-17T08:56:55.719217+0000 mon.c (mon.2) 140 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[22670]: audit 2024-09-17T08:56:55.719835+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[22670]: audit 2024-09-17T08:56:56.161512+0000 mon.a (mon.0) 1417 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[32124]: cluster 2024-09-17T08:56:55.228842+0000 mon.a (mon.0) 1415 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:56:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[32124]: cluster 2024-09-17T08:56:55.492532+0000 osd.6 (osd.6) 13 : cluster [DBG] 97.4 scrub starts 2024-09-17T08:56:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[32124]: cluster 2024-09-17T08:56:55.498587+0000 osd.6 (osd.6) 14 : cluster [DBG] 97.4 scrub ok 2024-09-17T08:56:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[32124]: audit 2024-09-17T08:56:55.714264+0000 mon.c (mon.2) 139 : audit [DBG] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-17T08:56:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[32124]: audit 2024-09-17T08:56:55.719217+0000 mon.c (mon.2) 140 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[32124]: audit 2024-09-17T08:56:55.719835+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:56 smithi078 bash[32124]: audit 2024-09-17T08:56:56.161512+0000 mon.a (mon.0) 1417 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:57.921 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:56.639701+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:57.921 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: cluster 2024-09-17T08:56:56.639892+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-17T08:56:57.921 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:56.641562+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.78:0/2126962768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:56.641745+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2"}]: dispatch 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:56.652426+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:56.652850+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:56.653519+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: cluster 2024-09-17T08:56:56.810983+0000 mgr.y (mgr.14532) 226 : cluster [DBG] pgmap v200: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.5 KiB/s rd, 7 op/s 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.163111+0000 mon.a (mon.0) 1422 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.224691+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.225370+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.225626+0000 mon.a (mon.0) 1425 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: cluster 2024-09-17T08:56:57.225901+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.232165+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:57.922 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.233549+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.78:0/392543230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi078-64688-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.234400+0000 mon.c (mon.2) 145 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[32124]: audit 2024-09-17T08:56:57.235806+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:56.639701+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: cluster 2024-09-17T08:56:56.639892+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:56.641562+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.78:0/2126962768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:56.641745+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2"}]: dispatch 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:56.652426+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:56.652850+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:56.653519+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: cluster 2024-09-17T08:56:56.810983+0000 mgr.y (mgr.14532) 226 : cluster [DBG] pgmap v200: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.5 KiB/s rd, 7 op/s 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.163111+0000 mon.a (mon.0) 1422 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.224691+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.225370+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.225626+0000 mon.a (mon.0) 1425 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: cluster 2024-09-17T08:56:57.225901+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.232165+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.233549+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.78:0/392543230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi078-64688-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.234400+0000 mon.c (mon.2) 145 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:57.924 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22670]: audit 2024-09-17T08:56:57.235806+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:58.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:56.639701+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:58.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: cluster 2024-09-17T08:56:56.639892+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-17T08:56:58.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:56.641562+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.78:0/2126962768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:58.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:56.641745+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2"}]: dispatch 2024-09-17T08:56:58.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:56.652426+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:56.652850+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:56.653519+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: cluster 2024-09-17T08:56:56.810983+0000 mgr.y (mgr.14532) 226 : cluster [DBG] pgmap v200: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.5 KiB/s rd, 7 op/s 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.163111+0000 mon.a (mon.0) 1422 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.224691+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi078-64912-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.225370+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi078-64680-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.225626+0000 mon.a (mon.0) 1425 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi078-64830-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: cluster 2024-09-17T08:56:57.225901+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.232165+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.233549+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.78:0/392543230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi078-64688-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.234400+0000 mon.c (mon.2) 145 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:58.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:57 smithi136 bash[24812]: audit 2024-09-17T08:56:57.235806+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-17T08:56:58.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:56:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:56:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:56:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:58 smithi136 bash[24812]: audit 2024-09-17T08:56:58.164807+0000 mon.a (mon.0) 1429 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:58 smithi136 bash[24812]: audit 2024-09-17T08:56:58.227273+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? 172.21.15.78:0/392543230' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi078-64688-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:58 smithi136 bash[24812]: audit 2024-09-17T08:56:58.227477+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-17T08:56:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:58 smithi136 bash[24812]: cluster 2024-09-17T08:56:58.228105+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-09-17T08:56:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:58 smithi136 bash[24812]: audit 2024-09-17T08:56:58.233055+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:59.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:58 smithi136 bash[24812]: audit 2024-09-17T08:56:58.234043+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[22670]: audit 2024-09-17T08:56:58.164807+0000 mon.a (mon.0) 1429 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[22670]: audit 2024-09-17T08:56:58.227273+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? 172.21.15.78:0/392543230' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi078-64688-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[22670]: audit 2024-09-17T08:56:58.227477+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-17T08:56:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[22670]: cluster 2024-09-17T08:56:58.228105+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-09-17T08:56:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[22670]: audit 2024-09-17T08:56:58.233055+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[22670]: audit 2024-09-17T08:56:58.234043+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[32124]: audit 2024-09-17T08:56:58.164807+0000 mon.a (mon.0) 1429 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:56:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[32124]: audit 2024-09-17T08:56:58.227273+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? 172.21.15.78:0/392543230' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi078-64688-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:56:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[32124]: audit 2024-09-17T08:56:58.227477+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-17T08:56:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[32124]: cluster 2024-09-17T08:56:58.228105+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-09-17T08:56:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[32124]: audit 2024-09-17T08:56:58.233055+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:58 smithi078 bash[32124]: audit 2024-09-17T08:56:58.234043+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-17T08:56:59.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: cluster 2024-09-17T08:56:58.811790+0000 mgr.y (mgr.14532) 227 : cluster [DBG] pgmap v203: 332 pgs: 40 creating+peering, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: audit 2024-09-17T08:56:59.166614+0000 mon.a (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: audit 2024-09-17T08:56:59.230833+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: cluster 2024-09-17T08:56:59.231268+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: audit 2024-09-17T08:56:59.257873+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: audit 2024-09-17T08:56:59.258483+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.78:0/1070968349' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: audit 2024-09-17T08:56:59.258550+0000 mon.a (mon.0) 1437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:57:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:56:59 smithi136 bash[24812]: audit 2024-09-17T08:56:59.259265+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: cluster 2024-09-17T08:56:58.811790+0000 mgr.y (mgr.14532) 227 : cluster [DBG] pgmap v203: 332 pgs: 40 creating+peering, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T08:57:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: audit 2024-09-17T08:56:59.166614+0000 mon.a (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: audit 2024-09-17T08:56:59.230833+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-17T08:57:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: cluster 2024-09-17T08:56:59.231268+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-09-17T08:57:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: audit 2024-09-17T08:56:59.257873+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:57:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: audit 2024-09-17T08:56:59.258483+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.78:0/1070968349' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: audit 2024-09-17T08:56:59.258550+0000 mon.a (mon.0) 1437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[32124]: audit 2024-09-17T08:56:59.259265+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: cluster 2024-09-17T08:56:58.811790+0000 mgr.y (mgr.14532) 227 : cluster [DBG] pgmap v203: 332 pgs: 40 creating+peering, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: audit 2024-09-17T08:56:59.166614+0000 mon.a (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: audit 2024-09-17T08:56:59.230833+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: cluster 2024-09-17T08:56:59.231268+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: audit 2024-09-17T08:56:59.257873+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.78:0/3869643792' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: audit 2024-09-17T08:56:59.258483+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.78:0/1070968349' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: audit 2024-09-17T08:56:59.258550+0000 mon.a (mon.0) 1437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]: dispatch 2024-09-17T08:57:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:56:59 smithi078 bash[22670]: audit 2024-09-17T08:56:59.259265+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:00 smithi136 bash[24812]: audit 2024-09-17T08:56:59.346153+0000 mgr.y (mgr.14532) 228 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:00 smithi136 bash[24812]: audit 2024-09-17T08:57:00.168209+0000 mon.a (mon.0) 1439 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:00 smithi136 bash[24812]: audit 2024-09-17T08:57:00.237881+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]': finished 2024-09-17T08:57:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:00 smithi136 bash[24812]: audit 2024-09-17T08:57:00.240608+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:00 smithi136 bash[24812]: cluster 2024-09-17T08:57:00.240878+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-17T08:57:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:00 smithi136 bash[24812]: audit 2024-09-17T08:57:00.242736+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.78:0/2458019435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:00 smithi136 bash[24812]: audit 2024-09-17T08:57:00.245209+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[32124]: audit 2024-09-17T08:56:59.346153+0000 mgr.y (mgr.14532) 228 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[32124]: audit 2024-09-17T08:57:00.168209+0000 mon.a (mon.0) 1439 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[32124]: audit 2024-09-17T08:57:00.237881+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]': finished 2024-09-17T08:57:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[32124]: audit 2024-09-17T08:57:00.240608+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[32124]: cluster 2024-09-17T08:57:00.240878+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[32124]: audit 2024-09-17T08:57:00.242736+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.78:0/2458019435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[32124]: audit 2024-09-17T08:57:00.245209+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[22670]: audit 2024-09-17T08:56:59.346153+0000 mgr.y (mgr.14532) 228 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[22670]: audit 2024-09-17T08:57:00.168209+0000 mon.a (mon.0) 1439 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[22670]: audit 2024-09-17T08:57:00.237881+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi078-64830-1","app":"app1","key":"key1"}]': finished 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[22670]: audit 2024-09-17T08:57:00.240608+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi078-64680-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[22670]: cluster 2024-09-17T08:57:00.240878+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[22670]: audit 2024-09-17T08:57:00.242736+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.78:0/2458019435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:00 smithi078 bash[22670]: audit 2024-09-17T08:57:00.245209+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: seed 64830 2024-09-17T08:57:01.253 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (4 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (1153 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (65 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (50 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (19 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (3 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (9 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (9 ms) 2024-09-17T08:57:01.254 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2 ms) 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (12 ms) 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (4 ms) 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (4 ms) 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (5 ms) 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: osd_max_attr_size = 0 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-09-17T08:57:01.255 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (2420 ms) 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (520 ms) 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: done waiting, doing copies 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: waiting for final deep scrubs... 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: done waiting 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (61123 ms) 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (9 ms) 2024-09-17T08:57:01.256 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (4 ms) 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4530 ms) 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-09-17T08:57:01.257 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-17T08:57:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: cluster 2024-09-17T08:57:00.812717+0000 mgr.y (mgr.14532) 229 : cluster [DBG] pgmap v206: 364 pgs: 64 unknown, 8 creating+peering, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T08:57:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.169875+0000 mon.a (mon.0) 1444 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.249461+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: cluster 2024-09-17T08:57:01.251416+0000 mon.a (mon.0) 1446 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-17T08:57:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.300463+0000 mon.c (mon.2) 150 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.300907+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.305050+0000 mon.c (mon.2) 151 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.305562+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.306408+0000 mon.c (mon.2) 152 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:02.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:01 smithi136 bash[24812]: audit 2024-09-17T08:57:01.307602+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: cluster 2024-09-17T08:57:00.812717+0000 mgr.y (mgr.14532) 229 : cluster [DBG] pgmap v206: 364 pgs: 64 unknown, 8 creating+peering, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T08:57:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.169875+0000 mon.a (mon.0) 1444 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.249461+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: cluster 2024-09-17T08:57:01.251416+0000 mon.a (mon.0) 1446 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.300463+0000 mon.c (mon.2) 150 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.300907+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.305050+0000 mon.c (mon.2) 151 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.305562+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.306408+0000 mon.c (mon.2) 152 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[22670]: audit 2024-09-17T08:57:01.307602+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: cluster 2024-09-17T08:57:00.812717+0000 mgr.y (mgr.14532) 229 : cluster [DBG] pgmap v206: 364 pgs: 64 unknown, 8 creating+peering, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.169875+0000 mon.a (mon.0) 1444 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.249461+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi078-64688-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: cluster 2024-09-17T08:57:01.251416+0000 mon.a (mon.0) 1446 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.300463+0000 mon.c (mon.2) 150 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.300907+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.305050+0000 mon.c (mon.2) 151 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.305562+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.306408+0000 mon.c (mon.2) 152 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:01 smithi078 bash[32124]: audit 2024-09-17T08:57:01.307602+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:02 smithi136 bash[24812]: cluster 2024-09-17T08:57:01.741462+0000 mon.a (mon.0) 1450 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:02 smithi136 bash[24812]: audit 2024-09-17T08:57:02.171500+0000 mon.a (mon.0) 1451 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:02 smithi136 bash[24812]: audit 2024-09-17T08:57:02.246164+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:02 smithi136 bash[24812]: cluster 2024-09-17T08:57:02.246563+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-09-17T08:57:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:02 smithi136 bash[24812]: audit 2024-09-17T08:57:02.253146+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? 172.21.15.78:0/1419672599' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi078-64680-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:02 smithi136 bash[24812]: audit 2024-09-17T08:57:02.255719+0000 mon.c (mon.2) 153 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:02 smithi136 bash[24812]: audit 2024-09-17T08:57:02.259483+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[22670]: cluster 2024-09-17T08:57:01.741462+0000 mon.a (mon.0) 1450 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[22670]: audit 2024-09-17T08:57:02.171500+0000 mon.a (mon.0) 1451 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[22670]: audit 2024-09-17T08:57:02.246164+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[22670]: cluster 2024-09-17T08:57:02.246563+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-09-17T08:57:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[22670]: audit 2024-09-17T08:57:02.253146+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? 172.21.15.78:0/1419672599' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi078-64680-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[22670]: audit 2024-09-17T08:57:02.255719+0000 mon.c (mon.2) 153 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[22670]: audit 2024-09-17T08:57:02.259483+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[32124]: cluster 2024-09-17T08:57:01.741462+0000 mon.a (mon.0) 1450 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[32124]: audit 2024-09-17T08:57:02.171500+0000 mon.a (mon.0) 1451 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[32124]: audit 2024-09-17T08:57:02.246164+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64830-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[32124]: cluster 2024-09-17T08:57:02.246563+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[32124]: audit 2024-09-17T08:57:02.253146+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? 172.21.15.78:0/1419672599' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi078-64680-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[32124]: audit 2024-09-17T08:57:02.255719+0000 mon.c (mon.2) 153 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:02 smithi078 bash[32124]: audit 2024-09-17T08:57:02.259483+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:04.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:03 smithi136 bash[24812]: cluster 2024-09-17T08:57:02.814977+0000 mgr.y (mgr.14532) 230 : cluster [DBG] pgmap v209: 300 pgs: 5 unknown, 29 creating+peering, 266 active+clean; 592 KiB data, 506 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:03 smithi136 bash[24812]: audit 2024-09-17T08:57:03.173192+0000 mon.a (mon.0) 1456 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:03 smithi136 bash[24812]: audit 2024-09-17T08:57:03.253573+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? 172.21.15.78:0/1419672599' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi078-64680-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:03 smithi136 bash[24812]: cluster 2024-09-17T08:57:03.704670+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-09-17T08:57:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:03 smithi136 bash[24812]: audit 2024-09-17T08:57:03.706519+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? 172.21.15.78:0/3885559861' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi078-64688-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[22670]: cluster 2024-09-17T08:57:02.814977+0000 mgr.y (mgr.14532) 230 : cluster [DBG] pgmap v209: 300 pgs: 5 unknown, 29 creating+peering, 266 active+clean; 592 KiB data, 506 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[22670]: audit 2024-09-17T08:57:03.173192+0000 mon.a (mon.0) 1456 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[22670]: audit 2024-09-17T08:57:03.253573+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? 172.21.15.78:0/1419672599' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi078-64680-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[22670]: cluster 2024-09-17T08:57:03.704670+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-09-17T08:57:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[22670]: audit 2024-09-17T08:57:03.706519+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? 172.21.15.78:0/3885559861' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi078-64688-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:04.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[32124]: cluster 2024-09-17T08:57:02.814977+0000 mgr.y (mgr.14532) 230 : cluster [DBG] pgmap v209: 300 pgs: 5 unknown, 29 creating+peering, 266 active+clean; 592 KiB data, 506 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[32124]: audit 2024-09-17T08:57:03.173192+0000 mon.a (mon.0) 1456 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[32124]: audit 2024-09-17T08:57:03.253573+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? 172.21.15.78:0/1419672599' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi078-64680-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[32124]: cluster 2024-09-17T08:57:03.704670+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-09-17T08:57:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:03 smithi078 bash[32124]: audit 2024-09-17T08:57:03.706519+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? 172.21.15.78:0/3885559861' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi078-64688-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:04.266 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscP api_snapshots_pp: Running main() from gmock_main.cc 2024-09-17T08:57:04.266 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: seed 64912 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2494 ms) 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (3722 ms) 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (4358 ms) 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1250 ms) 2024-09-17T08:57:04.267 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4424 ms) 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (16249 ms total) 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (5605 ms) 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3727 ms) 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6145 ms) 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3952 ms) 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-17T08:57:04.268 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2052 ms) 2024-09-17T08:57:04.269 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-17T08:57:04.269 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:463: Skipped 2024-09-17T08:57:04.269 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: 2024-09-17T08:57:04.269 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: deleting snap 23 in pool LibRadosSnapshotsSelfManagedPP_smithi078-64912-7 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: waiting for snaps to purge 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17807 ms) 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (39288 ms total) 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-17T08:57:04.272 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (15 ms) 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5058 ms) 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5074 ms total) 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3012 ms) 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2013 ms) 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-17T08:57:04.273 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2016 ms) 2024-09-17T08:57:05.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:05 smithi136 bash[24812]: audit 2024-09-17T08:57:04.174863+0000 mon.a (mon.0) 1460 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:05 smithi136 bash[24812]: audit 2024-09-17T08:57:04.259512+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:05 smithi136 bash[24812]: audit 2024-09-17T08:57:04.259905+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? 172.21.15.78:0/3885559861' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi078-64688-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:05 smithi136 bash[24812]: cluster 2024-09-17T08:57:04.260452+0000 mon.a (mon.0) 1463 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-09-17T08:57:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[22670]: audit 2024-09-17T08:57:04.174863+0000 mon.a (mon.0) 1460 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[22670]: audit 2024-09-17T08:57:04.259512+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[22670]: audit 2024-09-17T08:57:04.259905+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? 172.21.15.78:0/3885559861' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi078-64688-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[22670]: cluster 2024-09-17T08:57:04.260452+0000 mon.a (mon.0) 1463 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-09-17T08:57:05.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[32124]: audit 2024-09-17T08:57:04.174863+0000 mon.a (mon.0) 1460 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:05.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[32124]: audit 2024-09-17T08:57:04.259512+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64830-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[32124]: audit 2024-09-17T08:57:04.259905+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? 172.21.15.78:0/3885559861' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi078-64688-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:05 smithi078 bash[32124]: cluster 2024-09-17T08:57:04.260452+0000 mon.a (mon.0) 1463 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-09-17T08:57:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:06 smithi136 bash[24812]: cluster 2024-09-17T08:57:04.815868+0000 mgr.y (mgr.14532) 231 : cluster [DBG] pgmap v212: 308 pgs: 40 unknown, 268 active+clean; 592 KiB data, 386 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:06 smithi136 bash[24812]: audit 2024-09-17T08:57:05.176517+0000 mon.a (mon.0) 1464 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:06 smithi136 bash[24812]: cluster 2024-09-17T08:57:05.265896+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-17T08:57:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:06 smithi136 bash[24812]: audit 2024-09-17T08:57:05.269441+0000 mon.c (mon.2) 154 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:06 smithi136 bash[24812]: audit 2024-09-17T08:57:05.270661+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:06 smithi136 bash[24812]: audit 2024-09-17T08:57:05.270957+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.78:0/3139061610' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:06 smithi136 bash[24812]: audit 2024-09-17T08:57:05.272259+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[22670]: cluster 2024-09-17T08:57:04.815868+0000 mgr.y (mgr.14532) 231 : cluster [DBG] pgmap v212: 308 pgs: 40 unknown, 268 active+clean; 592 KiB data, 386 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[22670]: audit 2024-09-17T08:57:05.176517+0000 mon.a (mon.0) 1464 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[22670]: cluster 2024-09-17T08:57:05.265896+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-17T08:57:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[22670]: audit 2024-09-17T08:57:05.269441+0000 mon.c (mon.2) 154 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[22670]: audit 2024-09-17T08:57:05.270661+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[22670]: audit 2024-09-17T08:57:05.270957+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.78:0/3139061610' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[22670]: audit 2024-09-17T08:57:05.272259+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[32124]: cluster 2024-09-17T08:57:04.815868+0000 mgr.y (mgr.14532) 231 : cluster [DBG] pgmap v212: 308 pgs: 40 unknown, 268 active+clean; 592 KiB data, 386 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[32124]: audit 2024-09-17T08:57:05.176517+0000 mon.a (mon.0) 1464 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[32124]: cluster 2024-09-17T08:57:05.265896+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[32124]: audit 2024-09-17T08:57:05.269441+0000 mon.c (mon.2) 154 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[32124]: audit 2024-09-17T08:57:05.270661+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[32124]: audit 2024-09-17T08:57:05.270957+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.78:0/3139061610' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:06 smithi078 bash[32124]: audit 2024-09-17T08:57:05.272259+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: audit 2024-09-17T08:57:06.178121+0000 mon.a (mon.0) 1468 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: audit 2024-09-17T08:57:06.273403+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: audit 2024-09-17T08:57:06.273774+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: cluster 2024-09-17T08:57:06.274462+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-17T08:57:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: audit 2024-09-17T08:57:06.277417+0000 mon.c (mon.2) 156 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: audit 2024-09-17T08:57:06.280859+0000 mon.a (mon.0) 1472 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: audit 2024-09-17T08:57:06.282098+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.78:0/1808126136' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi078-64688-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:07 smithi136 bash[24812]: cluster 2024-09-17T08:57:06.816932+0000 mgr.y (mgr.14532) 232 : cluster [DBG] pgmap v215: 372 pgs: 104 unknown, 268 active+clean; 592 KiB data, 386 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: audit 2024-09-17T08:57:06.178121+0000 mon.a (mon.0) 1468 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: audit 2024-09-17T08:57:06.273403+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: audit 2024-09-17T08:57:06.273774+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: cluster 2024-09-17T08:57:06.274462+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-17T08:57:07.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: audit 2024-09-17T08:57:06.277417+0000 mon.c (mon.2) 156 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: audit 2024-09-17T08:57:06.280859+0000 mon.a (mon.0) 1472 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: audit 2024-09-17T08:57:06.282098+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.78:0/1808126136' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi078-64688-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22670]: cluster 2024-09-17T08:57:06.816932+0000 mgr.y (mgr.14532) 232 : cluster [DBG] pgmap v215: 372 pgs: 104 unknown, 268 active+clean; 592 KiB data, 386 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: audit 2024-09-17T08:57:06.178121+0000 mon.a (mon.0) 1468 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: audit 2024-09-17T08:57:06.273403+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: audit 2024-09-17T08:57:06.273774+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi078-64680-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: cluster 2024-09-17T08:57:06.274462+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: audit 2024-09-17T08:57:06.277417+0000 mon.c (mon.2) 156 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: audit 2024-09-17T08:57:06.280859+0000 mon.a (mon.0) 1472 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: audit 2024-09-17T08:57:06.282098+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.78:0/1808126136' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi078-64688-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[32124]: cluster 2024-09-17T08:57:06.816932+0000 mgr.y (mgr.14532) 232 : cluster [DBG] pgmap v215: 372 pgs: 104 unknown, 268 active+clean; 592 KiB data, 386 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:08.209 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:57:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:57:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:57:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:08 smithi136 bash[24812]: audit 2024-09-17T08:57:07.172540+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:08 smithi136 bash[24812]: audit 2024-09-17T08:57:07.172830+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? 172.21.15.78:0/1808126136' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi078-64688-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:08 smithi136 bash[24812]: cluster 2024-09-17T08:57:07.173313+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-09-17T08:57:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:08 smithi136 bash[24812]: audit 2024-09-17T08:57:07.181095+0000 mon.a (mon.0) 1477 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:08 smithi136 bash[24812]: audit 2024-09-17T08:57:07.181244+0000 mon.c (mon.2) 157 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:08 smithi136 bash[24812]: audit 2024-09-17T08:57:07.183071+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:08 smithi136 bash[24812]: cluster 2024-09-17T08:57:07.669443+0000 mon.a (mon.0) 1479 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[32124]: audit 2024-09-17T08:57:07.172540+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[32124]: audit 2024-09-17T08:57:07.172830+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? 172.21.15.78:0/1808126136' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi078-64688-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[32124]: cluster 2024-09-17T08:57:07.173313+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-09-17T08:57:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[32124]: audit 2024-09-17T08:57:07.181095+0000 mon.a (mon.0) 1477 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[32124]: audit 2024-09-17T08:57:07.181244+0000 mon.c (mon.2) 157 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[32124]: audit 2024-09-17T08:57:07.183071+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[32124]: cluster 2024-09-17T08:57:07.669443+0000 mon.a (mon.0) 1479 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[22670]: audit 2024-09-17T08:57:07.172540+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64830-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[22670]: audit 2024-09-17T08:57:07.172830+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? 172.21.15.78:0/1808126136' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi078-64688-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[22670]: cluster 2024-09-17T08:57:07.173313+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[22670]: audit 2024-09-17T08:57:07.181095+0000 mon.a (mon.0) 1477 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[22670]: audit 2024-09-17T08:57:07.181244+0000 mon.c (mon.2) 157 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[22670]: audit 2024-09-17T08:57:07.183071+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:08.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:08 smithi078 bash[22670]: cluster 2024-09-17T08:57:07.669443+0000 mon.a (mon.0) 1479 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:09.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:57:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:08.175185+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:57:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: cluster 2024-09-17T08:57:08.175591+0000 mon.a (mon.0) 1481 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-09-17T08:57:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:08.177353+0000 mon.c (mon.2) 158 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:08.179286+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:08.181077+0000 mon.b (mon.1) 73 : audit [INF] from='client.? 172.21.15.78:0/1971800230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:08.183618+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:08.189603+0000 mon.a (mon.0) 1484 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: cluster 2024-09-17T08:57:08.817951+0000 mgr.y (mgr.14532) 233 : cluster [DBG] pgmap v218: 300 pgs: 32 unknown, 268 active+clean; 592 KiB data, 359 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:09.181883+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:09.182239+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: cluster 2024-09-17T08:57:09.183014+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:09.185996+0000 mon.c (mon.2) 159 : audit [INF] from='client.? 172.21.15.78:0/2897912877' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:09.187418+0000 mon.c (mon.2) 160 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:09.188229+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:09.190021+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:09 smithi136 bash[24812]: audit 2024-09-17T08:57:09.191063+0000 mon.a (mon.0) 1490 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:08.175185+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: cluster 2024-09-17T08:57:08.175591+0000 mon.a (mon.0) 1481 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:08.177353+0000 mon.c (mon.2) 158 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:08.179286+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:08.181077+0000 mon.b (mon.1) 73 : audit [INF] from='client.? 172.21.15.78:0/1971800230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:08.183618+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:08.189603+0000 mon.a (mon.0) 1484 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: cluster 2024-09-17T08:57:08.817951+0000 mgr.y (mgr.14532) 233 : cluster [DBG] pgmap v218: 300 pgs: 32 unknown, 268 active+clean; 592 KiB data, 359 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:09.181883+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:09.182239+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: cluster 2024-09-17T08:57:09.183014+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:09.185996+0000 mon.c (mon.2) 159 : audit [INF] from='client.? 172.21.15.78:0/2897912877' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:09.187418+0000 mon.c (mon.2) 160 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:09.188229+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:09.190021+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[22670]: audit 2024-09-17T08:57:09.191063+0000 mon.a (mon.0) 1490 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:08.175185+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: cluster 2024-09-17T08:57:08.175591+0000 mon.a (mon.0) 1481 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:08.177353+0000 mon.c (mon.2) 158 : audit [INF] from='client.? 172.21.15.78:0/2925766971' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:08.179286+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:08.181077+0000 mon.b (mon.1) 73 : audit [INF] from='client.? 172.21.15.78:0/1971800230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:08.183618+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:08.189603+0000 mon.a (mon.0) 1484 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: cluster 2024-09-17T08:57:08.817951+0000 mgr.y (mgr.14532) 233 : cluster [DBG] pgmap v218: 300 pgs: 32 unknown, 268 active+clean; 592 KiB data, 359 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:09.181883+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi078-64912-16"}]': finished 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:09.182239+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi078-64680-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: cluster 2024-09-17T08:57:09.183014+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:09.185996+0000 mon.c (mon.2) 159 : audit [INF] from='client.? 172.21.15.78:0/2897912877' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:09.187418+0000 mon.c (mon.2) 160 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:09.188229+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:09.190021+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:09.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:09 smithi078 bash[32124]: audit 2024-09-17T08:57:09.191063+0000 mon.a (mon.0) 1490 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:09.231417+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:09.233258+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:09.233919+0000 mon.a (mon.0) 1493 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:09.357625+0000 mgr.y (mgr.14532) 234 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:09.982827+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:10.185770+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:10.186076+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:10.186655+0000 mon.a (mon.0) 1497 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: cluster 2024-09-17T08:57:10.186904+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-09-17T08:57:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:10.188240+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:10.190783+0000 mon.c (mon.2) 161 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:10.191798+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:10 smithi136 bash[24812]: audit 2024-09-17T08:57:10.193005+0000 mon.a (mon.0) 1501 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:09.231417+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:09.233258+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:09.233919+0000 mon.a (mon.0) 1493 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:09.357625+0000 mgr.y (mgr.14532) 234 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:09.982827+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:10.185770+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:10.186076+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:10.186655+0000 mon.a (mon.0) 1497 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: cluster 2024-09-17T08:57:10.186904+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:10.188240+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:10.190783+0000 mon.c (mon.2) 161 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:10.191798+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[22670]: audit 2024-09-17T08:57:10.193005+0000 mon.a (mon.0) 1501 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:09.231417+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:09.233258+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:09.233919+0000 mon.a (mon.0) 1493 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:09.357625+0000 mgr.y (mgr.14532) 234 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:09.982827+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:10.185770+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi078-64688-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:10.186076+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:10.186655+0000 mon.a (mon.0) 1497 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: cluster 2024-09-17T08:57:10.186904+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:10.188240+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:10.190783+0000 mon.c (mon.2) 161 : audit [INF] from='client.? 172.21.15.78:0/1699686711' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:10.191798+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]: dispatch 2024-09-17T08:57:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:10 smithi078 bash[32124]: audit 2024-09-17T08:57:10.193005+0000 mon.a (mon.0) 1501 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:12.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:11 smithi136 bash[24812]: cluster 2024-09-17T08:57:10.818875+0000 mgr.y (mgr.14532) 235 : cluster [DBG] pgmap v221: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 359 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:12.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:11 smithi078 bash[32124]: cluster 2024-09-17T08:57:10.818875+0000 mgr.y (mgr.14532) 235 : cluster [DBG] pgmap v221: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 359 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:11 smithi078 bash[22670]: cluster 2024-09-17T08:57:10.818875+0000 mgr.y (mgr.14532) 235 : cluster [DBG] pgmap v221: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 359 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:11.641048+0000 mon.a (mon.0) 1502 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: cluster 2024-09-17T08:57:11.641392+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:11.643126+0000 mon.a (mon.0) 1504 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:11.645333+0000 mon.c (mon.2) 162 : audit [INF] from='client.? 172.21.15.78:0/3408770812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:11.655793+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:12.523224+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:12.523888+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: cluster 2024-09-17T08:57:12.524271+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-09-17T08:57:13.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:12.527406+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.78:0/2757068905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:12.528322+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.78:0/2921323748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:12.537387+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:12.540325+0000 mon.a (mon.0) 1510 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:12 smithi136 bash[24812]: audit 2024-09-17T08:57:12.644786+0000 mon.a (mon.0) 1511 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:11.641048+0000 mon.a (mon.0) 1502 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: cluster 2024-09-17T08:57:11.641392+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-09-17T08:57:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:11.643126+0000 mon.a (mon.0) 1504 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:11.645333+0000 mon.c (mon.2) 162 : audit [INF] from='client.? 172.21.15.78:0/3408770812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:11.655793+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:12.523224+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:12.523888+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: cluster 2024-09-17T08:57:12.524271+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:12.527406+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.78:0/2757068905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:12.528322+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.78:0/2921323748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:12.537387+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:12.540325+0000 mon.a (mon.0) 1510 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[22670]: audit 2024-09-17T08:57:12.644786+0000 mon.a (mon.0) 1511 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:11.641048+0000 mon.a (mon.0) 1502 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64830-24"}]': finished 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: cluster 2024-09-17T08:57:11.641392+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-09-17T08:57:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:11.643126+0000 mon.a (mon.0) 1504 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:11.645333+0000 mon.c (mon.2) 162 : audit [INF] from='client.? 172.21.15.78:0/3408770812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:11.655793+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:12.523224+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:12.523888+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi078-64680-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: cluster 2024-09-17T08:57:12.524271+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:12.527406+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.78:0/2757068905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:12.528322+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.78:0/2921323748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:12.537387+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:12.540325+0000 mon.a (mon.0) 1510 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:13.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:12 smithi078 bash[32124]: audit 2024-09-17T08:57:12.644786+0000 mon.a (mon.0) 1511 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:14.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: cluster 2024-09-17T08:57:12.821610+0000 mgr.y (mgr.14532) 236 : cluster [DBG] pgmap v224: 364 pgs: 72 creating+peering, 292 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T08:57:14.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.522248+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:14.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.522515+0000 mon.a (mon.0) 1513 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:14.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: cluster 2024-09-17T08:57:13.523141+0000 mon.a (mon.0) 1514 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-09-17T08:57:14.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.577470+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.578466+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.579550+0000 mon.c (mon.2) 166 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.579993+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.580599+0000 mon.c (mon.2) 167 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:14.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.581019+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:14.043 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:13 smithi136 bash[24812]: audit 2024-09-17T08:57:13.645975+0000 mon.a (mon.0) 1518 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:14.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: cluster 2024-09-17T08:57:12.821610+0000 mgr.y (mgr.14532) 236 : cluster [DBG] pgmap v224: 364 pgs: 72 creating+peering, 292 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T08:57:14.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.522248+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:14.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.522515+0000 mon.a (mon.0) 1513 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: cluster 2024-09-17T08:57:13.523141+0000 mon.a (mon.0) 1514 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.577470+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.578466+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.579550+0000 mon.c (mon.2) 166 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.579993+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.580599+0000 mon.c (mon.2) 167 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.581019+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[32124]: audit 2024-09-17T08:57:13.645975+0000 mon.a (mon.0) 1518 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:14.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: cluster 2024-09-17T08:57:12.821610+0000 mgr.y (mgr.14532) 236 : cluster [DBG] pgmap v224: 364 pgs: 72 creating+peering, 292 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.522248+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi078-64688-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.522515+0000 mon.a (mon.0) 1513 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi078-64830-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: cluster 2024-09-17T08:57:13.523141+0000 mon.a (mon.0) 1514 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.577470+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.578466+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.579550+0000 mon.c (mon.2) 166 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.579993+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.580599+0000 mon.c (mon.2) 167 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.581019+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:14.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:13 smithi078 bash[22670]: audit 2024-09-17T08:57:13.645975+0000 mon.a (mon.0) 1518 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:15.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:15 smithi136 bash[24812]: cluster 2024-09-17T08:57:13.658996+0000 mon.a (mon.0) 1519 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:15 smithi136 bash[24812]: audit 2024-09-17T08:57:14.521639+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:15 smithi136 bash[24812]: cluster 2024-09-17T08:57:14.522164+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-09-17T08:57:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:15 smithi136 bash[24812]: audit 2024-09-17T08:57:14.523500+0000 mon.c (mon.2) 168 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:15.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:15 smithi136 bash[24812]: audit 2024-09-17T08:57:14.532828+0000 mon.a (mon.0) 1522 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[32124]: cluster 2024-09-17T08:57:13.658996+0000 mon.a (mon.0) 1519 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[32124]: audit 2024-09-17T08:57:14.521639+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[32124]: cluster 2024-09-17T08:57:14.522164+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-09-17T08:57:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[32124]: audit 2024-09-17T08:57:14.523500+0000 mon.c (mon.2) 168 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[32124]: audit 2024-09-17T08:57:14.532828+0000 mon.a (mon.0) 1522 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:15.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[22670]: cluster 2024-09-17T08:57:13.658996+0000 mon.a (mon.0) 1519 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:15.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[22670]: audit 2024-09-17T08:57:14.521639+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi078-64680-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[22670]: cluster 2024-09-17T08:57:14.522164+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-09-17T08:57:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[22670]: audit 2024-09-17T08:57:14.523500+0000 mon.c (mon.2) 168 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:15 smithi078 bash[22670]: audit 2024-09-17T08:57:14.532828+0000 mon.a (mon.0) 1522 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:16.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:16 smithi136 bash[24812]: cluster 2024-09-17T08:57:14.822689+0000 mgr.y (mgr.14532) 237 : cluster [DBG] pgmap v227: 268 pgs: 8 creating+peering, 260 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:16 smithi136 bash[24812]: audit 2024-09-17T08:57:15.400255+0000 mon.a (mon.0) 1523 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:16 smithi136 bash[24812]: cluster 2024-09-17T08:57:15.975476+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-09-17T08:57:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:16 smithi136 bash[24812]: audit 2024-09-17T08:57:15.977062+0000 mon.c (mon.2) 169 : audit [INF] from='client.? 172.21.15.78:0/975937282' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:16 smithi136 bash[24812]: audit 2024-09-17T08:57:15.980962+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? 172.21.15.78:0/2308899523' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi078-64688-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:16 smithi136 bash[24812]: audit 2024-09-17T08:57:15.987359+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[22670]: cluster 2024-09-17T08:57:14.822689+0000 mgr.y (mgr.14532) 237 : cluster [DBG] pgmap v227: 268 pgs: 8 creating+peering, 260 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[22670]: audit 2024-09-17T08:57:15.400255+0000 mon.a (mon.0) 1523 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[22670]: cluster 2024-09-17T08:57:15.975476+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-09-17T08:57:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[22670]: audit 2024-09-17T08:57:15.977062+0000 mon.c (mon.2) 169 : audit [INF] from='client.? 172.21.15.78:0/975937282' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[22670]: audit 2024-09-17T08:57:15.980962+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? 172.21.15.78:0/2308899523' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi078-64688-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[22670]: audit 2024-09-17T08:57:15.987359+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[32124]: cluster 2024-09-17T08:57:14.822689+0000 mgr.y (mgr.14532) 237 : cluster [DBG] pgmap v227: 268 pgs: 8 creating+peering, 260 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[32124]: audit 2024-09-17T08:57:15.400255+0000 mon.a (mon.0) 1523 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[32124]: cluster 2024-09-17T08:57:15.975476+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[32124]: audit 2024-09-17T08:57:15.977062+0000 mon.c (mon.2) 169 : audit [INF] from='client.? 172.21.15.78:0/975937282' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[32124]: audit 2024-09-17T08:57:15.980962+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? 172.21.15.78:0/2308899523' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi078-64688-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:16.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:16 smithi078 bash[32124]: audit 2024-09-17T08:57:15.987359+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:17 smithi136 bash[24812]: audit 2024-09-17T08:57:16.406005+0000 mon.a (mon.0) 1527 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:17.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:17 smithi136 bash[24812]: audit 2024-09-17T08:57:16.536347+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:17.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:17 smithi136 bash[24812]: audit 2024-09-17T08:57:16.537833+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.78:0/2308899523' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi078-64688-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:17.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:17 smithi136 bash[24812]: audit 2024-09-17T08:57:16.538062+0000 mon.a (mon.0) 1530 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:17.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:17 smithi136 bash[24812]: cluster 2024-09-17T08:57:16.538406+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-09-17T08:57:17.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:17 smithi136 bash[24812]: cluster 2024-09-17T08:57:16.823615+0000 mgr.y (mgr.14532) 238 : cluster [DBG] pgmap v230: 340 pgs: 72 unknown, 8 creating+peering, 260 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[22670]: audit 2024-09-17T08:57:16.406005+0000 mon.a (mon.0) 1527 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[22670]: audit 2024-09-17T08:57:16.536347+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[22670]: audit 2024-09-17T08:57:16.537833+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.78:0/2308899523' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi078-64688-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[22670]: audit 2024-09-17T08:57:16.538062+0000 mon.a (mon.0) 1530 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[22670]: cluster 2024-09-17T08:57:16.538406+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-09-17T08:57:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[22670]: cluster 2024-09-17T08:57:16.823615+0000 mgr.y (mgr.14532) 238 : cluster [DBG] pgmap v230: 340 pgs: 72 unknown, 8 creating+peering, 260 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[32124]: audit 2024-09-17T08:57:16.406005+0000 mon.a (mon.0) 1527 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[32124]: audit 2024-09-17T08:57:16.536347+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi078-64680-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[32124]: audit 2024-09-17T08:57:16.537833+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.78:0/2308899523' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi078-64688-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[32124]: audit 2024-09-17T08:57:16.538062+0000 mon.a (mon.0) 1530 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi078-64830-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[32124]: cluster 2024-09-17T08:57:16.538406+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-09-17T08:57:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[32124]: cluster 2024-09-17T08:57:16.823615+0000 mgr.y (mgr.14532) 238 : cluster [DBG] pgmap v230: 340 pgs: 72 unknown, 8 creating+peering, 260 active+clean; 592 KiB data, 381 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:18.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:57:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:57:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:57:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:18 smithi136 bash[24812]: audit 2024-09-17T08:57:17.407618+0000 mon.a (mon.0) 1532 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:18 smithi136 bash[24812]: cluster 2024-09-17T08:57:17.542844+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-09-17T08:57:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:18 smithi078 bash[22670]: audit 2024-09-17T08:57:17.407618+0000 mon.a (mon.0) 1532 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:18 smithi078 bash[22670]: cluster 2024-09-17T08:57:17.542844+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-09-17T08:57:18.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:18 smithi078 bash[32124]: audit 2024-09-17T08:57:17.407618+0000 mon.a (mon.0) 1532 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:18.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:18 smithi078 bash[32124]: cluster 2024-09-17T08:57:17.542844+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-09-17T08:57:19.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: audit 2024-09-17T08:57:18.450122+0000 mon.a (mon.0) 1534 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: cluster 2024-09-17T08:57:18.549799+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: audit 2024-09-17T08:57:18.552834+0000 mon.c (mon.2) 170 : audit [INF] from='client.? 172.21.15.78:0/2380570348' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: audit 2024-09-17T08:57:18.553303+0000 mon.c (mon.2) 171 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: audit 2024-09-17T08:57:18.569411+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: audit 2024-09-17T08:57:18.571383+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.78:0/3074074649' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi078-64688-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: audit 2024-09-17T08:57:18.572057+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:19 smithi136 bash[24812]: cluster 2024-09-17T08:57:18.824492+0000 mgr.y (mgr.14532) 239 : cluster [DBG] pgmap v233: 332 pgs: 64 unknown, 268 active+clean; 616 KiB data, 382 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-17T08:57:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: audit 2024-09-17T08:57:18.450122+0000 mon.a (mon.0) 1534 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: cluster 2024-09-17T08:57:18.549799+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-09-17T08:57:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: audit 2024-09-17T08:57:18.552834+0000 mon.c (mon.2) 170 : audit [INF] from='client.? 172.21.15.78:0/2380570348' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: audit 2024-09-17T08:57:18.553303+0000 mon.c (mon.2) 171 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: audit 2024-09-17T08:57:18.569411+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: audit 2024-09-17T08:57:18.571383+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.78:0/3074074649' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi078-64688-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: audit 2024-09-17T08:57:18.572057+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[22670]: cluster 2024-09-17T08:57:18.824492+0000 mgr.y (mgr.14532) 239 : cluster [DBG] pgmap v233: 332 pgs: 64 unknown, 268 active+clean; 616 KiB data, 382 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: audit 2024-09-17T08:57:18.450122+0000 mon.a (mon.0) 1534 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: cluster 2024-09-17T08:57:18.549799+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: audit 2024-09-17T08:57:18.552834+0000 mon.c (mon.2) 170 : audit [INF] from='client.? 172.21.15.78:0/2380570348' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: audit 2024-09-17T08:57:18.553303+0000 mon.c (mon.2) 171 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: audit 2024-09-17T08:57:18.569411+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: audit 2024-09-17T08:57:18.571383+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.78:0/3074074649' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi078-64688-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:19.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: audit 2024-09-17T08:57:18.572057+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:19.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:19 smithi078 bash[32124]: cluster 2024-09-17T08:57:18.824492+0000 mgr.y (mgr.14532) 239 : cluster [DBG] pgmap v233: 332 pgs: 64 unknown, 268 active+clean; 616 KiB data, 382 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_ api_aio: Running main() from gmock_main.cc 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [----------] Global test environment set-up. 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.TooBig (11630 ms) 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (6160 ms) 2024-09-17T08:57:20.565 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (4666 ms) 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3031 ms) 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3567 ms) 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (4403 ms) 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3307 ms) 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (2815 ms) 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-17T08:57:20.566 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (2821 ms) 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3299 ms) 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2810 ms) 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3132 ms) 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2875 ms) 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-09-17T08:57:20.567 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2998 ms) 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.Flush (3035 ms) 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2978 ms) 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3013 ms) 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3022 ms) 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3002 ms) 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3011 ms) 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-09-17T08:57:20.568 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3004 ms) 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3025 ms) 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3010 ms) 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (2919 ms) 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3007 ms) 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3335 ms) 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [----------] 26 tests from LibRadosAio (93877 ms total) 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-09-17T08:57:20.569 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.360946+0000 mgr.y (mgr.14532) 240 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.451856+0000 mon.a (mon.0) 1539 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: cluster 2024-09-17T08:57:19.540549+0000 mon.a (mon.0) 1540 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.557678+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.558168+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.78:0/3074074649' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi078-64688-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.558330+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: cluster 2024-09-17T08:57:19.558791+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.573047+0000 mon.c (mon.2) 172 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.578835+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:20.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:20 smithi136 bash[24812]: audit 2024-09-17T08:57:19.950606+0000 mon.a (mon.0) 1546 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:57:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.360946+0000 mgr.y (mgr.14532) 240 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.451856+0000 mon.a (mon.0) 1539 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: cluster 2024-09-17T08:57:19.540549+0000 mon.a (mon.0) 1540 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.557678+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.558168+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.78:0/3074074649' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi078-64688-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.558330+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: cluster 2024-09-17T08:57:19.558791+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.573047+0000 mon.c (mon.2) 172 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.578835+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[32124]: audit 2024-09-17T08:57:19.950606+0000 mon.a (mon.0) 1546 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.360946+0000 mgr.y (mgr.14532) 240 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.451856+0000 mon.a (mon.0) 1539 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: cluster 2024-09-17T08:57:19.540549+0000 mon.a (mon.0) 1540 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:20.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.557678+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi078-64830-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:20.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.558168+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.78:0/3074074649' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi078-64688-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:20.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.558330+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:20.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: cluster 2024-09-17T08:57:19.558791+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-09-17T08:57:20.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.573047+0000 mon.c (mon.2) 172 : audit [INF] from='client.? 172.21.15.78:0/4018192858' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:20.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.578835+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]: dispatch 2024-09-17T08:57:20.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:20 smithi078 bash[22670]: audit 2024-09-17T08:57:19.950606+0000 mon.a (mon.0) 1546 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.453599+0000 mon.a (mon.0) 1547 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.553364+0000 mon.a (mon.0) 1548 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.562970+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: cluster 2024-09-17T08:57:20.565537+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.567480+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.598576+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.615738+0000 mon.c (mon.2) 173 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.616435+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:20.626799+0000 mon.c (mon.2) 174 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: cluster 2024-09-17T08:57:20.825287+0000 mgr.y (mgr.14532) 241 : cluster [DBG] pgmap v236: 268 pgs: 268 active+clean; 616 KiB data, 382 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-17T08:57:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:21.059024+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:21.060091+0000 mon.c (mon.2) 175 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:21.061746+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:21.062070+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:21.063792+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:21.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:21 smithi136 bash[24812]: audit 2024-09-17T08:57:21.064449+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi078-64680-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.453599+0000 mon.a (mon.0) 1547 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.553364+0000 mon.a (mon.0) 1548 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.562970+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: cluster 2024-09-17T08:57:20.565537+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.567480+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.598576+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.615738+0000 mon.c (mon.2) 173 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.616435+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:20.626799+0000 mon.c (mon.2) 174 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: cluster 2024-09-17T08:57:20.825287+0000 mgr.y (mgr.14532) 241 : cluster [DBG] pgmap v236: 268 pgs: 268 active+clean; 616 KiB data, 382 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:21.059024+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:21.060091+0000 mon.c (mon.2) 175 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:21.061746+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:21.062070+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:21.063792+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[22670]: audit 2024-09-17T08:57:21.064449+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi078-64680-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.453599+0000 mon.a (mon.0) 1547 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.553364+0000 mon.a (mon.0) 1548 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.562970+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi078-64680-27"}]': finished 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: cluster 2024-09-17T08:57:20.565537+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-09-17T08:57:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.567480+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.598576+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.615738+0000 mon.c (mon.2) 173 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.616435+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:20.626799+0000 mon.c (mon.2) 174 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: cluster 2024-09-17T08:57:20.825287+0000 mgr.y (mgr.14532) 241 : cluster [DBG] pgmap v236: 268 pgs: 268 active+clean; 616 KiB data, 382 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:21.059024+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:21.060091+0000 mon.c (mon.2) 175 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:21.061746+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:21.062070+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:21.063792+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:21.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:21 smithi078 bash[32124]: audit 2024-09-17T08:57:21.064449+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi078-64680-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.455988+0000 mon.a (mon.0) 1559 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.566302+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.567027+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi078-64680-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: cluster 2024-09-17T08:57:21.567255+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.568489+0000 mon.c (mon.2) 176 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.570232+0000 mon.c (mon.2) 177 : audit [INF] from='client.? 172.21.15.78:0/3580409451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.571120+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi078-64680-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.572118+0000 mon.a (mon.0) 1564 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.572703+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:22.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:22 smithi136 bash[24812]: audit 2024-09-17T08:57:21.777528+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:22.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.455988+0000 mon.a (mon.0) 1559 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:22.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.566302+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:22.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.567027+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi078-64680-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:22.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: cluster 2024-09-17T08:57:21.567255+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-09-17T08:57:22.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.568489+0000 mon.c (mon.2) 176 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.570232+0000 mon.c (mon.2) 177 : audit [INF] from='client.? 172.21.15.78:0/3580409451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.571120+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi078-64680-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.572118+0000 mon.a (mon.0) 1564 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.572703+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[32124]: audit 2024-09-17T08:57:21.777528+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.455988+0000 mon.a (mon.0) 1559 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.566302+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:22.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.567027+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi078-64680-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:22.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: cluster 2024-09-17T08:57:21.567255+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-09-17T08:57:22.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.568489+0000 mon.c (mon.2) 176 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:22.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.570232+0000 mon.c (mon.2) 177 : audit [INF] from='client.? 172.21.15.78:0/3580409451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:22.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.571120+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi078-64680-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:22.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.572118+0000 mon.a (mon.0) 1564 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:22.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.572703+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:22.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:22 smithi078 bash[22670]: audit 2024-09-17T08:57:21.777528+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:22.458363+0000 mon.a (mon.0) 1567 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:22.459736+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]: dispatch 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: cluster 2024-09-17T08:57:22.827776+0000 mgr.y (mgr.14532) 242 : cluster [DBG] pgmap v239: 300 pgs: 17 creating+peering, 15 creating+activating, 268 active+clean; 617 KiB data, 391 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 22 op/s 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:23.392937+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:23.393598+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:23.393720+0000 mon.a (mon.0) 1571 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]': finished 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: cluster 2024-09-17T08:57:23.393814+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:23.397953+0000 mon.a (mon.0) 1573 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:23.398668+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13"}]: dispatch 2024-09-17T08:57:23.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:23.400313+0000 mon.a (mon.0) 1575 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:23 smithi136 bash[24812]: audit 2024-09-17T08:57:23.403919+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-17T08:57:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:22.458363+0000 mon.a (mon.0) 1567 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:22.459736+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]: dispatch 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: cluster 2024-09-17T08:57:22.827776+0000 mgr.y (mgr.14532) 242 : cluster [DBG] pgmap v239: 300 pgs: 17 creating+peering, 15 creating+activating, 268 active+clean; 617 KiB data, 391 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 22 op/s 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:23.392937+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:23.393598+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:23.393720+0000 mon.a (mon.0) 1571 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]': finished 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: cluster 2024-09-17T08:57:23.393814+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:23.397953+0000 mon.a (mon.0) 1573 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:23.398668+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13"}]: dispatch 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:23.400313+0000 mon.a (mon.0) 1575 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[22670]: audit 2024-09-17T08:57:23.403919+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-17T08:57:23.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:22.458363+0000 mon.a (mon.0) 1567 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:22.459736+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]: dispatch 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: cluster 2024-09-17T08:57:22.827776+0000 mgr.y (mgr.14532) 242 : cluster [DBG] pgmap v239: 300 pgs: 17 creating+peering, 15 creating+activating, 268 active+clean; 617 KiB data, 391 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 22 op/s 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:23.392937+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi078-64688-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:23.393598+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:23.393720+0000 mon.a (mon.0) 1571 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]': finished 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: cluster 2024-09-17T08:57:23.393814+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:23.397953+0000 mon.a (mon.0) 1573 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:23.398668+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13"}]: dispatch 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:23.400313+0000 mon.a (mon.0) 1575 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:23 smithi078 bash[32124]: audit 2024-09-17T08:57:23.403919+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-17T08:57:24.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:24 smithi136 bash[24812]: cluster 2024-09-17T08:57:23.511020+0000 mon.a (mon.0) 1577 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:24 smithi136 bash[24812]: audit 2024-09-17T08:57:23.524759+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi078-64680-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:24 smithi136 bash[24812]: audit 2024-09-17T08:57:23.524978+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:24 smithi136 bash[24812]: audit 2024-09-17T08:57:23.525194+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13"}]': finished 2024-09-17T08:57:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:24 smithi136 bash[24812]: audit 2024-09-17T08:57:23.525421+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]': finished 2024-09-17T08:57:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:24 smithi136 bash[24812]: cluster 2024-09-17T08:57:23.525589+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-09-17T08:57:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:24 smithi136 bash[24812]: audit 2024-09-17T08:57:23.540654+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[22670]: cluster 2024-09-17T08:57:23.511020+0000 mon.a (mon.0) 1577 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[22670]: audit 2024-09-17T08:57:23.524759+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi078-64680-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[22670]: audit 2024-09-17T08:57:23.524978+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[22670]: audit 2024-09-17T08:57:23.525194+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13"}]': finished 2024-09-17T08:57:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[22670]: audit 2024-09-17T08:57:23.525421+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]': finished 2024-09-17T08:57:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[22670]: cluster 2024-09-17T08:57:23.525589+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[22670]: audit 2024-09-17T08:57:23.540654+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[32124]: cluster 2024-09-17T08:57:23.511020+0000 mon.a (mon.0) 1577 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[32124]: audit 2024-09-17T08:57:23.524759+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi078-64680-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[32124]: audit 2024-09-17T08:57:23.524978+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi078-64830-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[32124]: audit 2024-09-17T08:57:23.525194+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-13"}]': finished 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[32124]: audit 2024-09-17T08:57:23.525421+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]': finished 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[32124]: cluster 2024-09-17T08:57:23.525589+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-09-17T08:57:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:24 smithi078 bash[32124]: audit 2024-09-17T08:57:23.540654+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:25.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:25 smithi136 bash[24812]: cluster 2024-09-17T08:57:24.533137+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-09-17T08:57:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:25 smithi136 bash[24812]: cluster 2024-09-17T08:57:24.828926+0000 mgr.y (mgr.14532) 243 : cluster [DBG] pgmap v242: 284 pgs: 48 unknown, 236 active+clean; 617 KiB data, 391 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s wr, 0 op/s 2024-09-17T08:57:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:25 smithi136 bash[24812]: audit 2024-09-17T08:57:24.984345+0000 mon.a (mon.0) 1585 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:25 smithi136 bash[24812]: audit 2024-09-17T08:57:24.985259+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.78:0/3125634781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi078-64688-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:25 smithi136 bash[24812]: audit 2024-09-17T08:57:25.017282+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:25 smithi136 bash[24812]: audit 2024-09-17T08:57:25.018380+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:25.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[22670]: cluster 2024-09-17T08:57:24.533137+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-09-17T08:57:25.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[22670]: cluster 2024-09-17T08:57:24.828926+0000 mgr.y (mgr.14532) 243 : cluster [DBG] pgmap v242: 284 pgs: 48 unknown, 236 active+clean; 617 KiB data, 391 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s wr, 0 op/s 2024-09-17T08:57:25.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[22670]: audit 2024-09-17T08:57:24.984345+0000 mon.a (mon.0) 1585 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:25.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[22670]: audit 2024-09-17T08:57:24.985259+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.78:0/3125634781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi078-64688-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:25.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[22670]: audit 2024-09-17T08:57:25.017282+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:25.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[22670]: audit 2024-09-17T08:57:25.018380+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:25.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[32124]: cluster 2024-09-17T08:57:24.533137+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-09-17T08:57:25.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[32124]: cluster 2024-09-17T08:57:24.828926+0000 mgr.y (mgr.14532) 243 : cluster [DBG] pgmap v242: 284 pgs: 48 unknown, 236 active+clean; 617 KiB data, 391 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s wr, 0 op/s 2024-09-17T08:57:25.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[32124]: audit 2024-09-17T08:57:24.984345+0000 mon.a (mon.0) 1585 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:25.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[32124]: audit 2024-09-17T08:57:24.985259+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.78:0/3125634781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi078-64688-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:25.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[32124]: audit 2024-09-17T08:57:25.017282+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:25.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:25 smithi078 bash[32124]: audit 2024-09-17T08:57:25.018380+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:26.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: cluster 2024-09-17T08:57:25.523113+0000 mon.a (mon.0) 1589 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:26.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: audit 2024-09-17T08:57:25.545338+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? 172.21.15.78:0/3125634781' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi078-64688-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:26.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: cluster 2024-09-17T08:57:25.548495+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-09-17T08:57:26.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: audit 2024-09-17T08:57:25.550752+0000 mon.c (mon.2) 178 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:26.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: audit 2024-09-17T08:57:25.554165+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: audit 2024-09-17T08:57:25.554618+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: audit 2024-09-17T08:57:25.555059+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: audit 2024-09-17T08:57:25.555477+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[22670]: audit 2024-09-17T08:57:25.986177+0000 mon.a (mon.0) 1596 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: cluster 2024-09-17T08:57:25.523113+0000 mon.a (mon.0) 1589 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: audit 2024-09-17T08:57:25.545338+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? 172.21.15.78:0/3125634781' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi078-64688-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: cluster 2024-09-17T08:57:25.548495+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: audit 2024-09-17T08:57:25.550752+0000 mon.c (mon.2) 178 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: audit 2024-09-17T08:57:25.554165+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:26.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: audit 2024-09-17T08:57:25.554618+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:26.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: audit 2024-09-17T08:57:25.555059+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:26.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: audit 2024-09-17T08:57:25.555477+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:26.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:26 smithi078 bash[32124]: audit 2024-09-17T08:57:25.986177+0000 mon.a (mon.0) 1596 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:27.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: cluster 2024-09-17T08:57:25.523113+0000 mon.a (mon.0) 1589 : cluster [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: audit 2024-09-17T08:57:25.545338+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? 172.21.15.78:0/3125634781' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi078-64688-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: cluster 2024-09-17T08:57:25.548495+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: audit 2024-09-17T08:57:25.550752+0000 mon.c (mon.2) 178 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: audit 2024-09-17T08:57:25.554165+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: audit 2024-09-17T08:57:25.554618+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: audit 2024-09-17T08:57:25.555059+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: audit 2024-09-17T08:57:25.555477+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:27.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:26 smithi136 bash[24812]: audit 2024-09-17T08:57:25.986177+0000 mon.a (mon.0) 1596 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout:P (69946 ms total) 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (141 ms) 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (141 ms total) 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: 2024-09-17T08:57:27.547 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (72 ms) 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (3 ms) 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (75 ms total) 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (65 ms) 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (7 ms) 2024-09-17T08:57:27.548 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (72 ms total) 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (45 ms) 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (28 ms) 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (73 ms total) 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1063 ms) 2024-09-17T08:57:27.549 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1063 ms total) 2024-09-17T08:57:27.550 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: 2024-09-17T08:57:27.550 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-09-17T08:57:27.550 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (107808 ms total) 2024-09-17T08:57:27.550 INFO:tasks.workunit.client.0.smithi078.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout:pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2009 ms) 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9050 ms total) 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4050 ms) 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3980 ms) 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-17T08:57:27.554 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3965 ms) 2024-09-17T08:57:27.555 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11995 ms total) 2024-09-17T08:57:27.555 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: 2024-09-17T08:57:27.555 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-09-17T08:57:27.555 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (107770 ms total) 2024-09-17T08:57:27.555 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-09-17T08:57:27.555 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-09-17T08:57:27.555 INFO:tasks.workunit.client.0.smithi078.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-17T08:57:27.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.545867+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:27.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.546392+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:27.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.547015+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.547261+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: cluster 2024-09-17T08:57:26.548646+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.551466+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.552356+0000 mon.a (mon.0) 1603 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.552617+0000 mon.c (mon.2) 179 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:26.567521+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: cluster 2024-09-17T08:57:26.829755+0000 mgr.y (mgr.14532) 244 : cluster [DBG] pgmap v245: 260 pgs: 32 unknown, 228 active+clean; 585 KiB data, 391 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:27.032993+0000 mon.a (mon.0) 1605 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:27.532526+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:27.533233+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:27.533713+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: cluster 2024-09-17T08:57:27.536304+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-09-17T08:57:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22670]: audit 2024-09-17T08:57:27.549399+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.78:0/364692605' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi078-64688-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.545867+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.546392+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.547015+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.547261+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: cluster 2024-09-17T08:57:26.548646+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.551466+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.552356+0000 mon.a (mon.0) 1603 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.552617+0000 mon.c (mon.2) 179 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:26.567521+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: cluster 2024-09-17T08:57:26.829755+0000 mgr.y (mgr.14532) 244 : cluster [DBG] pgmap v245: 260 pgs: 32 unknown, 228 active+clean; 585 KiB data, 391 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:27.032993+0000 mon.a (mon.0) 1605 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:27.532526+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:27.533233+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:27.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:27.533713+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:27.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: cluster 2024-09-17T08:57:27.536304+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-09-17T08:57:27.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[32124]: audit 2024-09-17T08:57:27.549399+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.78:0/364692605' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi078-64688-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.545867+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.546392+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.547015+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.547261+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: cluster 2024-09-17T08:57:26.548646+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.551466+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]: dispatch 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.552356+0000 mon.a (mon.0) 1603 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]: dispatch 2024-09-17T08:57:28.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.552617+0000 mon.c (mon.2) 179 : audit [INF] from='client.? 172.21.15.78:0/237234865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:26.567521+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]: dispatch 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: cluster 2024-09-17T08:57:26.829755+0000 mgr.y (mgr.14532) 244 : cluster [DBG] pgmap v245: 260 pgs: 32 unknown, 228 active+clean; 585 KiB data, 391 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:27.032993+0000 mon.a (mon.0) 1605 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:27.532526+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? 172.21.15.78:0/1292671298' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi078-64912-21"}]': finished 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:27.533233+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? 172.21.15.78:0/2296763073' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi078-64680-28"}]': finished 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:27.533713+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi078-64830-36"}]': finished 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: cluster 2024-09-17T08:57:27.536304+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-09-17T08:57:28.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:27 smithi136 bash[24812]: audit 2024-09-17T08:57:27.549399+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.78:0/364692605' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi078-64688-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:28.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:57:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:57:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:57:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:27.570092+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:27.576546+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:27.577644+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:27.577999+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi078-64680-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:28.034703+0000 mon.a (mon.0) 1615 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:28.526875+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.78:0/364692605' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi078-64688-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:28.527283+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:28.527441+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi078-64680-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: cluster 2024-09-17T08:57:28.527651+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:28.528910+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi078-64680-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[22670]: audit 2024-09-17T08:57:28.536163+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-15"}]: dispatch 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:27.570092+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:27.576546+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:27.577644+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:27.577999+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi078-64680-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:28.034703+0000 mon.a (mon.0) 1615 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:28.526875+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.78:0/364692605' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi078-64688-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:28.527283+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:28.527441+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi078-64680-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: cluster 2024-09-17T08:57:28.527651+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:28.528910+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi078-64680-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:28 smithi078 bash[32124]: audit 2024-09-17T08:57:28.536163+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-15"}]: dispatch 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:27.570092+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:27.576546+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:27.577644+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:27.577999+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi078-64680-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:28.034703+0000 mon.a (mon.0) 1615 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:28.526875+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.78:0/364692605' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi078-64688-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:28.527283+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:28.527441+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi078-64680-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: cluster 2024-09-17T08:57:28.527651+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-09-17T08:57:29.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:28.528910+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi078-64680-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:29.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:28 smithi136 bash[24812]: audit 2024-09-17T08:57:28.536163+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-15"}]: dispatch 2024-09-17T08:57:29.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:57:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:57:30.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:29 smithi136 bash[24812]: cluster 2024-09-17T08:57:28.830651+0000 mgr.y (mgr.14532) 245 : cluster [DBG] pgmap v248: 292 pgs: 32 creating+peering, 260 active+clean; 585 KiB data, 392 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:30.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:29 smithi136 bash[24812]: audit 2024-09-17T08:57:29.036302+0000 mon.a (mon.0) 1622 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:30.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:29 smithi078 bash[32124]: cluster 2024-09-17T08:57:28.830651+0000 mgr.y (mgr.14532) 245 : cluster [DBG] pgmap v248: 292 pgs: 32 creating+peering, 260 active+clean; 585 KiB data, 392 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:30.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:29 smithi078 bash[32124]: audit 2024-09-17T08:57:29.036302+0000 mon.a (mon.0) 1622 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:30.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:29 smithi078 bash[22670]: cluster 2024-09-17T08:57:28.830651+0000 mgr.y (mgr.14532) 245 : cluster [DBG] pgmap v248: 292 pgs: 32 creating+peering, 260 active+clean; 585 KiB data, 392 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:30.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:29 smithi078 bash[22670]: audit 2024-09-17T08:57:29.036302+0000 mon.a (mon.0) 1622 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:29.371557+0000 mgr.y (mgr.14532) 246 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:29.976290+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-15"}]': finished 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: cluster 2024-09-17T08:57:29.976380+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:29.977851+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-15", "mode": "writeback"}]: dispatch 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:30.436744+0000 mon.a (mon.0) 1626 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: cluster 2024-09-17T08:57:30.523942+0000 mon.a (mon.0) 1627 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:30.538311+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi078-64680-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:30.538529+0000 mon.a (mon.0) 1629 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-15", "mode": "writeback"}]': finished 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: cluster 2024-09-17T08:57:30.538774+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-09-17T08:57:31.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:30.541041+0000 mon.c (mon.2) 180 : audit [INF] from='client.? 172.21.15.78:0/3729999868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:31.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:30 smithi136 bash[24812]: audit 2024-09-17T08:57:30.555101+0000 mon.a (mon.0) 1631 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:31.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:29.371557+0000 mgr.y (mgr.14532) 246 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:31.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:29.976290+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-15"}]': finished 2024-09-17T08:57:31.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: cluster 2024-09-17T08:57:29.976380+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-09-17T08:57:31.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:29.977851+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-15", "mode": "writeback"}]: dispatch 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:30.436744+0000 mon.a (mon.0) 1626 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: cluster 2024-09-17T08:57:30.523942+0000 mon.a (mon.0) 1627 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:30.538311+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi078-64680-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:30.538529+0000 mon.a (mon.0) 1629 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-15", "mode": "writeback"}]': finished 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: cluster 2024-09-17T08:57:30.538774+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:30.541041+0000 mon.c (mon.2) 180 : audit [INF] from='client.? 172.21.15.78:0/3729999868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[32124]: audit 2024-09-17T08:57:30.555101+0000 mon.a (mon.0) 1631 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:29.371557+0000 mgr.y (mgr.14532) 246 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:29.976290+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-15"}]': finished 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: cluster 2024-09-17T08:57:29.976380+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-09-17T08:57:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:29.977851+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-15", "mode": "writeback"}]: dispatch 2024-09-17T08:57:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:30.436744+0000 mon.a (mon.0) 1626 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: cluster 2024-09-17T08:57:30.523942+0000 mon.a (mon.0) 1627 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:30.538311+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi078-64680-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:30.538529+0000 mon.a (mon.0) 1629 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-15", "mode": "writeback"}]': finished 2024-09-17T08:57:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: cluster 2024-09-17T08:57:30.538774+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-09-17T08:57:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:30.541041+0000 mon.c (mon.2) 180 : audit [INF] from='client.? 172.21.15.78:0/3729999868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:30 smithi078 bash[22670]: audit 2024-09-17T08:57:30.555101+0000 mon.a (mon.0) 1631 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:32.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:31 smithi136 bash[24812]: cluster 2024-09-17T08:57:30.831534+0000 mgr.y (mgr.14532) 247 : cluster [DBG] pgmap v251: 300 pgs: 40 unknown, 260 active+clean; 585 KiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:57:32.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:31 smithi136 bash[24812]: audit 2024-09-17T08:57:31.438315+0000 mon.a (mon.0) 1632 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:32.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:31 smithi136 bash[24812]: cluster 2024-09-17T08:57:31.526482+0000 mon.a (mon.0) 1633 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:32.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:31 smithi136 bash[24812]: audit 2024-09-17T08:57:31.543872+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:32.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:31 smithi136 bash[24812]: cluster 2024-09-17T08:57:31.544528+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-09-17T08:57:32.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:31 smithi136 bash[24812]: audit 2024-09-17T08:57:31.615646+0000 mon.a (mon.0) 1636 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:32.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[22670]: cluster 2024-09-17T08:57:30.831534+0000 mgr.y (mgr.14532) 247 : cluster [DBG] pgmap v251: 300 pgs: 40 unknown, 260 active+clean; 585 KiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:57:32.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[22670]: audit 2024-09-17T08:57:31.438315+0000 mon.a (mon.0) 1632 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:32.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[22670]: cluster 2024-09-17T08:57:31.526482+0000 mon.a (mon.0) 1633 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:32.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[22670]: audit 2024-09-17T08:57:31.543872+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:32.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[22670]: cluster 2024-09-17T08:57:31.544528+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-09-17T08:57:32.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[22670]: audit 2024-09-17T08:57:31.615646+0000 mon.a (mon.0) 1636 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:32.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[32124]: cluster 2024-09-17T08:57:30.831534+0000 mgr.y (mgr.14532) 247 : cluster [DBG] pgmap v251: 300 pgs: 40 unknown, 260 active+clean; 585 KiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:57:32.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[32124]: audit 2024-09-17T08:57:31.438315+0000 mon.a (mon.0) 1632 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:32.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[32124]: cluster 2024-09-17T08:57:31.526482+0000 mon.a (mon.0) 1633 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:32.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[32124]: audit 2024-09-17T08:57:31.543872+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi078-64688-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:32.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[32124]: cluster 2024-09-17T08:57:31.544528+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-09-17T08:57:32.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:31 smithi078 bash[32124]: audit 2024-09-17T08:57:31.615646+0000 mon.a (mon.0) 1636 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (11631 ms) 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-09-17T08:57:32.559 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (22986 ms) 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (5940 ms) 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (2855 ms) 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3445 ms) 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2776 ms) 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2871 ms) 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3017 ms) 2024-09-17T08:57:32.560 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2987 ms) 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3023 ms) 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2999 ms) 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3012 ms) 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3001 ms) 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3018 ms) 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3424 ms) 2024-09-17T08:57:32.561 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2600 ms) 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3020 ms) 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3010 ms) 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2915 ms) 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3460 ms) 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2884 ms) 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3017 ms) 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-09-17T08:57:32.562 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3026 ms) 2024-09-17T08:57:32.563 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-09-17T08:57:32.563 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2963 ms) 2024-09-17T08:57:32.563 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-09-17T08:57:32.563 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3019 ms) 2024-09-17T08:57:32.563 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-09-17T08:57:32.563 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3423 ms) 2024-09-17T08:57:32.563 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-17T08:57:33.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:33 smithi136 bash[24812]: audit 2024-09-17T08:57:32.440047+0000 mon.a (mon.0) 1637 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:33.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:33 smithi136 bash[24812]: audit 2024-09-17T08:57:32.548466+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:33.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:33 smithi136 bash[24812]: cluster 2024-09-17T08:57:32.548656+0000 mon.a (mon.0) 1639 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-09-17T08:57:33.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:33 smithi136 bash[24812]: audit 2024-09-17T08:57:32.552219+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15"}]: dispatch 2024-09-17T08:57:33.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:33 smithi136 bash[24812]: audit 2024-09-17T08:57:32.553125+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:33.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[22670]: audit 2024-09-17T08:57:32.440047+0000 mon.a (mon.0) 1637 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[22670]: audit 2024-09-17T08:57:32.548466+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[22670]: cluster 2024-09-17T08:57:32.548656+0000 mon.a (mon.0) 1639 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[22670]: audit 2024-09-17T08:57:32.552219+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15"}]: dispatch 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[22670]: audit 2024-09-17T08:57:32.553125+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[32124]: audit 2024-09-17T08:57:32.440047+0000 mon.a (mon.0) 1637 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[32124]: audit 2024-09-17T08:57:32.548466+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[32124]: cluster 2024-09-17T08:57:32.548656+0000 mon.a (mon.0) 1639 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[32124]: audit 2024-09-17T08:57:32.552219+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15"}]: dispatch 2024-09-17T08:57:33.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:33 smithi078 bash[32124]: audit 2024-09-17T08:57:32.553125+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: cluster 2024-09-17T08:57:32.833753+0000 mgr.y (mgr.14532) 248 : cluster [DBG] pgmap v254: 260 pgs: 260 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T08:57:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: audit 2024-09-17T08:57:33.038380+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-09-17T08:57:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: audit 2024-09-17T08:57:33.441758+0000 mon.a (mon.0) 1643 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: cluster 2024-09-17T08:57:33.544553+0000 mon.a (mon.0) 1644 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: audit 2024-09-17T08:57:33.563655+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15"}]': finished 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: audit 2024-09-17T08:57:33.563857+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: audit 2024-09-17T08:57:33.564073+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: cluster 2024-09-17T08:57:33.564207+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: audit 2024-09-17T08:57:33.580886+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[22670]: audit 2024-09-17T08:57:33.582851+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.78:0/1487375863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi078-64688-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: cluster 2024-09-17T08:57:32.833753+0000 mgr.y (mgr.14532) 248 : cluster [DBG] pgmap v254: 260 pgs: 260 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: audit 2024-09-17T08:57:33.038380+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: audit 2024-09-17T08:57:33.441758+0000 mon.a (mon.0) 1643 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: cluster 2024-09-17T08:57:33.544553+0000 mon.a (mon.0) 1644 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: audit 2024-09-17T08:57:33.563655+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15"}]': finished 2024-09-17T08:57:34.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: audit 2024-09-17T08:57:33.563857+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:34.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: audit 2024-09-17T08:57:33.564073+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-17T08:57:34.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: cluster 2024-09-17T08:57:33.564207+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-09-17T08:57:34.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: audit 2024-09-17T08:57:33.580886+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:34.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:34 smithi078 bash[32124]: audit 2024-09-17T08:57:33.582851+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.78:0/1487375863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi078-64688-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: cluster 2024-09-17T08:57:32.833753+0000 mgr.y (mgr.14532) 248 : cluster [DBG] pgmap v254: 260 pgs: 260 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: audit 2024-09-17T08:57:33.038380+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: audit 2024-09-17T08:57:33.441758+0000 mon.a (mon.0) 1643 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: cluster 2024-09-17T08:57:33.544553+0000 mon.a (mon.0) 1644 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: audit 2024-09-17T08:57:33.563655+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-15"}]': finished 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: audit 2024-09-17T08:57:33.563857+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: audit 2024-09-17T08:57:33.564073+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: cluster 2024-09-17T08:57:33.564207+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: audit 2024-09-17T08:57:33.580886+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]: dispatch 2024-09-17T08:57:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:34 smithi136 bash[24812]: audit 2024-09-17T08:57:33.582851+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.78:0/1487375863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi078-64688-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:35.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:34.443497+0000 mon.a (mon.0) 1651 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:35.394 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:34.567763+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:35.394 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:34.568325+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? 172.21.15.78:0/1487375863' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi078-64688-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: cluster 2024-09-17T08:57:34.568727+0000 mon.a (mon.0) 1654 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:34.614436+0000 mon.c (mon.2) 181 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:35.027945+0000 mon.a (mon.0) 1655 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:35.029259+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:35.029824+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:35.031035+0000 mon.c (mon.2) 182 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:35.031878+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:35.032751+0000 mon.c (mon.2) 183 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[22670]: audit 2024-09-17T08:57:35.033313+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:35.395 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:34.443497+0000 mon.a (mon.0) 1651 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:34.567763+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:34.568325+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? 172.21.15.78:0/1487375863' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi078-64688-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: cluster 2024-09-17T08:57:34.568727+0000 mon.a (mon.0) 1654 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:34.614436+0000 mon.c (mon.2) 181 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:35.027945+0000 mon.a (mon.0) 1655 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:35.029259+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:35.029824+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:35.031035+0000 mon.c (mon.2) 182 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:35.031878+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:35.032751+0000 mon.c (mon.2) 183 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:35.396 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:35 smithi078 bash[32124]: audit 2024-09-17T08:57:35.033313+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:34.443497+0000 mon.a (mon.0) 1651 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:34.567763+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.78:0/2561017860' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi078-64680-29"}]': finished 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:34.568325+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? 172.21.15.78:0/1487375863' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi078-64688-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: cluster 2024-09-17T08:57:34.568727+0000 mon.a (mon.0) 1654 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:34.614436+0000 mon.c (mon.2) 181 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:35.027945+0000 mon.a (mon.0) 1655 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:35.029259+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]: dispatch 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:35.029824+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:35.031035+0000 mon.c (mon.2) 182 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:35.031878+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:35.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:35.032751+0000 mon.c (mon.2) 183 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:35.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:35 smithi136 bash[24812]: audit 2024-09-17T08:57:35.033313+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: cluster 2024-09-17T08:57:34.834794+0000 mgr.y (mgr.14532) 249 : cluster [DBG] pgmap v257: 260 pgs: 32 unknown, 228 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: audit 2024-09-17T08:57:35.582246+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]': finished 2024-09-17T08:57:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: audit 2024-09-17T08:57:35.582505+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: cluster 2024-09-17T08:57:35.582710+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-09-17T08:57:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: audit 2024-09-17T08:57:35.587043+0000 mon.a (mon.0) 1663 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: audit 2024-09-17T08:57:35.589137+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: audit 2024-09-17T08:57:35.604052+0000 mon.c (mon.2) 184 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[22670]: audit 2024-09-17T08:57:35.604719+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: cluster 2024-09-17T08:57:34.834794+0000 mgr.y (mgr.14532) 249 : cluster [DBG] pgmap v257: 260 pgs: 32 unknown, 228 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: audit 2024-09-17T08:57:35.582246+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]': finished 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: audit 2024-09-17T08:57:35.582505+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: cluster 2024-09-17T08:57:35.582710+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: audit 2024-09-17T08:57:35.587043+0000 mon.a (mon.0) 1663 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: audit 2024-09-17T08:57:35.589137+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: audit 2024-09-17T08:57:35.604052+0000 mon.c (mon.2) 184 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:36 smithi078 bash[32124]: audit 2024-09-17T08:57:35.604719+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: cluster 2024-09-17T08:57:34.834794+0000 mgr.y (mgr.14532) 249 : cluster [DBG] pgmap v257: 260 pgs: 32 unknown, 228 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: audit 2024-09-17T08:57:35.582246+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pg_num","val":"11"}]': finished 2024-09-17T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: audit 2024-09-17T08:57:35.582505+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi078-64680-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: cluster 2024-09-17T08:57:35.582710+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-09-17T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: audit 2024-09-17T08:57:35.587043+0000 mon.a (mon.0) 1663 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: audit 2024-09-17T08:57:35.589137+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: audit 2024-09-17T08:57:35.604052+0000 mon.c (mon.2) 184 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:36 smithi136 bash[24812]: audit 2024-09-17T08:57:35.604719+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:36.586164+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: cluster 2024-09-17T08:57:36.835613+0000 mgr.y (mgr.14532) 250 : cluster [DBG] pgmap v260: 292 pgs: 64 unknown, 228 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: cluster 2024-09-17T08:57:37.040275+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-09-17T08:57:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.041128+0000 mon.a (mon.0) 1668 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.041612+0000 mon.c (mon.2) 185 : audit [INF] from='client.? 172.21.15.78:0/3300530589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.050484+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.050987+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: cluster 2024-09-17T08:57:37.517881+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.533094+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.533889+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.534136+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: cluster 2024-09-17T08:57:37.534356+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-09-17T08:57:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22670]: audit 2024-09-17T08:57:37.542828+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-17"}]: dispatch 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:36.586164+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: cluster 2024-09-17T08:57:36.835613+0000 mgr.y (mgr.14532) 250 : cluster [DBG] pgmap v260: 292 pgs: 64 unknown, 228 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: cluster 2024-09-17T08:57:37.040275+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.041128+0000 mon.a (mon.0) 1668 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.041612+0000 mon.c (mon.2) 185 : audit [INF] from='client.? 172.21.15.78:0/3300530589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.050484+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.050987+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: cluster 2024-09-17T08:57:37.517881+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.533094+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.533889+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.534136+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: cluster 2024-09-17T08:57:37.534356+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-09-17T08:57:37.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[32124]: audit 2024-09-17T08:57:37.542828+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-17"}]: dispatch 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:36.586164+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: cluster 2024-09-17T08:57:36.835613+0000 mgr.y (mgr.14532) 250 : cluster [DBG] pgmap v260: 292 pgs: 64 unknown, 228 active+clean; 585 KiB data, 401 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: cluster 2024-09-17T08:57:37.040275+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.041128+0000 mon.a (mon.0) 1668 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.041612+0000 mon.c (mon.2) 185 : audit [INF] from='client.? 172.21.15.78:0/3300530589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.050484+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.050987+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: cluster 2024-09-17T08:57:37.517881+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.533094+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi078-64680-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.533889+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi078-64688-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.534136+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: cluster 2024-09-17T08:57:37.534356+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-09-17T08:57:38.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:37 smithi136 bash[24812]: audit 2024-09-17T08:57:37.542828+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-17"}]: dispatch 2024-09-17T08:57:38.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:57:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:57:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:57:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:39 smithi136 bash[24812]: audit 2024-09-17T08:57:38.042493+0000 mon.a (mon.0) 1677 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:39.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:39 smithi136 bash[24812]: audit 2024-09-17T08:57:38.539870+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-17"}]': finished 2024-09-17T08:57:39.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:39 smithi136 bash[24812]: cluster 2024-09-17T08:57:38.540278+0000 mon.a (mon.0) 1679 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-09-17T08:57:39.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:39 smithi136 bash[24812]: audit 2024-09-17T08:57:38.542754+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-17", "mode": "writeback"}]: dispatch 2024-09-17T08:57:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[22670]: audit 2024-09-17T08:57:38.042493+0000 mon.a (mon.0) 1677 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[22670]: audit 2024-09-17T08:57:38.539870+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-17"}]': finished 2024-09-17T08:57:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[22670]: cluster 2024-09-17T08:57:38.540278+0000 mon.a (mon.0) 1679 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-09-17T08:57:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[22670]: audit 2024-09-17T08:57:38.542754+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-17", "mode": "writeback"}]: dispatch 2024-09-17T08:57:39.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[32124]: audit 2024-09-17T08:57:38.042493+0000 mon.a (mon.0) 1677 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:39.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[32124]: audit 2024-09-17T08:57:38.539870+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-17"}]': finished 2024-09-17T08:57:39.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[32124]: cluster 2024-09-17T08:57:38.540278+0000 mon.a (mon.0) 1679 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-09-17T08:57:39.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:39 smithi078 bash[32124]: audit 2024-09-17T08:57:38.542754+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-17", "mode": "writeback"}]: dispatch 2024-09-17T08:57:39.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:57:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: cluster 2024-09-17T08:57:38.836637+0000 mgr.y (mgr.14532) 251 : cluster [DBG] pgmap v263: 268 pgs: 8 creating+peering, 260 active+clean; 585 KiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.012718+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.044052+0000 mon.a (mon.0) 1682 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: cluster 2024-09-17T08:57:39.528121+0000 mon.a (mon.0) 1683 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.546565+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-17", "mode": "writeback"}]': finished 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.546865+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: cluster 2024-09-17T08:57:39.547023+0000 mon.a (mon.0) 1686 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.553816+0000 mon.c (mon.2) 186 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.554181+0000 mon.c (mon.2) 187 : audit [INF] from='client.? 172.21.15.78:0/2975968354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:40.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.560291+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:40.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.561312+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:40.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:40 smithi136 bash[24812]: audit 2024-09-17T08:57:39.654113+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: cluster 2024-09-17T08:57:38.836637+0000 mgr.y (mgr.14532) 251 : cluster [DBG] pgmap v263: 268 pgs: 8 creating+peering, 260 active+clean; 585 KiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-17T08:57:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.012718+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-09-17T08:57:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.044052+0000 mon.a (mon.0) 1682 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: cluster 2024-09-17T08:57:39.528121+0000 mon.a (mon.0) 1683 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.546565+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-17", "mode": "writeback"}]': finished 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.546865+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: cluster 2024-09-17T08:57:39.547023+0000 mon.a (mon.0) 1686 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.553816+0000 mon.c (mon.2) 186 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.554181+0000 mon.c (mon.2) 187 : audit [INF] from='client.? 172.21.15.78:0/2975968354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.560291+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.561312+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[22670]: audit 2024-09-17T08:57:39.654113+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: cluster 2024-09-17T08:57:38.836637+0000 mgr.y (mgr.14532) 251 : cluster [DBG] pgmap v263: 268 pgs: 8 creating+peering, 260 active+clean; 585 KiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-17T08:57:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.012718+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.044052+0000 mon.a (mon.0) 1682 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: cluster 2024-09-17T08:57:39.528121+0000 mon.a (mon.0) 1683 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.546565+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-17", "mode": "writeback"}]': finished 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.546865+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: cluster 2024-09-17T08:57:39.547023+0000 mon.a (mon.0) 1686 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.553816+0000 mon.c (mon.2) 186 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.554181+0000 mon.c (mon.2) 187 : audit [INF] from='client.? 172.21.15.78:0/2975968354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.560291+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.561312+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:40.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:40 smithi078 bash[32124]: audit 2024-09-17T08:57:39.654113+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:41.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:39.380152+0000 mgr.y (mgr.14532) 252 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.036617+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.039027+0000 mon.a (mon.0) 1691 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.045548+0000 mon.a (mon.0) 1692 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.550566+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.550824+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.551474+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: cluster 2024-09-17T08:57:40.551665+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.552790+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17"}]: dispatch 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.555227+0000 mon.c (mon.2) 188 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:41 smithi136 bash[24812]: audit 2024-09-17T08:57:40.556299+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:39.380152+0000 mgr.y (mgr.14532) 252 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.036617+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.039027+0000 mon.a (mon.0) 1691 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.045548+0000 mon.a (mon.0) 1692 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.550566+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.550824+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.551474+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: cluster 2024-09-17T08:57:40.551665+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.552790+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17"}]: dispatch 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.555227+0000 mon.c (mon.2) 188 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[32124]: audit 2024-09-17T08:57:40.556299+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:39.380152+0000 mgr.y (mgr.14532) 252 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.036617+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.039027+0000 mon.a (mon.0) 1691 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.045548+0000 mon.a (mon.0) 1692 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.550566+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.550824+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi078-64688-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.551474+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: cluster 2024-09-17T08:57:40.551665+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.552790+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17"}]: dispatch 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.555227+0000 mon.c (mon.2) 188 : audit [INF] from='client.? 172.21.15.78:0/1305058766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:41 smithi078 bash[22670]: audit 2024-09-17T08:57:40.556299+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]: dispatch 2024-09-17T08:57:42.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:42 smithi136 bash[24812]: cluster 2024-09-17T08:57:40.837678+0000 mgr.y (mgr.14532) 253 : cluster [DBG] pgmap v266: 292 pgs: 32 unknown, 260 active+clean; 585 KiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-17T08:57:42.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:42 smithi136 bash[24812]: audit 2024-09-17T08:57:41.047085+0000 mon.a (mon.0) 1699 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:42.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:42 smithi136 bash[24812]: cluster 2024-09-17T08:57:41.543528+0000 mon.a (mon.0) 1700 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:42.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:42 smithi136 bash[24812]: audit 2024-09-17T08:57:41.563126+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17"}]': finished 2024-09-17T08:57:42.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:42 smithi136 bash[24812]: audit 2024-09-17T08:57:41.563385+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:42.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:42 smithi136 bash[24812]: cluster 2024-09-17T08:57:41.563696+0000 mon.a (mon.0) 1703 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-09-17T08:57:42.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:42 smithi136 bash[24812]: audit 2024-09-17T08:57:41.619195+0000 mon.c (mon.2) 189 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[22670]: cluster 2024-09-17T08:57:40.837678+0000 mgr.y (mgr.14532) 253 : cluster [DBG] pgmap v266: 292 pgs: 32 unknown, 260 active+clean; 585 KiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-17T08:57:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[22670]: audit 2024-09-17T08:57:41.047085+0000 mon.a (mon.0) 1699 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[22670]: cluster 2024-09-17T08:57:41.543528+0000 mon.a (mon.0) 1700 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[22670]: audit 2024-09-17T08:57:41.563126+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17"}]': finished 2024-09-17T08:57:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[22670]: audit 2024-09-17T08:57:41.563385+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[22670]: cluster 2024-09-17T08:57:41.563696+0000 mon.a (mon.0) 1703 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[22670]: audit 2024-09-17T08:57:41.619195+0000 mon.c (mon.2) 189 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[32124]: cluster 2024-09-17T08:57:40.837678+0000 mgr.y (mgr.14532) 253 : cluster [DBG] pgmap v266: 292 pgs: 32 unknown, 260 active+clean; 585 KiB data, 406 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[32124]: audit 2024-09-17T08:57:41.047085+0000 mon.a (mon.0) 1699 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[32124]: cluster 2024-09-17T08:57:41.543528+0000 mon.a (mon.0) 1700 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[32124]: audit 2024-09-17T08:57:41.563126+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-17"}]': finished 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[32124]: audit 2024-09-17T08:57:41.563385+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi078-64680-30"}]': finished 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[32124]: cluster 2024-09-17T08:57:41.563696+0000 mon.a (mon.0) 1703 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-09-17T08:57:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:42 smithi078 bash[32124]: audit 2024-09-17T08:57:41.619195+0000 mon.c (mon.2) 189 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.036257+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.037843+0000 mon.c (mon.2) 190 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.047429+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.048321+0000 mon.c (mon.2) 191 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.048376+0000 mon.a (mon.0) 1706 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.048794+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.562927+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: cluster 2024-09-17T08:57:42.563143+0000 mon.a (mon.0) 1709 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-09-17T08:57:43.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.572363+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi078-64688-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:43.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:42.575670+0000 mon.c (mon.2) 192 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:43 smithi136 bash[24812]: audit 2024-09-17T08:57:43.019636+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.036257+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.037843+0000 mon.c (mon.2) 190 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.047429+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.048321+0000 mon.c (mon.2) 191 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.048376+0000 mon.a (mon.0) 1706 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.048794+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.562927+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: cluster 2024-09-17T08:57:42.563143+0000 mon.a (mon.0) 1709 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.572363+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi078-64688-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:42.575670+0000 mon.c (mon.2) 192 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[32124]: audit 2024-09-17T08:57:43.019636+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.036257+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.037843+0000 mon.c (mon.2) 190 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.047429+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.048321+0000 mon.c (mon.2) 191 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.048376+0000 mon.a (mon.0) 1706 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.048794+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.562927+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi078-64680-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: cluster 2024-09-17T08:57:42.563143+0000 mon.a (mon.0) 1709 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.572363+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi078-64688-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:42.575670+0000 mon.c (mon.2) 192 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:43 smithi078 bash[22670]: audit 2024-09-17T08:57:43.019636+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:44.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:44 smithi136 bash[24812]: cluster 2024-09-17T08:57:42.839536+0000 mgr.y (mgr.14532) 254 : cluster [DBG] pgmap v269: 259 pgs: 32 creating+peering, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:44.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:44 smithi136 bash[24812]: audit 2024-09-17T08:57:43.049600+0000 mon.a (mon.0) 1712 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:44.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:44 smithi136 bash[24812]: cluster 2024-09-17T08:57:43.554720+0000 mon.a (mon.0) 1713 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:44.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:44 smithi136 bash[24812]: audit 2024-09-17T08:57:43.573856+0000 mon.a (mon.0) 1714 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi078-64688-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:44.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:44 smithi136 bash[24812]: cluster 2024-09-17T08:57:44.021457+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-09-17T08:57:44.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:44 smithi136 bash[24812]: audit 2024-09-17T08:57:44.024475+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[22670]: cluster 2024-09-17T08:57:42.839536+0000 mgr.y (mgr.14532) 254 : cluster [DBG] pgmap v269: 259 pgs: 32 creating+peering, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[22670]: audit 2024-09-17T08:57:43.049600+0000 mon.a (mon.0) 1712 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[22670]: cluster 2024-09-17T08:57:43.554720+0000 mon.a (mon.0) 1713 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[22670]: audit 2024-09-17T08:57:43.573856+0000 mon.a (mon.0) 1714 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi078-64688-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[22670]: cluster 2024-09-17T08:57:44.021457+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-09-17T08:57:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[22670]: audit 2024-09-17T08:57:44.024475+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[32124]: cluster 2024-09-17T08:57:42.839536+0000 mgr.y (mgr.14532) 254 : cluster [DBG] pgmap v269: 259 pgs: 32 creating+peering, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[32124]: audit 2024-09-17T08:57:43.049600+0000 mon.a (mon.0) 1712 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[32124]: cluster 2024-09-17T08:57:43.554720+0000 mon.a (mon.0) 1713 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[32124]: audit 2024-09-17T08:57:43.573856+0000 mon.a (mon.0) 1714 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi078-64688-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[32124]: cluster 2024-09-17T08:57:44.021457+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-09-17T08:57:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:44 smithi078 bash[32124]: audit 2024-09-17T08:57:44.024475+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.051562+0000 mon.a (mon.0) 1717 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.523020+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd=[{ 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.523052+0000 mon.a (mon.0) 1719 : audit [INF] "prefix": "osd pool set", 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.523073+0000 mon.a (mon.0) 1720 : audit [INF] "pool": "PoolEIOFlag_smithi078-64688-33", 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.523097+0000 mon.a (mon.0) 1721 : audit [INF] "var": "eio", 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.523120+0000 mon.a (mon.0) 1722 : audit [INF] "val": "true" 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.523148+0000 mon.a (mon.0) 1723 : audit [INF] }]: dispatch 2024-09-17T08:57:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.576975+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.577356+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.577764+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd='[{ 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.577812+0000 mon.a (mon.0) 1727 : audit [INF] "prefix": "osd pool set", 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.577847+0000 mon.a (mon.0) 1728 : audit [INF] "pool": "PoolEIOFlag_smithi078-64688-33", 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.577876+0000 mon.a (mon.0) 1729 : audit [INF] "var": "eio", 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.577903+0000 mon.a (mon.0) 1730 : audit [INF] "val": "true" 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.577935+0000 mon.a (mon.0) 1731 : audit [INF] }]': finished 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: cluster 2024-09-17T08:57:44.578095+0000 mon.a (mon.0) 1732 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[22670]: audit 2024-09-17T08:57:44.593125+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:45.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.051562+0000 mon.a (mon.0) 1717 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.523020+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd=[{ 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.523052+0000 mon.a (mon.0) 1719 : audit [INF] "prefix": "osd pool set", 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.523073+0000 mon.a (mon.0) 1720 : audit [INF] "pool": "PoolEIOFlag_smithi078-64688-33", 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.523097+0000 mon.a (mon.0) 1721 : audit [INF] "var": "eio", 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.523120+0000 mon.a (mon.0) 1722 : audit [INF] "val": "true" 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.523148+0000 mon.a (mon.0) 1723 : audit [INF] }]: dispatch 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.576975+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.577356+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.577764+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd='[{ 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.577812+0000 mon.a (mon.0) 1727 : audit [INF] "prefix": "osd pool set", 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.577847+0000 mon.a (mon.0) 1728 : audit [INF] "pool": "PoolEIOFlag_smithi078-64688-33", 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.577876+0000 mon.a (mon.0) 1729 : audit [INF] "var": "eio", 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.577903+0000 mon.a (mon.0) 1730 : audit [INF] "val": "true" 2024-09-17T08:57:45.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.577935+0000 mon.a (mon.0) 1731 : audit [INF] }]': finished 2024-09-17T08:57:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: cluster 2024-09-17T08:57:44.578095+0000 mon.a (mon.0) 1732 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-09-17T08:57:45.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:45 smithi078 bash[32124]: audit 2024-09-17T08:57:44.593125+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.051562+0000 mon.a (mon.0) 1717 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.523020+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd=[{ 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.523052+0000 mon.a (mon.0) 1719 : audit [INF] "prefix": "osd pool set", 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.523073+0000 mon.a (mon.0) 1720 : audit [INF] "pool": "PoolEIOFlag_smithi078-64688-33", 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.523097+0000 mon.a (mon.0) 1721 : audit [INF] "var": "eio", 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.523120+0000 mon.a (mon.0) 1722 : audit [INF] "val": "true" 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.523148+0000 mon.a (mon.0) 1723 : audit [INF] }]: dispatch 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.576975+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi078-64680-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.577356+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.577764+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? 172.21.15.78:0/1856105416' entity='client.admin' cmd='[{ 2024-09-17T08:57:45.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.577812+0000 mon.a (mon.0) 1727 : audit [INF] "prefix": "osd pool set", 2024-09-17T08:57:45.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.577847+0000 mon.a (mon.0) 1728 : audit [INF] "pool": "PoolEIOFlag_smithi078-64688-33", 2024-09-17T08:57:45.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.577876+0000 mon.a (mon.0) 1729 : audit [INF] "var": "eio", 2024-09-17T08:57:45.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.577903+0000 mon.a (mon.0) 1730 : audit [INF] "val": "true" 2024-09-17T08:57:45.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.577935+0000 mon.a (mon.0) 1731 : audit [INF] }]': finished 2024-09-17T08:57:45.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: cluster 2024-09-17T08:57:44.578095+0000 mon.a (mon.0) 1732 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-09-17T08:57:45.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:45 smithi136 bash[24812]: audit 2024-09-17T08:57:44.593125+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[22670]: cluster 2024-09-17T08:57:44.840421+0000 mgr.y (mgr.14532) 255 : cluster [DBG] pgmap v272: 299 pgs: 40 unknown, 32 creating+peering, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[22670]: audit 2024-09-17T08:57:45.052827+0000 mon.a (mon.0) 1734 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[22670]: audit 2024-09-17T08:57:45.587070+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[22670]: cluster 2024-09-17T08:57:45.587385+0000 mon.a (mon.0) 1736 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-09-17T08:57:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[22670]: audit 2024-09-17T08:57:45.589711+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-19"}]: dispatch 2024-09-17T08:57:46.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[32124]: cluster 2024-09-17T08:57:44.840421+0000 mgr.y (mgr.14532) 255 : cluster [DBG] pgmap v272: 299 pgs: 40 unknown, 32 creating+peering, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:46.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[32124]: audit 2024-09-17T08:57:45.052827+0000 mon.a (mon.0) 1734 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:46.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[32124]: audit 2024-09-17T08:57:45.587070+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:46.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[32124]: cluster 2024-09-17T08:57:45.587385+0000 mon.a (mon.0) 1736 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-09-17T08:57:46.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:46 smithi078 bash[32124]: audit 2024-09-17T08:57:45.589711+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-19"}]: dispatch 2024-09-17T08:57:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:46 smithi136 bash[24812]: cluster 2024-09-17T08:57:44.840421+0000 mgr.y (mgr.14532) 255 : cluster [DBG] pgmap v272: 299 pgs: 40 unknown, 32 creating+peering, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:46 smithi136 bash[24812]: audit 2024-09-17T08:57:45.052827+0000 mon.a (mon.0) 1734 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:46.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:46 smithi136 bash[24812]: audit 2024-09-17T08:57:45.587070+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:46.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:46 smithi136 bash[24812]: cluster 2024-09-17T08:57:45.587385+0000 mon.a (mon.0) 1736 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-09-17T08:57:46.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:46 smithi136 bash[24812]: audit 2024-09-17T08:57:45.589711+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-19"}]: dispatch 2024-09-17T08:57:47.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22670]: audit 2024-09-17T08:57:46.065657+0000 mon.a (mon.0) 1738 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:47.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22670]: audit 2024-09-17T08:57:46.592143+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-19"}]': finished 2024-09-17T08:57:47.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22670]: cluster 2024-09-17T08:57:46.592445+0000 mon.a (mon.0) 1740 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-09-17T08:57:47.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22670]: audit 2024-09-17T08:57:46.595120+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-19", "mode": "writeback"}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22670]: audit 2024-09-17T08:57:46.595674+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? 172.21.15.78:0/734726857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi078-64688-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22670]: audit 2024-09-17T08:57:46.596217+0000 mon.c (mon.2) 193 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22670]: audit 2024-09-17T08:57:46.597030+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[32124]: audit 2024-09-17T08:57:46.065657+0000 mon.a (mon.0) 1738 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[32124]: audit 2024-09-17T08:57:46.592143+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-19"}]': finished 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[32124]: cluster 2024-09-17T08:57:46.592445+0000 mon.a (mon.0) 1740 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[32124]: audit 2024-09-17T08:57:46.595120+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-19", "mode": "writeback"}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[32124]: audit 2024-09-17T08:57:46.595674+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? 172.21.15.78:0/734726857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi078-64688-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[32124]: audit 2024-09-17T08:57:46.596217+0000 mon.c (mon.2) 193 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[32124]: audit 2024-09-17T08:57:46.597030+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:47.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:47 smithi136 bash[24812]: audit 2024-09-17T08:57:46.065657+0000 mon.a (mon.0) 1738 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:47.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:47 smithi136 bash[24812]: audit 2024-09-17T08:57:46.592143+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-19"}]': finished 2024-09-17T08:57:47.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:47 smithi136 bash[24812]: cluster 2024-09-17T08:57:46.592445+0000 mon.a (mon.0) 1740 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-09-17T08:57:47.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:47 smithi136 bash[24812]: audit 2024-09-17T08:57:46.595120+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-19", "mode": "writeback"}]: dispatch 2024-09-17T08:57:47.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:47 smithi136 bash[24812]: audit 2024-09-17T08:57:46.595674+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? 172.21.15.78:0/734726857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi078-64688-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:47.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:47 smithi136 bash[24812]: audit 2024-09-17T08:57:46.596217+0000 mon.c (mon.2) 193 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:47.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:47 smithi136 bash[24812]: audit 2024-09-17T08:57:46.597030+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:48.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:57:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:57:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:57:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: cluster 2024-09-17T08:57:46.841302+0000 mgr.y (mgr.14532) 256 : cluster [DBG] pgmap v275: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: audit 2024-09-17T08:57:47.067764+0000 mon.a (mon.0) 1744 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: cluster 2024-09-17T08:57:47.586235+0000 mon.a (mon.0) 1745 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: audit 2024-09-17T08:57:47.602405+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-19", "mode": "writeback"}]': finished 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: audit 2024-09-17T08:57:47.602720+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? 172.21.15.78:0/734726857' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi078-64688-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: audit 2024-09-17T08:57:47.603440+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: cluster 2024-09-17T08:57:47.603949+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: audit 2024-09-17T08:57:47.605528+0000 mon.c (mon.2) 194 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: audit 2024-09-17T08:57:47.607395+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[22670]: audit 2024-09-17T08:57:47.672654+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: cluster 2024-09-17T08:57:46.841302+0000 mgr.y (mgr.14532) 256 : cluster [DBG] pgmap v275: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: audit 2024-09-17T08:57:47.067764+0000 mon.a (mon.0) 1744 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: cluster 2024-09-17T08:57:47.586235+0000 mon.a (mon.0) 1745 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: audit 2024-09-17T08:57:47.602405+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-19", "mode": "writeback"}]': finished 2024-09-17T08:57:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: audit 2024-09-17T08:57:47.602720+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? 172.21.15.78:0/734726857' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi078-64688-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: audit 2024-09-17T08:57:47.603440+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: cluster 2024-09-17T08:57:47.603949+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-09-17T08:57:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: audit 2024-09-17T08:57:47.605528+0000 mon.c (mon.2) 194 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: audit 2024-09-17T08:57:47.607395+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:48 smithi078 bash[32124]: audit 2024-09-17T08:57:47.672654+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:48.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: cluster 2024-09-17T08:57:46.841302+0000 mgr.y (mgr.14532) 256 : cluster [DBG] pgmap v275: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 410 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: audit 2024-09-17T08:57:47.067764+0000 mon.a (mon.0) 1744 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: cluster 2024-09-17T08:57:47.586235+0000 mon.a (mon.0) 1745 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: audit 2024-09-17T08:57:47.602405+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-19", "mode": "writeback"}]': finished 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: audit 2024-09-17T08:57:47.602720+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? 172.21.15.78:0/734726857' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi078-64688-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: audit 2024-09-17T08:57:47.603440+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: cluster 2024-09-17T08:57:47.603949+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: audit 2024-09-17T08:57:47.605528+0000 mon.c (mon.2) 194 : audit [INF] from='client.? 172.21.15.78:0/2748354663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: audit 2024-09-17T08:57:47.607395+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]: dispatch 2024-09-17T08:57:48.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:48 smithi136 bash[24812]: audit 2024-09-17T08:57:47.672654+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: audit 2024-09-17T08:57:48.069869+0000 mon.a (mon.0) 1752 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: audit 2024-09-17T08:57:48.607823+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: audit 2024-09-17T08:57:48.608026+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: cluster 2024-09-17T08:57:48.608227+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: audit 2024-09-17T08:57:48.615956+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19"}]: dispatch 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: audit 2024-09-17T08:57:48.656962+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: audit 2024-09-17T08:57:48.658096+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[32124]: audit 2024-09-17T08:57:48.658565+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi078-64680-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: audit 2024-09-17T08:57:48.069869+0000 mon.a (mon.0) 1752 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: audit 2024-09-17T08:57:48.607823+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: audit 2024-09-17T08:57:48.608026+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: cluster 2024-09-17T08:57:48.608227+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: audit 2024-09-17T08:57:48.615956+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19"}]: dispatch 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: audit 2024-09-17T08:57:48.656962+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: audit 2024-09-17T08:57:48.658096+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:49.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:49 smithi078 bash[22670]: audit 2024-09-17T08:57:48.658565+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi078-64680-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:49.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: audit 2024-09-17T08:57:48.069869+0000 mon.a (mon.0) 1752 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:49.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: audit 2024-09-17T08:57:48.607823+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi078-64680-31"}]': finished 2024-09-17T08:57:49.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: audit 2024-09-17T08:57:48.608026+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:49.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: cluster 2024-09-17T08:57:48.608227+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-09-17T08:57:49.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: audit 2024-09-17T08:57:48.615956+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19"}]: dispatch 2024-09-17T08:57:49.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: audit 2024-09-17T08:57:48.656962+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:49.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: audit 2024-09-17T08:57:48.658096+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:49.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[24812]: audit 2024-09-17T08:57:48.658565+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi078-64680-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:49.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:57:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:57:50.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: cluster 2024-09-17T08:57:48.842047+0000 mgr.y (mgr.14532) 257 : cluster [DBG] pgmap v278: 259 pgs: 259 active+clean; 585 KiB data, 415 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T08:57:50.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.097422+0000 mon.a (mon.0) 1760 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:50.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.098052+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-09-17T08:57:50.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.391529+0000 mgr.y (mgr.14532) 258 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: cluster 2024-09-17T08:57:49.597813+0000 mon.a (mon.0) 1762 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: cluster 2024-09-17T08:57:49.600005+0000 mon.a (mon.0) 1763 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.617602+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19"}]': finished 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.617828+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi078-64680-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.618084+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: cluster 2024-09-17T08:57:49.618225+0000 mon.a (mon.0) 1767 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.620586+0000 mon.c (mon.2) 195 : audit [INF] from='client.? 172.21.15.78:0/3356851964' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.621597+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[32124]: audit 2024-09-17T08:57:49.629386+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi078-64680-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: cluster 2024-09-17T08:57:48.842047+0000 mgr.y (mgr.14532) 257 : cluster [DBG] pgmap v278: 259 pgs: 259 active+clean; 585 KiB data, 415 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.097422+0000 mon.a (mon.0) 1760 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.098052+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.391529+0000 mgr.y (mgr.14532) 258 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: cluster 2024-09-17T08:57:49.597813+0000 mon.a (mon.0) 1762 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: cluster 2024-09-17T08:57:49.600005+0000 mon.a (mon.0) 1763 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.617602+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19"}]': finished 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.617828+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi078-64680-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.618084+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: cluster 2024-09-17T08:57:49.618225+0000 mon.a (mon.0) 1767 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.620586+0000 mon.c (mon.2) 195 : audit [INF] from='client.? 172.21.15.78:0/3356851964' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.621597+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:50 smithi078 bash[22670]: audit 2024-09-17T08:57:49.629386+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi078-64680-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: cluster 2024-09-17T08:57:48.842047+0000 mgr.y (mgr.14532) 257 : cluster [DBG] pgmap v278: 259 pgs: 259 active+clean; 585 KiB data, 415 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T08:57:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.097422+0000 mon.a (mon.0) 1760 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.098052+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-09-17T08:57:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.391529+0000 mgr.y (mgr.14532) 258 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:57:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: cluster 2024-09-17T08:57:49.597813+0000 mon.a (mon.0) 1762 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: cluster 2024-09-17T08:57:49.600005+0000 mon.a (mon.0) 1763 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.617602+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-19"}]': finished 2024-09-17T08:57:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.617828+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi078-64680-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.618084+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi078-64720-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-17T08:57:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: cluster 2024-09-17T08:57:49.618225+0000 mon.a (mon.0) 1767 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-09-17T08:57:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.620586+0000 mon.c (mon.2) 195 : audit [INF] from='client.? 172.21.15.78:0/3356851964' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.621597+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:50 smithi136 bash[24812]: audit 2024-09-17T08:57:49.629386+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi078-64680-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:51.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: audit 2024-09-17T08:57:50.099645+0000 mon.a (mon.0) 1770 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: audit 2024-09-17T08:57:50.100865+0000 mon.a (mon.0) 1771 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: audit 2024-09-17T08:57:50.109322+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-17T08:57:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: audit 2024-09-17T08:57:50.619716+0000 mon.a (mon.0) 1773 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: cluster 2024-09-17T08:57:50.842923+0000 mgr.y (mgr.14532) 259 : cluster [DBG] pgmap v281: 259 pgs: 32 unknown, 227 active+clean; 585 KiB data, 415 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: audit 2024-09-17T08:57:51.062069+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]': finished 2024-09-17T08:57:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: cluster 2024-09-17T08:57:51.062345+0000 mon.a (mon.0) 1775 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-09-17T08:57:51.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:51 smithi136 bash[24812]: audit 2024-09-17T08:57:51.072760+0000 mon.a (mon.0) 1776 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: audit 2024-09-17T08:57:50.099645+0000 mon.a (mon.0) 1770 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: audit 2024-09-17T08:57:50.100865+0000 mon.a (mon.0) 1771 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: audit 2024-09-17T08:57:50.109322+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-17T08:57:51.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: audit 2024-09-17T08:57:50.619716+0000 mon.a (mon.0) 1773 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:51.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: cluster 2024-09-17T08:57:50.842923+0000 mgr.y (mgr.14532) 259 : cluster [DBG] pgmap v281: 259 pgs: 32 unknown, 227 active+clean; 585 KiB data, 415 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:51.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: audit 2024-09-17T08:57:51.062069+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]': finished 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: cluster 2024-09-17T08:57:51.062345+0000 mon.a (mon.0) 1775 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[32124]: audit 2024-09-17T08:57:51.072760+0000 mon.a (mon.0) 1776 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: audit 2024-09-17T08:57:50.099645+0000 mon.a (mon.0) 1770 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: audit 2024-09-17T08:57:50.100865+0000 mon.a (mon.0) 1771 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: audit 2024-09-17T08:57:50.109322+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: audit 2024-09-17T08:57:50.619716+0000 mon.a (mon.0) 1773 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi078-64688-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: cluster 2024-09-17T08:57:50.842923+0000 mgr.y (mgr.14532) 259 : cluster [DBG] pgmap v281: 259 pgs: 32 unknown, 227 active+clean; 585 KiB data, 415 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: audit 2024-09-17T08:57:51.062069+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi078-64720-1","var":"pgp_num","val":"11"}]': finished 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: cluster 2024-09-17T08:57:51.062345+0000 mon.a (mon.0) 1775 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-09-17T08:57:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:51 smithi078 bash[22670]: audit 2024-09-17T08:57:51.072760+0000 mon.a (mon.0) 1776 : audit [DBG] from='client.? 172.21.15.78:0/3319582622' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-17T08:57:53.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:52 smithi136 bash[24812]: audit 2024-09-17T08:57:51.624271+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi078-64680-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:53.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:52 smithi136 bash[24812]: cluster 2024-09-17T08:57:51.624669+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-09-17T08:57:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:52 smithi136 bash[24812]: audit 2024-09-17T08:57:51.627853+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:52 smithi136 bash[24812]: audit 2024-09-17T08:57:51.672346+0000 mon.a (mon.0) 1780 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:52 smithi136 bash[24812]: audit 2024-09-17T08:57:52.097213+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:53.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:52 smithi136 bash[24812]: audit 2024-09-17T08:57:52.098098+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi078-64720-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[22670]: audit 2024-09-17T08:57:51.624271+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi078-64680-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[22670]: cluster 2024-09-17T08:57:51.624669+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-09-17T08:57:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[22670]: audit 2024-09-17T08:57:51.627853+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[22670]: audit 2024-09-17T08:57:51.672346+0000 mon.a (mon.0) 1780 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[22670]: audit 2024-09-17T08:57:52.097213+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[22670]: audit 2024-09-17T08:57:52.098098+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi078-64720-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[32124]: audit 2024-09-17T08:57:51.624271+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi078-64680-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[32124]: cluster 2024-09-17T08:57:51.624669+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-09-17T08:57:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[32124]: audit 2024-09-17T08:57:51.627853+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[32124]: audit 2024-09-17T08:57:51.672346+0000 mon.a (mon.0) 1780 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[32124]: audit 2024-09-17T08:57:52.097213+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:52 smithi078 bash[32124]: audit 2024-09-17T08:57:52.098098+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi078-64720-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:54.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:52.630952+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:52.631716+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi078-64720-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: cluster 2024-09-17T08:57:52.631922+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:52.634690+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi078-64720-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:52.634812+0000 mon.c (mon.2) 196 : audit [INF] from='client.? 172.21.15.78:0/2304521075' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:52.651352+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:52.683015+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: cluster 2024-09-17T08:57:52.845156+0000 mgr.y (mgr.14532) 260 : cluster [DBG] pgmap v284: 268 pgs: 32 creating+peering, 236 active+clean; 584 KiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:54.073451+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: audit 2024-09-17T08:57:54.073922+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[32124]: cluster 2024-09-17T08:57:54.074237+0000 mon.a (mon.0) 1791 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-09-17T08:57:54.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:52.630952+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:52.631716+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi078-64720-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: cluster 2024-09-17T08:57:52.631922+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:52.634690+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi078-64720-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:52.634812+0000 mon.c (mon.2) 196 : audit [INF] from='client.? 172.21.15.78:0/2304521075' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:52.651352+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:52.683015+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: cluster 2024-09-17T08:57:52.845156+0000 mgr.y (mgr.14532) 260 : cluster [DBG] pgmap v284: 268 pgs: 32 creating+peering, 236 active+clean; 584 KiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:54.073451+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: audit 2024-09-17T08:57:54.073922+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:54.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:54 smithi078 bash[22670]: cluster 2024-09-17T08:57:54.074237+0000 mon.a (mon.0) 1791 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-09-17T08:57:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:52.630952+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:52.631716+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi078-64720-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: cluster 2024-09-17T08:57:52.631922+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:52.634690+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi078-64720-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:52.634812+0000 mon.c (mon.2) 196 : audit [INF] from='client.? 172.21.15.78:0/2304521075' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:52.651352+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:52.683015+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: cluster 2024-09-17T08:57:52.845156+0000 mgr.y (mgr.14532) 260 : cluster [DBG] pgmap v284: 268 pgs: 32 creating+peering, 236 active+clean; 584 KiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:54.073451+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: audit 2024-09-17T08:57:54.073922+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:57:54.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:54 smithi136 bash[24812]: cluster 2024-09-17T08:57:54.074237+0000 mon.a (mon.0) 1791 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.076247+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-21"}]: dispatch 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.077202+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.636794+0000 mon.a (mon.0) 1794 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi078-64720-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.637019+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-21"}]': finished 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.637197+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: cluster 2024-09-17T08:57:54.637451+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.638305+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.645848+0000 mon.c (mon.2) 197 : audit [INF] from='client.? 172.21.15.78:0/1587461982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.648340+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-21", "mode": "writeback"}]: dispatch 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:54.648640+0000 mon.a (mon.0) 1800 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: cluster 2024-09-17T08:57:54.846053+0000 mgr.y (mgr.14532) 261 : cluster [DBG] pgmap v287: 300 pgs: 40 unknown, 32 creating+peering, 228 active+clean; 583 KiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:55.075283+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[32124]: audit 2024-09-17T08:57:55.077527+0000 mon.a (mon.0) 1802 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.076247+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-21"}]: dispatch 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.077202+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.636794+0000 mon.a (mon.0) 1794 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi078-64720-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.637019+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-21"}]': finished 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.637197+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: cluster 2024-09-17T08:57:54.637451+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.638305+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.645848+0000 mon.c (mon.2) 197 : audit [INF] from='client.? 172.21.15.78:0/1587461982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:55.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.648340+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-21", "mode": "writeback"}]: dispatch 2024-09-17T08:57:55.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:54.648640+0000 mon.a (mon.0) 1800 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:55.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: cluster 2024-09-17T08:57:54.846053+0000 mgr.y (mgr.14532) 261 : cluster [DBG] pgmap v287: 300 pgs: 40 unknown, 32 creating+peering, 228 active+clean; 583 KiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:57:55.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:55.075283+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:55.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:55 smithi078 bash[22670]: audit 2024-09-17T08:57:55.077527+0000 mon.a (mon.0) 1802 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.076247+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-21"}]: dispatch 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.077202+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.636794+0000 mon.a (mon.0) 1794 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi078-64720-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.637019+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-21"}]': finished 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.637197+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: cluster 2024-09-17T08:57:54.637451+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.638305+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]: dispatch 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.645848+0000 mon.c (mon.2) 197 : audit [INF] from='client.? 172.21.15.78:0/1587461982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.648340+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-21", "mode": "writeback"}]: dispatch 2024-09-17T08:57:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:54.648640+0000 mon.a (mon.0) 1800 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: cluster 2024-09-17T08:57:54.846053+0000 mgr.y (mgr.14532) 261 : cluster [DBG] pgmap v287: 300 pgs: 40 unknown, 32 creating+peering, 228 active+clean; 583 KiB data, 420 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T08:57:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:55.075283+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:57:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:55 smithi136 bash[24812]: audit 2024-09-17T08:57:55.077527+0000 mon.a (mon.0) 1802 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:57:55.750 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAiexpected=7 2024-09-17T08:57:55.750 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:566253c9:::13:head 2024-09-17T08:57:55.750 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:566253c9:::13:head expected=26:566253c9:::13:head 2024-09-17T08:57:55.750 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:566253c9:::13:head -> 13 2024-09-17T08:57:55.750 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=13 expected=13 2024-09-17T08:57:55.750 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:52ea6a34:::10:head 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:52ea6a34:::10:head expected=26:52ea6a34:::10:head 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:52ea6a34:::10:head -> 10 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=10 expected=10 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:c4fdafeb:::6:head 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:c4fdafeb:::6:head expected=26:c4fdafeb:::6:head 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:c4fdafeb:::6:head -> 6 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=6 expected=6 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:bd63b0f1:::8:head 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:bd63b0f1:::8:head expected=26:bd63b0f1:::8:head 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:bd63b0f1:::8:head -> 8 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=8 expected=8 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:b29083e3:::5:head 2024-09-17T08:57:55.751 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:b29083e3:::5:head expected=26:b29083e3:::5:head 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:b29083e3:::5:head -> 5 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=5 expected=5 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:89d3ae78:::11:head 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:89d3ae78:::11:head expected=26:89d3ae78:::11:head 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:89d3ae78:::11:head -> 11 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=11 expected=11 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:863748b0:::15:head 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:863748b0:::15:head expected=26:863748b0:::15:head 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:863748b0:::15:head -> 15 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=15 expected=15 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : seek to 26:02547ec2:::1:head 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : cursor()=26:02547ec2:::1:head expected=26:02547ec2:::1:head 2024-09-17T08:57:55.752 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: > 26:02547ec2:::1:head -> 1 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: : entry=1 expected=1 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (262 ms) 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (102571 ms) 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: split 0/5 -> MIN 26:33333333::::head 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: split 1/5 -> 26:33333333::::head 26:66666666::::head 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: split 2/5 -> 26:66666666::::head 26:99999999::::head 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: split 3/5 -> 26:99999999::::head 26:cccccccc::::head 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: split 4/5 -> 26:cccccccc::::head MAX 2024-09-17T08:57:55.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (16499 ms) 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] 7 tests from LibRadosList (119880 ms total) 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1061 ms) 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset foo1,foo2,foo3 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo1 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo2 2024-09-17T08:57:55.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo3 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset foo1,foo4,foo5 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo4 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo5 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo1 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset foo6,foo7 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo7 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: foo6 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns1:foo4 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns1:foo5 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns2:foo7 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns2:foo6 2024-09-17T08:57:55.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: ns1:foo1 2024-09-17T08:57:55.756 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: :foo1 2024-09-17T08:57:55.756 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: :foo2 2024-09-17T08:57:55.756 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: :foo3 2024-09-17T08:57:55.756 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (44 ms) 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: cluster 2024-09-17T08:57:55.629561+0000 mon.a (mon.0) 1803 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.644839+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.645178+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-21", "mode": "writeback"}]': finished 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.645327+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: cluster 2024-09-17T08:57:55.645766+0000 mon.a (mon.0) 1807 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.690198+0000 mon.c (mon.2) 198 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.690878+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.691769+0000 mon.c (mon.2) 199 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.692162+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.693014+0000 mon.c (mon.2) 200 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:56.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:56 smithi136 bash[24812]: audit 2024-09-17T08:57:55.693811+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: cluster 2024-09-17T08:57:55.629561+0000 mon.a (mon.0) 1803 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.644839+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.645178+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-21", "mode": "writeback"}]': finished 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.645327+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: cluster 2024-09-17T08:57:55.645766+0000 mon.a (mon.0) 1807 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.690198+0000 mon.c (mon.2) 198 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.690878+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.691769+0000 mon.c (mon.2) 199 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.692162+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.693014+0000 mon.c (mon.2) 200 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[22670]: audit 2024-09-17T08:57:55.693811+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: cluster 2024-09-17T08:57:55.629561+0000 mon.a (mon.0) 1803 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.644839+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? 172.21.15.78:0/2312541477' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi078-64680-32"}]': finished 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.645178+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-21", "mode": "writeback"}]': finished 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.645327+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: cluster 2024-09-17T08:57:55.645766+0000 mon.a (mon.0) 1807 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.690198+0000 mon.c (mon.2) 198 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.690878+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.691769+0000 mon.c (mon.2) 199 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.692162+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.693014+0000 mon.c (mon.2) 200 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:56.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:56 smithi078 bash[32124]: audit 2024-09-17T08:57:55.693811+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:57:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.153839+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.650755+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.651535+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: cluster 2024-09-17T08:57:56.651715+0000 mon.a (mon.0) 1814 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.656309+0000 mon.c (mon.2) 201 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.659142+0000 mon.a (mon.0) 1815 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.660972+0000 mon.a (mon.0) 1816 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21"}]: dispatch 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.661744+0000 mon.a (mon.0) 1817 : audit [INF] from='client.? 172.21.15.78:0/1960773443' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: audit 2024-09-17T08:57:56.663245+0000 mon.a (mon.0) 1818 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:57 smithi136 bash[24812]: cluster 2024-09-17T08:57:56.846994+0000 mgr.y (mgr.14532) 262 : cluster [DBG] pgmap v290: 324 pgs: 64 unknown, 32 creating+peering, 228 active+clean; 583 KiB data, 420 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:57.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.153839+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:57.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.650755+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:57.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.651535+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:57.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: cluster 2024-09-17T08:57:56.651715+0000 mon.a (mon.0) 1814 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-09-17T08:57:57.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.656309+0000 mon.c (mon.2) 201 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.659142+0000 mon.a (mon.0) 1815 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.660972+0000 mon.a (mon.0) 1816 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21"}]: dispatch 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.661744+0000 mon.a (mon.0) 1817 : audit [INF] from='client.? 172.21.15.78:0/1960773443' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: audit 2024-09-17T08:57:56.663245+0000 mon.a (mon.0) 1818 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[32124]: cluster 2024-09-17T08:57:56.846994+0000 mgr.y (mgr.14532) 262 : cluster [DBG] pgmap v290: 324 pgs: 64 unknown, 32 creating+peering, 228 active+clean; 583 KiB data, 420 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.153839+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.650755+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi078-64680-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.651535+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: cluster 2024-09-17T08:57:56.651715+0000 mon.a (mon.0) 1814 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-09-17T08:57:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.656309+0000 mon.c (mon.2) 201 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.659142+0000 mon.a (mon.0) 1815 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:57:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.660972+0000 mon.a (mon.0) 1816 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21"}]: dispatch 2024-09-17T08:57:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.661744+0000 mon.a (mon.0) 1817 : audit [INF] from='client.? 172.21.15.78:0/1960773443' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:57:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: audit 2024-09-17T08:57:56.663245+0000 mon.a (mon.0) 1818 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22670]: cluster 2024-09-17T08:57:56.846994+0000 mgr.y (mgr.14532) 262 : cluster [DBG] pgmap v290: 324 pgs: 64 unknown, 32 creating+peering, 228 active+clean; 583 KiB data, 420 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:57:58.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:57:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:57:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:57:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[32124]: cluster 2024-09-17T08:57:57.526758+0000 mon.a (mon.0) 1819 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[32124]: cluster 2024-09-17T08:57:57.644619+0000 mon.a (mon.0) 1820 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[32124]: audit 2024-09-17T08:57:58.104979+0000 mon.a (mon.0) 1821 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21"}]': finished 2024-09-17T08:57:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[32124]: audit 2024-09-17T08:57:58.105050+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.78:0/1960773443' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[32124]: audit 2024-09-17T08:57:58.105213+0000 mon.a (mon.0) 1823 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:57:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[32124]: cluster 2024-09-17T08:57:58.105422+0000 mon.a (mon.0) 1824 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-09-17T08:57:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[32124]: audit 2024-09-17T08:57:58.106475+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[22670]: cluster 2024-09-17T08:57:57.526758+0000 mon.a (mon.0) 1819 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[22670]: cluster 2024-09-17T08:57:57.644619+0000 mon.a (mon.0) 1820 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[22670]: audit 2024-09-17T08:57:58.104979+0000 mon.a (mon.0) 1821 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21"}]': finished 2024-09-17T08:57:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[22670]: audit 2024-09-17T08:57:58.105050+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.78:0/1960773443' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[22670]: audit 2024-09-17T08:57:58.105213+0000 mon.a (mon.0) 1823 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:57:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[22670]: cluster 2024-09-17T08:57:58.105422+0000 mon.a (mon.0) 1824 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-09-17T08:57:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:58 smithi078 bash[22670]: audit 2024-09-17T08:57:58.106475+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:58.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:58 smithi136 bash[24812]: cluster 2024-09-17T08:57:57.526758+0000 mon.a (mon.0) 1819 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:57:58.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:58 smithi136 bash[24812]: cluster 2024-09-17T08:57:57.644619+0000 mon.a (mon.0) 1820 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:57:58.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:58 smithi136 bash[24812]: audit 2024-09-17T08:57:58.104979+0000 mon.a (mon.0) 1821 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-21"}]': finished 2024-09-17T08:57:58.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:58 smithi136 bash[24812]: audit 2024-09-17T08:57:58.105050+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.78:0/1960773443' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi078-64688-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:57:58.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:58 smithi136 bash[24812]: audit 2024-09-17T08:57:58.105213+0000 mon.a (mon.0) 1823 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:57:58.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:58 smithi136 bash[24812]: cluster 2024-09-17T08:57:58.105422+0000 mon.a (mon.0) 1824 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-09-17T08:57:58.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:58 smithi136 bash[24812]: audit 2024-09-17T08:57:58.106475+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]: dispatch 2024-09-17T08:57:59.658 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:57:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:58:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:59 smithi136 bash[24812]: audit 2024-09-17T08:57:58.664241+0000 mon.a (mon.0) 1826 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:59 smithi136 bash[24812]: audit 2024-09-17T08:57:58.664518+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:58:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:59 smithi136 bash[24812]: cluster 2024-09-17T08:57:58.664773+0000 mon.a (mon.0) 1828 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-09-17T08:58:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:57:59 smithi136 bash[24812]: cluster 2024-09-17T08:57:58.847818+0000 mgr.y (mgr.14532) 263 : cluster [DBG] pgmap v293: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 424 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[22670]: audit 2024-09-17T08:57:58.664241+0000 mon.a (mon.0) 1826 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[22670]: audit 2024-09-17T08:57:58.664518+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:58:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[22670]: cluster 2024-09-17T08:57:58.664773+0000 mon.a (mon.0) 1828 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-09-17T08:58:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[22670]: cluster 2024-09-17T08:57:58.847818+0000 mgr.y (mgr.14532) 263 : cluster [DBG] pgmap v293: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 424 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[32124]: audit 2024-09-17T08:57:58.664241+0000 mon.a (mon.0) 1826 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi078-64680-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[32124]: audit 2024-09-17T08:57:58.664518+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? 172.21.15.78:0/3858083457' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi078-64720-2"}]': finished 2024-09-17T08:58:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[32124]: cluster 2024-09-17T08:57:58.664773+0000 mon.a (mon.0) 1828 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-09-17T08:58:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:57:59 smithi078 bash[32124]: cluster 2024-09-17T08:57:58.847818+0000 mgr.y (mgr.14532) 263 : cluster [DBG] pgmap v293: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 424 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:01.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:00 smithi136 bash[24812]: audit 2024-09-17T08:57:59.402815+0000 mgr.y (mgr.14532) 264 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:01.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:00 smithi136 bash[24812]: cluster 2024-09-17T08:57:59.682128+0000 mon.a (mon.0) 1829 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-09-17T08:58:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:00 smithi136 bash[24812]: audit 2024-09-17T08:57:59.691582+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:00 smithi136 bash[24812]: audit 2024-09-17T08:57:59.693911+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.78:0/58495237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:00 smithi136 bash[24812]: audit 2024-09-17T08:57:59.696717+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[32124]: audit 2024-09-17T08:57:59.402815+0000 mgr.y (mgr.14532) 264 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[32124]: cluster 2024-09-17T08:57:59.682128+0000 mon.a (mon.0) 1829 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[32124]: audit 2024-09-17T08:57:59.691582+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[32124]: audit 2024-09-17T08:57:59.693911+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.78:0/58495237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[32124]: audit 2024-09-17T08:57:59.696717+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[22670]: audit 2024-09-17T08:57:59.402815+0000 mgr.y (mgr.14532) 264 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[22670]: cluster 2024-09-17T08:57:59.682128+0000 mon.a (mon.0) 1829 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-09-17T08:58:01.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[22670]: audit 2024-09-17T08:57:59.691582+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[22670]: audit 2024-09-17T08:57:59.693911+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.78:0/58495237' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:00 smithi078 bash[22670]: audit 2024-09-17T08:57:59.696717+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:01.727 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 1 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 10 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 13 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 7 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 14 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 0 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 15 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 11 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 5 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 8 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 6 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 3 0 2024-09-17T08:58:01.728 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 4 0 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 12 0 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 9 0 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 2 0 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (58 ms) 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] 3 tests from LibRadosListEC (1163 ms total) 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2602 ms) 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] 1 test from LibRadosListNP (2602 ms total) 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: 2024-09-17T08:58:01.729 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [----------] Global test environment tear-down 2024-09-17T08:58:01.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [==========] 11 tests from 3 test suites ran. (142034 ms total) 2024-09-17T08:58:01.730 INFO:tasks.workunit.client.0.smithi078.stdout: api_list: [ PASSED ] 11 tests. 2024-09-17T08:58:02.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: audit 2024-09-17T08:58:00.682574+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: audit 2024-09-17T08:58:00.682882+0000 mon.a (mon.0) 1833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: cluster 2024-09-17T08:58:00.683417+0000 mon.a (mon.0) 1834 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-09-17T08:58:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: audit 2024-09-17T08:58:00.692772+0000 mon.c (mon.2) 203 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: audit 2024-09-17T08:58:00.707704+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: audit 2024-09-17T08:58:00.756002+0000 mon.c (mon.2) 204 : audit [INF] from='client.? 172.21.15.78:0/58495237' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-17T08:58:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: cluster 2024-09-17T08:58:00.848558+0000 mgr.y (mgr.14532) 265 : cluster [DBG] pgmap v296: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 424 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:02.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:01 smithi136 bash[24812]: audit 2024-09-17T08:58:01.184634+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-17T08:58:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: audit 2024-09-17T08:58:00.682574+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: audit 2024-09-17T08:58:00.682882+0000 mon.a (mon.0) 1833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: cluster 2024-09-17T08:58:00.683417+0000 mon.a (mon.0) 1834 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-09-17T08:58:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: audit 2024-09-17T08:58:00.692772+0000 mon.c (mon.2) 203 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: audit 2024-09-17T08:58:00.707704+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: audit 2024-09-17T08:58:00.756002+0000 mon.c (mon.2) 204 : audit [INF] from='client.? 172.21.15.78:0/58495237' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: cluster 2024-09-17T08:58:00.848558+0000 mgr.y (mgr.14532) 265 : cluster [DBG] pgmap v296: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 424 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[22670]: audit 2024-09-17T08:58:01.184634+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: audit 2024-09-17T08:58:00.682574+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: audit 2024-09-17T08:58:00.682882+0000 mon.a (mon.0) 1833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64720-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: cluster 2024-09-17T08:58:00.683417+0000 mon.a (mon.0) 1834 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: audit 2024-09-17T08:58:00.692772+0000 mon.c (mon.2) 203 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: audit 2024-09-17T08:58:00.707704+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: audit 2024-09-17T08:58:00.756002+0000 mon.c (mon.2) 204 : audit [INF] from='client.? 172.21.15.78:0/58495237' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-17T08:58:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: cluster 2024-09-17T08:58:00.848558+0000 mgr.y (mgr.14532) 265 : cluster [DBG] pgmap v296: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 424 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:02.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:01 smithi078 bash[32124]: audit 2024-09-17T08:58:01.184634+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-17T08:58:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: audit 2024-09-17T08:58:01.715276+0000 mon.a (mon.0) 1837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: audit 2024-09-17T08:58:01.715673+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-17T08:58:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: cluster 2024-09-17T08:58:01.715902+0000 mon.a (mon.0) 1839 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-09-17T08:58:03.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: audit 2024-09-17T08:58:01.717265+0000 mon.c (mon.2) 205 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:03.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: audit 2024-09-17T08:58:01.721299+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:03.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: audit 2024-09-17T08:58:01.722972+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? 172.21.15.78:0/2139174362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:03.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: audit 2024-09-17T08:58:01.764900+0000 mon.a (mon.0) 1842 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:03.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:02 smithi136 bash[24812]: cluster 2024-09-17T08:58:02.528053+0000 mon.a (mon.0) 1843 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: audit 2024-09-17T08:58:01.715276+0000 mon.a (mon.0) 1837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: audit 2024-09-17T08:58:01.715673+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-17T08:58:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: cluster 2024-09-17T08:58:01.715902+0000 mon.a (mon.0) 1839 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-09-17T08:58:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: audit 2024-09-17T08:58:01.717265+0000 mon.c (mon.2) 205 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: audit 2024-09-17T08:58:01.721299+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: audit 2024-09-17T08:58:01.722972+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? 172.21.15.78:0/2139174362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:03.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: audit 2024-09-17T08:58:01.764900+0000 mon.a (mon.0) 1842 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[32124]: cluster 2024-09-17T08:58:02.528053+0000 mon.a (mon.0) 1843 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: audit 2024-09-17T08:58:01.715276+0000 mon.a (mon.0) 1837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: audit 2024-09-17T08:58:01.715673+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi078-64720-3","pool2":"test-rados-api-smithi078-64720-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: cluster 2024-09-17T08:58:01.715902+0000 mon.a (mon.0) 1839 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: audit 2024-09-17T08:58:01.717265+0000 mon.c (mon.2) 205 : audit [INF] from='client.? 172.21.15.78:0/1818657458' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: audit 2024-09-17T08:58:01.721299+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]: dispatch 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: audit 2024-09-17T08:58:01.722972+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? 172.21.15.78:0/2139174362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: audit 2024-09-17T08:58:01.764900+0000 mon.a (mon.0) 1842 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:03.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:02 smithi078 bash[22670]: cluster 2024-09-17T08:58:02.528053+0000 mon.a (mon.0) 1843 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.718193+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.718410+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? 172.21.15.78:0/2139174362' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.719085+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: cluster 2024-09-17T08:58:02.719260+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.723277+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-23"}]: dispatch 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.767423+0000 mon.c (mon.2) 206 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.767951+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.768742+0000 mon.c (mon.2) 207 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.769005+0000 mon.a (mon.0) 1850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.769575+0000 mon.c (mon.2) 208 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:04.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: audit 2024-09-17T08:58:02.769930+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:04.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:03 smithi136 bash[24812]: cluster 2024-09-17T08:58:02.849562+0000 mgr.y (mgr.14532) 266 : cluster [DBG] pgmap v299: 260 pgs: 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.718193+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.718410+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? 172.21.15.78:0/2139174362' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.719085+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: cluster 2024-09-17T08:58:02.719260+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.723277+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-23"}]: dispatch 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.767423+0000 mon.c (mon.2) 206 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.767951+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.768742+0000 mon.c (mon.2) 207 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.769005+0000 mon.a (mon.0) 1850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.769575+0000 mon.c (mon.2) 208 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: audit 2024-09-17T08:58:02.769930+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[22670]: cluster 2024-09-17T08:58:02.849562+0000 mgr.y (mgr.14532) 266 : cluster [DBG] pgmap v299: 260 pgs: 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.718193+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi078-64680-33"}]': finished 2024-09-17T08:58:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.718410+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? 172.21.15.78:0/2139174362' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.719085+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: cluster 2024-09-17T08:58:02.719260+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.723277+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-23"}]: dispatch 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.767423+0000 mon.c (mon.2) 206 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.767951+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.768742+0000 mon.c (mon.2) 207 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.769005+0000 mon.a (mon.0) 1850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.769575+0000 mon.c (mon.2) 208 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: audit 2024-09-17T08:58:02.769930+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:04.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:03 smithi078 bash[32124]: cluster 2024-09-17T08:58:02.849562+0000 mgr.y (mgr.14532) 266 : cluster [DBG] pgmap v299: 260 pgs: 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:05.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: audit 2024-09-17T08:58:03.722627+0000 mon.a (mon.0) 1852 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-23"}]': finished 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: audit 2024-09-17T08:58:03.722867+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: cluster 2024-09-17T08:58:03.723143+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: audit 2024-09-17T08:58:03.724754+0000 mon.c (mon.2) 209 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: audit 2024-09-17T08:58:03.726992+0000 mon.a (mon.0) 1855 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-23", "mode": "writeback"}]: dispatch 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: audit 2024-09-17T08:58:03.727596+0000 mon.a (mon.0) 1856 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: audit 2024-09-17T08:58:03.738203+0000 mon.c (mon.2) 210 : audit [INF] from='client.? 172.21.15.78:0/1400166184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: audit 2024-09-17T08:58:03.748419+0000 mon.a (mon.0) 1857 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:05 smithi136 bash[24812]: cluster 2024-09-17T08:58:04.714677+0000 mon.a (mon.0) 1858 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: audit 2024-09-17T08:58:03.722627+0000 mon.a (mon.0) 1852 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-23"}]': finished 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: audit 2024-09-17T08:58:03.722867+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: cluster 2024-09-17T08:58:03.723143+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: audit 2024-09-17T08:58:03.724754+0000 mon.c (mon.2) 209 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: audit 2024-09-17T08:58:03.726992+0000 mon.a (mon.0) 1855 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-23", "mode": "writeback"}]: dispatch 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: audit 2024-09-17T08:58:03.727596+0000 mon.a (mon.0) 1856 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: audit 2024-09-17T08:58:03.738203+0000 mon.c (mon.2) 210 : audit [INF] from='client.? 172.21.15.78:0/1400166184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: audit 2024-09-17T08:58:03.748419+0000 mon.a (mon.0) 1857 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[22670]: cluster 2024-09-17T08:58:04.714677+0000 mon.a (mon.0) 1858 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: audit 2024-09-17T08:58:03.722627+0000 mon.a (mon.0) 1852 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-23"}]': finished 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: audit 2024-09-17T08:58:03.722867+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi078-64680-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: cluster 2024-09-17T08:58:03.723143+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: audit 2024-09-17T08:58:03.724754+0000 mon.c (mon.2) 209 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: audit 2024-09-17T08:58:03.726992+0000 mon.a (mon.0) 1855 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-23", "mode": "writeback"}]: dispatch 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: audit 2024-09-17T08:58:03.727596+0000 mon.a (mon.0) 1856 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: audit 2024-09-17T08:58:03.738203+0000 mon.c (mon.2) 210 : audit [INF] from='client.? 172.21.15.78:0/1400166184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: audit 2024-09-17T08:58:03.748419+0000 mon.a (mon.0) 1857 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:05 smithi078 bash[32124]: cluster 2024-09-17T08:58:04.714677+0000 mon.a (mon.0) 1858 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: audit 2024-09-17T08:58:04.727758+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-23", "mode": "writeback"}]': finished 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: cluster 2024-09-17T08:58:04.850291+0000 mgr.y (mgr.14532) 267 : cluster [DBG] pgmap v302: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: audit 2024-09-17T08:58:05.173493+0000 mon.a (mon.0) 1860 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: cluster 2024-09-17T08:58:05.173841+0000 mon.a (mon.0) 1861 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: audit 2024-09-17T08:58:05.733967+0000 mon.a (mon.0) 1862 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: cluster 2024-09-17T08:58:05.734282+0000 mon.a (mon.0) 1863 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: audit 2024-09-17T08:58:05.744316+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.78:0/2274168265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:06 smithi136 bash[24812]: audit 2024-09-17T08:58:05.798142+0000 mon.a (mon.0) 1865 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: audit 2024-09-17T08:58:04.727758+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-23", "mode": "writeback"}]': finished 2024-09-17T08:58:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: cluster 2024-09-17T08:58:04.850291+0000 mgr.y (mgr.14532) 267 : cluster [DBG] pgmap v302: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-17T08:58:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: audit 2024-09-17T08:58:05.173493+0000 mon.a (mon.0) 1860 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: cluster 2024-09-17T08:58:05.173841+0000 mon.a (mon.0) 1861 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-09-17T08:58:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: audit 2024-09-17T08:58:05.733967+0000 mon.a (mon.0) 1862 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: cluster 2024-09-17T08:58:05.734282+0000 mon.a (mon.0) 1863 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-09-17T08:58:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: audit 2024-09-17T08:58:05.744316+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.78:0/2274168265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[22670]: audit 2024-09-17T08:58:05.798142+0000 mon.a (mon.0) 1865 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:06.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: audit 2024-09-17T08:58:04.727758+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-23", "mode": "writeback"}]': finished 2024-09-17T08:58:06.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: cluster 2024-09-17T08:58:04.850291+0000 mgr.y (mgr.14532) 267 : cluster [DBG] pgmap v302: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-17T08:58:06.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: audit 2024-09-17T08:58:05.173493+0000 mon.a (mon.0) 1860 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:06.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: cluster 2024-09-17T08:58:05.173841+0000 mon.a (mon.0) 1861 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-09-17T08:58:06.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: audit 2024-09-17T08:58:05.733967+0000 mon.a (mon.0) 1862 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi078-64680-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:06.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: cluster 2024-09-17T08:58:05.734282+0000 mon.a (mon.0) 1863 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-09-17T08:58:06.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: audit 2024-09-17T08:58:05.744316+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.78:0/2274168265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:06.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:06 smithi078 bash[32124]: audit 2024-09-17T08:58:05.798142+0000 mon.a (mon.0) 1865 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:07 smithi136 bash[24812]: audit 2024-09-17T08:58:06.739111+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.78:0/2274168265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:07 smithi136 bash[24812]: audit 2024-09-17T08:58:06.740339+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:07 smithi136 bash[24812]: cluster 2024-09-17T08:58:06.740498+0000 mon.a (mon.0) 1868 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-09-17T08:58:08.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:07 smithi136 bash[24812]: audit 2024-09-17T08:58:06.744027+0000 mon.a (mon.0) 1869 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23"}]: dispatch 2024-09-17T08:58:08.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:07 smithi136 bash[24812]: cluster 2024-09-17T08:58:06.851043+0000 mgr.y (mgr.14532) 268 : cluster [DBG] pgmap v305: 332 pgs: 72 unknown, 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:08.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:58:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:58:08.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[32124]: audit 2024-09-17T08:58:06.739111+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.78:0/2274168265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:08.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[32124]: audit 2024-09-17T08:58:06.740339+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:08.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[32124]: cluster 2024-09-17T08:58:06.740498+0000 mon.a (mon.0) 1868 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-09-17T08:58:08.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[32124]: audit 2024-09-17T08:58:06.744027+0000 mon.a (mon.0) 1869 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23"}]: dispatch 2024-09-17T08:58:08.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[32124]: cluster 2024-09-17T08:58:06.851043+0000 mgr.y (mgr.14532) 268 : cluster [DBG] pgmap v305: 332 pgs: 72 unknown, 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:08.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[22670]: audit 2024-09-17T08:58:06.739111+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.78:0/2274168265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:08.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[22670]: audit 2024-09-17T08:58:06.740339+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:08.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[22670]: cluster 2024-09-17T08:58:06.740498+0000 mon.a (mon.0) 1868 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-09-17T08:58:08.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[22670]: audit 2024-09-17T08:58:06.744027+0000 mon.a (mon.0) 1869 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23"}]: dispatch 2024-09-17T08:58:08.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:07 smithi078 bash[22670]: cluster 2024-09-17T08:58:06.851043+0000 mgr.y (mgr.14532) 268 : cluster [DBG] pgmap v305: 332 pgs: 72 unknown, 260 active+clean; 584 KiB data, 413 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:09.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:58:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[24812]: cluster 2024-09-17T08:58:07.730728+0000 mon.a (mon.0) 1870 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[24812]: cluster 2024-09-17T08:58:07.732607+0000 mon.a (mon.0) 1871 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[24812]: audit 2024-09-17T08:58:07.756154+0000 mon.a (mon.0) 1872 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23"}]': finished 2024-09-17T08:58:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[24812]: cluster 2024-09-17T08:58:07.756482+0000 mon.a (mon.0) 1873 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-09-17T08:58:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[24812]: audit 2024-09-17T08:58:07.764443+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.78:0/3154683337' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[24812]: audit 2024-09-17T08:58:07.764755+0000 mon.c (mon.2) 211 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:09 smithi136 bash[24812]: audit 2024-09-17T08:58:07.771492+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[32124]: cluster 2024-09-17T08:58:07.730728+0000 mon.a (mon.0) 1870 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[32124]: cluster 2024-09-17T08:58:07.732607+0000 mon.a (mon.0) 1871 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[32124]: audit 2024-09-17T08:58:07.756154+0000 mon.a (mon.0) 1872 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23"}]': finished 2024-09-17T08:58:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[32124]: cluster 2024-09-17T08:58:07.756482+0000 mon.a (mon.0) 1873 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-09-17T08:58:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[32124]: audit 2024-09-17T08:58:07.764443+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.78:0/3154683337' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[32124]: audit 2024-09-17T08:58:07.764755+0000 mon.c (mon.2) 211 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[32124]: audit 2024-09-17T08:58:07.771492+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[22670]: cluster 2024-09-17T08:58:07.730728+0000 mon.a (mon.0) 1870 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[22670]: cluster 2024-09-17T08:58:07.732607+0000 mon.a (mon.0) 1871 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[22670]: audit 2024-09-17T08:58:07.756154+0000 mon.a (mon.0) 1872 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-23"}]': finished 2024-09-17T08:58:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[22670]: cluster 2024-09-17T08:58:07.756482+0000 mon.a (mon.0) 1873 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-09-17T08:58:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[22670]: audit 2024-09-17T08:58:07.764443+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.78:0/3154683337' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[22670]: audit 2024-09-17T08:58:07.764755+0000 mon.c (mon.2) 211 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:09 smithi078 bash[22670]: audit 2024-09-17T08:58:07.771492+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:08.753536+0000 mon.a (mon.0) 1876 : audit [INF] from='client.? 172.21.15.78:0/3154683337' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:08.754738+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: cluster 2024-09-17T08:58:08.755644+0000 mon.a (mon.0) 1878 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-09-17T08:58:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:08.756285+0000 mon.c (mon.2) 212 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:08.757457+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: cluster 2024-09-17T08:58:08.851490+0000 mgr.y (mgr.14532) 269 : cluster [DBG] pgmap v308: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:58:10.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.410428+0000 mgr.y (mgr.14532) 270 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.765853+0000 mon.a (mon.0) 1880 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: cluster 2024-09-17T08:58:09.766151+0000 mon.a (mon.0) 1881 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.777169+0000 mon.c (mon.2) 213 : audit [INF] from='client.? 172.21.15.78:0/4219364284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.781853+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.782248+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.809459+0000 mon.c (mon.2) 214 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.809785+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.810496+0000 mon.c (mon.2) 215 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.810811+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.811278+0000 mon.c (mon.2) 216 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:09.811549+0000 mon.a (mon.0) 1886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:10 smithi136 bash[24812]: audit 2024-09-17T08:58:10.111566+0000 mon.a (mon.0) 1887 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:08.753536+0000 mon.a (mon.0) 1876 : audit [INF] from='client.? 172.21.15.78:0/3154683337' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:08.754738+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: cluster 2024-09-17T08:58:08.755644+0000 mon.a (mon.0) 1878 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:08.756285+0000 mon.c (mon.2) 212 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:08.757457+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: cluster 2024-09-17T08:58:08.851490+0000 mgr.y (mgr.14532) 269 : cluster [DBG] pgmap v308: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.410428+0000 mgr.y (mgr.14532) 270 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.765853+0000 mon.a (mon.0) 1880 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: cluster 2024-09-17T08:58:09.766151+0000 mon.a (mon.0) 1881 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.777169+0000 mon.c (mon.2) 213 : audit [INF] from='client.? 172.21.15.78:0/4219364284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.781853+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.782248+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.809459+0000 mon.c (mon.2) 214 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.809785+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.810496+0000 mon.c (mon.2) 215 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.810811+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:08.753536+0000 mon.a (mon.0) 1876 : audit [INF] from='client.? 172.21.15.78:0/3154683337' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:08.754738+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: cluster 2024-09-17T08:58:08.755644+0000 mon.a (mon.0) 1878 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:08.756285+0000 mon.c (mon.2) 212 : audit [INF] from='client.? 172.21.15.78:0/2198167020' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:08.757457+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]: dispatch 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: cluster 2024-09-17T08:58:08.851490+0000 mgr.y (mgr.14532) 269 : cluster [DBG] pgmap v308: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:58:10.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.410428+0000 mgr.y (mgr.14532) 270 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.765853+0000 mon.a (mon.0) 1880 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi078-64680-34"}]': finished 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: cluster 2024-09-17T08:58:09.766151+0000 mon.a (mon.0) 1881 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.777169+0000 mon.c (mon.2) 213 : audit [INF] from='client.? 172.21.15.78:0/4219364284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.781853+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.782248+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.809459+0000 mon.c (mon.2) 214 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.809785+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.810496+0000 mon.c (mon.2) 215 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.810811+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:10.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.811278+0000 mon.c (mon.2) 216 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:10.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:09.811549+0000 mon.a (mon.0) 1886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:10.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[32124]: audit 2024-09-17T08:58:10.111566+0000 mon.a (mon.0) 1887 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:10.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.811278+0000 mon.c (mon.2) 216 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:10.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:09.811549+0000 mon.a (mon.0) 1886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:10.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:10 smithi078 bash[22670]: audit 2024-09-17T08:58:10.111566+0000 mon.a (mon.0) 1887 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:12.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:11 smithi136 bash[24812]: audit 2024-09-17T08:58:10.770753+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:12.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:11 smithi136 bash[24812]: audit 2024-09-17T08:58:10.771488+0000 mon.a (mon.0) 1889 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:12.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:11 smithi136 bash[24812]: audit 2024-09-17T08:58:10.771858+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:12.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:11 smithi136 bash[24812]: cluster 2024-09-17T08:58:10.772216+0000 mon.a (mon.0) 1891 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-09-17T08:58:12.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:11 smithi136 bash[24812]: audit 2024-09-17T08:58:10.783628+0000 mon.c (mon.2) 217 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:12.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:11 smithi136 bash[24812]: audit 2024-09-17T08:58:10.784366+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:12.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:11 smithi136 bash[24812]: cluster 2024-09-17T08:58:10.852015+0000 mgr.y (mgr.14532) 271 : cluster [DBG] pgmap v311: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 584 KiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:58:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[22670]: audit 2024-09-17T08:58:10.770753+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[22670]: audit 2024-09-17T08:58:10.771488+0000 mon.a (mon.0) 1889 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[22670]: audit 2024-09-17T08:58:10.771858+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[22670]: cluster 2024-09-17T08:58:10.772216+0000 mon.a (mon.0) 1891 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-09-17T08:58:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[22670]: audit 2024-09-17T08:58:10.783628+0000 mon.c (mon.2) 217 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[22670]: audit 2024-09-17T08:58:10.784366+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:12.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[22670]: cluster 2024-09-17T08:58:10.852015+0000 mgr.y (mgr.14532) 271 : cluster [DBG] pgmap v311: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 584 KiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:58:12.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[32124]: audit 2024-09-17T08:58:10.770753+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi078-64688-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:12.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[32124]: audit 2024-09-17T08:58:10.771488+0000 mon.a (mon.0) 1889 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:12.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[32124]: audit 2024-09-17T08:58:10.771858+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi078-64680-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:12.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[32124]: cluster 2024-09-17T08:58:10.772216+0000 mon.a (mon.0) 1891 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-09-17T08:58:12.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[32124]: audit 2024-09-17T08:58:10.783628+0000 mon.c (mon.2) 217 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:12.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[32124]: audit 2024-09-17T08:58:10.784366+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:12.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:11 smithi078 bash[32124]: cluster 2024-09-17T08:58:10.852015+0000 mgr.y (mgr.14532) 271 : cluster [DBG] pgmap v311: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 584 KiB data, 414 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:58:13.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:12 smithi136 bash[24812]: cluster 2024-09-17T08:58:12.231689+0000 mon.a (mon.0) 1893 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-09-17T08:58:13.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:12 smithi136 bash[24812]: audit 2024-09-17T08:58:12.235732+0000 mon.a (mon.0) 1894 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:12 smithi136 bash[24812]: audit 2024-09-17T08:58:12.544935+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:12 smithi136 bash[24812]: audit 2024-09-17T08:58:12.545317+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:12 smithi136 bash[24812]: cluster 2024-09-17T08:58:12.545502+0000 mon.a (mon.0) 1897 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-09-17T08:58:13.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:12 smithi136 bash[24812]: audit 2024-09-17T08:58:12.546752+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-25"}]: dispatch 2024-09-17T08:58:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[22670]: cluster 2024-09-17T08:58:12.231689+0000 mon.a (mon.0) 1893 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-09-17T08:58:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[22670]: audit 2024-09-17T08:58:12.235732+0000 mon.a (mon.0) 1894 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[22670]: audit 2024-09-17T08:58:12.544935+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[22670]: audit 2024-09-17T08:58:12.545317+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[22670]: cluster 2024-09-17T08:58:12.545502+0000 mon.a (mon.0) 1897 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-09-17T08:58:13.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[22670]: audit 2024-09-17T08:58:12.546752+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-25"}]: dispatch 2024-09-17T08:58:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[32124]: cluster 2024-09-17T08:58:12.231689+0000 mon.a (mon.0) 1893 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-09-17T08:58:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[32124]: audit 2024-09-17T08:58:12.235732+0000 mon.a (mon.0) 1894 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[32124]: audit 2024-09-17T08:58:12.544935+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi078-64680-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[32124]: audit 2024-09-17T08:58:12.545317+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[32124]: cluster 2024-09-17T08:58:12.545502+0000 mon.a (mon.0) 1897 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-09-17T08:58:13.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:12 smithi078 bash[32124]: audit 2024-09-17T08:58:12.546752+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-25"}]: dispatch 2024-09-17T08:58:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:13 smithi136 bash[24812]: cluster 2024-09-17T08:58:12.854720+0000 mgr.y (mgr.14532) 272 : cluster [DBG] pgmap v314: 332 pgs: 5 creating+peering, 3 unknown, 324 active+clean; 584 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:13 smithi136 bash[24812]: audit 2024-09-17T08:58:13.549463+0000 mon.a (mon.0) 1899 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-25"}]': finished 2024-09-17T08:58:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:13 smithi136 bash[24812]: cluster 2024-09-17T08:58:13.550447+0000 mon.a (mon.0) 1900 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-09-17T08:58:14.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:13 smithi136 bash[24812]: audit 2024-09-17T08:58:13.555595+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-25", "mode": "writeback"}]: dispatch 2024-09-17T08:58:14.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[22670]: cluster 2024-09-17T08:58:12.854720+0000 mgr.y (mgr.14532) 272 : cluster [DBG] pgmap v314: 332 pgs: 5 creating+peering, 3 unknown, 324 active+clean; 584 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:14.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[22670]: audit 2024-09-17T08:58:13.549463+0000 mon.a (mon.0) 1899 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-25"}]': finished 2024-09-17T08:58:14.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[22670]: cluster 2024-09-17T08:58:13.550447+0000 mon.a (mon.0) 1900 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-09-17T08:58:14.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[22670]: audit 2024-09-17T08:58:13.555595+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-25", "mode": "writeback"}]: dispatch 2024-09-17T08:58:14.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[32124]: cluster 2024-09-17T08:58:12.854720+0000 mgr.y (mgr.14532) 272 : cluster [DBG] pgmap v314: 332 pgs: 5 creating+peering, 3 unknown, 324 active+clean; 584 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[32124]: audit 2024-09-17T08:58:13.549463+0000 mon.a (mon.0) 1899 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-25"}]': finished 2024-09-17T08:58:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[32124]: cluster 2024-09-17T08:58:13.550447+0000 mon.a (mon.0) 1900 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-09-17T08:58:14.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:13 smithi078 bash[32124]: audit 2024-09-17T08:58:13.555595+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-25", "mode": "writeback"}]: dispatch 2024-09-17T08:58:15.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:14 smithi136 bash[24812]: cluster 2024-09-17T08:58:13.777176+0000 mon.a (mon.0) 1902 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:15.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:14 smithi136 bash[24812]: cluster 2024-09-17T08:58:14.538908+0000 mon.a (mon.0) 1903 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:14 smithi136 bash[24812]: audit 2024-09-17T08:58:14.549589+0000 mon.a (mon.0) 1904 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-25", "mode": "writeback"}]': finished 2024-09-17T08:58:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:14 smithi136 bash[24812]: cluster 2024-09-17T08:58:14.549857+0000 mon.a (mon.0) 1905 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-09-17T08:58:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:14 smithi136 bash[24812]: audit 2024-09-17T08:58:14.552607+0000 mon.c (mon.2) 218 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:14 smithi136 bash[24812]: audit 2024-09-17T08:58:14.555047+0000 mon.a (mon.0) 1906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:14 smithi136 bash[24812]: audit 2024-09-17T08:58:14.637140+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:15.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[22670]: cluster 2024-09-17T08:58:13.777176+0000 mon.a (mon.0) 1902 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:15.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[22670]: cluster 2024-09-17T08:58:14.538908+0000 mon.a (mon.0) 1903 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:15.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[22670]: audit 2024-09-17T08:58:14.549589+0000 mon.a (mon.0) 1904 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-25", "mode": "writeback"}]': finished 2024-09-17T08:58:15.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[22670]: cluster 2024-09-17T08:58:14.549857+0000 mon.a (mon.0) 1905 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-09-17T08:58:15.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[22670]: audit 2024-09-17T08:58:14.552607+0000 mon.c (mon.2) 218 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:15.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[22670]: audit 2024-09-17T08:58:14.555047+0000 mon.a (mon.0) 1906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:15.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[22670]: audit 2024-09-17T08:58:14.637140+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:15.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[32124]: cluster 2024-09-17T08:58:13.777176+0000 mon.a (mon.0) 1902 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:15.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[32124]: cluster 2024-09-17T08:58:14.538908+0000 mon.a (mon.0) 1903 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:15.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[32124]: audit 2024-09-17T08:58:14.549589+0000 mon.a (mon.0) 1904 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-25", "mode": "writeback"}]': finished 2024-09-17T08:58:15.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[32124]: cluster 2024-09-17T08:58:14.549857+0000 mon.a (mon.0) 1905 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-09-17T08:58:15.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[32124]: audit 2024-09-17T08:58:14.552607+0000 mon.c (mon.2) 218 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:15.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[32124]: audit 2024-09-17T08:58:14.555047+0000 mon.a (mon.0) 1906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:15.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:14 smithi078 bash[32124]: audit 2024-09-17T08:58:14.637140+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:16 smithi136 bash[24812]: cluster 2024-09-17T08:58:14.855629+0000 mgr.y (mgr.14532) 273 : cluster [DBG] pgmap v317: 260 pgs: 260 active+clean; 584 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:16 smithi136 bash[24812]: audit 2024-09-17T08:58:15.553378+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:16 smithi136 bash[24812]: audit 2024-09-17T08:58:15.554012+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:16 smithi136 bash[24812]: cluster 2024-09-17T08:58:15.554175+0000 mon.a (mon.0) 1910 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-09-17T08:58:16.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:16 smithi136 bash[24812]: audit 2024-09-17T08:58:15.556013+0000 mon.a (mon.0) 1911 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25"}]: dispatch 2024-09-17T08:58:16.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:16 smithi136 bash[24812]: audit 2024-09-17T08:58:15.562991+0000 mon.c (mon.2) 219 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:16.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:16 smithi136 bash[24812]: audit 2024-09-17T08:58:15.563906+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[22670]: cluster 2024-09-17T08:58:14.855629+0000 mgr.y (mgr.14532) 273 : cluster [DBG] pgmap v317: 260 pgs: 260 active+clean; 584 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[22670]: audit 2024-09-17T08:58:15.553378+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[22670]: audit 2024-09-17T08:58:15.554012+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[22670]: cluster 2024-09-17T08:58:15.554175+0000 mon.a (mon.0) 1910 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[22670]: audit 2024-09-17T08:58:15.556013+0000 mon.a (mon.0) 1911 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25"}]: dispatch 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[22670]: audit 2024-09-17T08:58:15.562991+0000 mon.c (mon.2) 219 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[22670]: audit 2024-09-17T08:58:15.563906+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[32124]: cluster 2024-09-17T08:58:14.855629+0000 mgr.y (mgr.14532) 273 : cluster [DBG] pgmap v317: 260 pgs: 260 active+clean; 584 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[32124]: audit 2024-09-17T08:58:15.553378+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[32124]: audit 2024-09-17T08:58:15.554012+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[32124]: cluster 2024-09-17T08:58:15.554175+0000 mon.a (mon.0) 1910 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[32124]: audit 2024-09-17T08:58:15.556013+0000 mon.a (mon.0) 1911 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25"}]: dispatch 2024-09-17T08:58:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[32124]: audit 2024-09-17T08:58:15.562991+0000 mon.c (mon.2) 219 : audit [INF] from='client.? 172.21.15.78:0/1448530835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:16.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:16 smithi078 bash[32124]: audit 2024-09-17T08:58:15.563906+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]: dispatch 2024-09-17T08:58:17.035 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: cluster 2024-09-17T08:58:16.545780+0000 mon.a (mon.0) 1913 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:17.035 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: audit 2024-09-17T08:58:16.558249+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25"}]': finished 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: audit 2024-09-17T08:58:16.558462+0000 mon.a (mon.0) 1915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: cluster 2024-09-17T08:58:16.558700+0000 mon.a (mon.0) 1916 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: audit 2024-09-17T08:58:16.564162+0000 mon.c (mon.2) 220 : audit [INF] from='client.? 172.21.15.78:0/1492011587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: audit 2024-09-17T08:58:16.566735+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: audit 2024-09-17T08:58:16.592508+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: audit 2024-09-17T08:58:16.593678+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22670]: audit 2024-09-17T08:58:16.594165+0000 mon.a (mon.0) 1920 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi078-64680-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:17.036 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: cluster 2024-09-17T08:58:16.545780+0000 mon.a (mon.0) 1913 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: audit 2024-09-17T08:58:16.558249+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25"}]': finished 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: audit 2024-09-17T08:58:16.558462+0000 mon.a (mon.0) 1915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: cluster 2024-09-17T08:58:16.558700+0000 mon.a (mon.0) 1916 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: audit 2024-09-17T08:58:16.564162+0000 mon.c (mon.2) 220 : audit [INF] from='client.? 172.21.15.78:0/1492011587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: audit 2024-09-17T08:58:16.566735+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: audit 2024-09-17T08:58:16.592508+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: audit 2024-09-17T08:58:16.593678+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:17.037 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[32124]: audit 2024-09-17T08:58:16.594165+0000 mon.a (mon.0) 1920 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi078-64680-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: cluster 2024-09-17T08:58:16.545780+0000 mon.a (mon.0) 1913 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: audit 2024-09-17T08:58:16.558249+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-25"}]': finished 2024-09-17T08:58:17.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: audit 2024-09-17T08:58:16.558462+0000 mon.a (mon.0) 1915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi078-64680-35"}]': finished 2024-09-17T08:58:17.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: cluster 2024-09-17T08:58:16.558700+0000 mon.a (mon.0) 1916 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-09-17T08:58:17.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: audit 2024-09-17T08:58:16.564162+0000 mon.c (mon.2) 220 : audit [INF] from='client.? 172.21.15.78:0/1492011587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:17.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: audit 2024-09-17T08:58:16.566735+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:17.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: audit 2024-09-17T08:58:16.592508+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:17.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: audit 2024-09-17T08:58:16.593678+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:17.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:17 smithi136 bash[24812]: audit 2024-09-17T08:58:16.594165+0000 mon.a (mon.0) 1920 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi078-64680-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:18 smithi136 bash[24812]: cluster 2024-09-17T08:58:16.856611+0000 mgr.y (mgr.14532) 274 : cluster [DBG] pgmap v320: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 454 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:18 smithi136 bash[24812]: audit 2024-09-17T08:58:17.566480+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:18.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:18 smithi136 bash[24812]: audit 2024-09-17T08:58:17.567026+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi078-64680-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:18.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:18 smithi136 bash[24812]: cluster 2024-09-17T08:58:17.567297+0000 mon.a (mon.0) 1923 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-09-17T08:58:18.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:18 smithi136 bash[24812]: audit 2024-09-17T08:58:17.570640+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi078-64680-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:18.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:58:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:58:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:58:18.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[32124]: cluster 2024-09-17T08:58:16.856611+0000 mgr.y (mgr.14532) 274 : cluster [DBG] pgmap v320: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 454 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[32124]: audit 2024-09-17T08:58:17.566480+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[32124]: audit 2024-09-17T08:58:17.567026+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi078-64680-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[32124]: cluster 2024-09-17T08:58:17.567297+0000 mon.a (mon.0) 1923 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-09-17T08:58:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[32124]: audit 2024-09-17T08:58:17.570640+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi078-64680-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:18.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[22670]: cluster 2024-09-17T08:58:16.856611+0000 mgr.y (mgr.14532) 274 : cluster [DBG] pgmap v320: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 454 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:18.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[22670]: audit 2024-09-17T08:58:17.566480+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi078-64688-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[22670]: audit 2024-09-17T08:58:17.567026+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi078-64680-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[22670]: cluster 2024-09-17T08:58:17.567297+0000 mon.a (mon.0) 1923 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-09-17T08:58:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:18 smithi078 bash[22670]: audit 2024-09-17T08:58:17.570640+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi078-64680-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:19.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:58:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:58:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:19 smithi136 bash[24812]: cluster 2024-09-17T08:58:18.857418+0000 mgr.y (mgr.14532) 275 : cluster [DBG] pgmap v323: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:19 smithi136 bash[24812]: cluster 2024-09-17T08:58:19.017515+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-09-17T08:58:19.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:19 smithi136 bash[24812]: audit 2024-09-17T08:58:19.025330+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:19 smithi078 bash[32124]: cluster 2024-09-17T08:58:18.857418+0000 mgr.y (mgr.14532) 275 : cluster [DBG] pgmap v323: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:19 smithi078 bash[32124]: cluster 2024-09-17T08:58:19.017515+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-09-17T08:58:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:19 smithi078 bash[32124]: audit 2024-09-17T08:58:19.025330+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:19 smithi078 bash[22670]: cluster 2024-09-17T08:58:18.857418+0000 mgr.y (mgr.14532) 275 : cluster [DBG] pgmap v323: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:19 smithi078 bash[22670]: cluster 2024-09-17T08:58:19.017515+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-09-17T08:58:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:19 smithi078 bash[22670]: audit 2024-09-17T08:58:19.025330+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:20 smithi136 bash[24812]: audit 2024-09-17T08:58:19.421756+0000 mgr.y (mgr.14532) 276 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:20 smithi136 bash[24812]: audit 2024-09-17T08:58:19.585685+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi078-64680-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:20 smithi136 bash[24812]: audit 2024-09-17T08:58:19.586274+0000 mon.a (mon.0) 1928 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:21.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:20 smithi136 bash[24812]: cluster 2024-09-17T08:58:19.586697+0000 mon.a (mon.0) 1929 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-09-17T08:58:21.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:20 smithi136 bash[24812]: audit 2024-09-17T08:58:19.596567+0000 mon.c (mon.2) 221 : audit [INF] from='client.? 172.21.15.78:0/3592851245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:21.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:20 smithi136 bash[24812]: audit 2024-09-17T08:58:19.598730+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:21.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[22670]: audit 2024-09-17T08:58:19.421756+0000 mgr.y (mgr.14532) 276 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:21.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[22670]: audit 2024-09-17T08:58:19.585685+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi078-64680-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:21.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[22670]: audit 2024-09-17T08:58:19.586274+0000 mon.a (mon.0) 1928 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:21.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[22670]: cluster 2024-09-17T08:58:19.586697+0000 mon.a (mon.0) 1929 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-09-17T08:58:21.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[22670]: audit 2024-09-17T08:58:19.596567+0000 mon.c (mon.2) 221 : audit [INF] from='client.? 172.21.15.78:0/3592851245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:21.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[22670]: audit 2024-09-17T08:58:19.598730+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:21.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[32124]: audit 2024-09-17T08:58:19.421756+0000 mgr.y (mgr.14532) 276 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:21.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[32124]: audit 2024-09-17T08:58:19.585685+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi078-64680-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:21.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[32124]: audit 2024-09-17T08:58:19.586274+0000 mon.a (mon.0) 1928 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:21.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[32124]: cluster 2024-09-17T08:58:19.586697+0000 mon.a (mon.0) 1929 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-09-17T08:58:21.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[32124]: audit 2024-09-17T08:58:19.596567+0000 mon.c (mon.2) 221 : audit [INF] from='client.? 172.21.15.78:0/3592851245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:21.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:20 smithi078 bash[32124]: audit 2024-09-17T08:58:19.598730+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: audit 2024-09-17T08:58:20.591149+0000 mon.a (mon.0) 1931 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: cluster 2024-09-17T08:58:20.591557+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-09-17T08:58:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: audit 2024-09-17T08:58:20.655295+0000 mon.a (mon.0) 1933 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:22.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: audit 2024-09-17T08:58:20.708307+0000 mon.a (mon.0) 1934 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:58:22.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: cluster 2024-09-17T08:58:20.858035+0000 mgr.y (mgr.14532) 277 : cluster [DBG] pgmap v326: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:22.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: audit 2024-09-17T08:58:21.248732+0000 mon.a (mon.0) 1935 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:58:22.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: audit 2024-09-17T08:58:21.249931+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:58:22.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:21 smithi136 bash[24812]: audit 2024-09-17T08:58:21.257029+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:22.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: audit 2024-09-17T08:58:20.591149+0000 mon.a (mon.0) 1931 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: cluster 2024-09-17T08:58:20.591557+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-09-17T08:58:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: audit 2024-09-17T08:58:20.655295+0000 mon.a (mon.0) 1933 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: audit 2024-09-17T08:58:20.708307+0000 mon.a (mon.0) 1934 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:58:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: cluster 2024-09-17T08:58:20.858035+0000 mgr.y (mgr.14532) 277 : cluster [DBG] pgmap v326: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: audit 2024-09-17T08:58:21.248732+0000 mon.a (mon.0) 1935 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:58:22.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: audit 2024-09-17T08:58:21.249931+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:58:22.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[32124]: audit 2024-09-17T08:58:21.257029+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:22.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: audit 2024-09-17T08:58:20.591149+0000 mon.a (mon.0) 1931 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi078-64688-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:22.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: cluster 2024-09-17T08:58:20.591557+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-09-17T08:58:22.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: audit 2024-09-17T08:58:20.655295+0000 mon.a (mon.0) 1933 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:22.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: audit 2024-09-17T08:58:20.708307+0000 mon.a (mon.0) 1934 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:58:22.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: cluster 2024-09-17T08:58:20.858035+0000 mgr.y (mgr.14532) 277 : cluster [DBG] pgmap v326: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:22.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: audit 2024-09-17T08:58:21.248732+0000 mon.a (mon.0) 1935 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:58:22.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: audit 2024-09-17T08:58:21.249931+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:58:22.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:21 smithi078 bash[22670]: audit 2024-09-17T08:58:21.257029+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:23.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.630082+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: cluster 2024-09-17T08:58:21.630330+0000 mon.a (mon.0) 1939 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.634842+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-27"}]: dispatch 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.635457+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.662807+0000 mon.c (mon.2) 222 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.663458+0000 mon.a (mon.0) 1942 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.664292+0000 mon.c (mon.2) 223 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.664634+0000 mon.a (mon.0) 1943 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.665117+0000 mon.c (mon.2) 224 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:23.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:22 smithi136 bash[24812]: audit 2024-09-17T08:58:21.665400+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:23.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.630082+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:23.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: cluster 2024-09-17T08:58:21.630330+0000 mon.a (mon.0) 1939 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-09-17T08:58:23.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.634842+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-27"}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.635457+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.662807+0000 mon.c (mon.2) 222 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.663458+0000 mon.a (mon.0) 1942 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.664292+0000 mon.c (mon.2) 223 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.664634+0000 mon.a (mon.0) 1943 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.665117+0000 mon.c (mon.2) 224 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[22670]: audit 2024-09-17T08:58:21.665400+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.630082+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:23.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: cluster 2024-09-17T08:58:21.630330+0000 mon.a (mon.0) 1939 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.634842+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-27"}]: dispatch 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.635457+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.662807+0000 mon.c (mon.2) 222 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.663458+0000 mon.a (mon.0) 1942 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.664292+0000 mon.c (mon.2) 223 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.664634+0000 mon.a (mon.0) 1943 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.665117+0000 mon.c (mon.2) 224 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:23.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:22 smithi078 bash[32124]: audit 2024-09-17T08:58:21.665400+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: audit 2024-09-17T08:58:22.634034+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-27"}]': finished 2024-09-17T08:58:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: audit 2024-09-17T08:58:22.634261+0000 mon.a (mon.0) 1946 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: audit 2024-09-17T08:58:22.634472+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: cluster 2024-09-17T08:58:22.634716+0000 mon.a (mon.0) 1948 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-09-17T08:58:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: audit 2024-09-17T08:58:22.637992+0000 mon.a (mon.0) 1949 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-27", "mode": "writeback"}]: dispatch 2024-09-17T08:58:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: audit 2024-09-17T08:58:22.638317+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: audit 2024-09-17T08:58:22.639691+0000 mon.c (mon.2) 225 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: audit 2024-09-17T08:58:22.649587+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: cluster 2024-09-17T08:58:22.860048+0000 mgr.y (mgr.14532) 278 : cluster [DBG] pgmap v329: 228 pgs: 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[32124]: cluster 2024-09-17T08:58:23.626072+0000 mon.a (mon.0) 1952 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: audit 2024-09-17T08:58:22.634034+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-27"}]': finished 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: audit 2024-09-17T08:58:22.634261+0000 mon.a (mon.0) 1946 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: audit 2024-09-17T08:58:22.634472+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: cluster 2024-09-17T08:58:22.634716+0000 mon.a (mon.0) 1948 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: audit 2024-09-17T08:58:22.637992+0000 mon.a (mon.0) 1949 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-27", "mode": "writeback"}]: dispatch 2024-09-17T08:58:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: audit 2024-09-17T08:58:22.638317+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:24.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: audit 2024-09-17T08:58:22.639691+0000 mon.c (mon.2) 225 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:24.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: audit 2024-09-17T08:58:22.649587+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:24.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: cluster 2024-09-17T08:58:22.860048+0000 mgr.y (mgr.14532) 278 : cluster [DBG] pgmap v329: 228 pgs: 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:24.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:24 smithi078 bash[22670]: cluster 2024-09-17T08:58:23.626072+0000 mon.a (mon.0) 1952 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: audit 2024-09-17T08:58:22.634034+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-27"}]': finished 2024-09-17T08:58:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: audit 2024-09-17T08:58:22.634261+0000 mon.a (mon.0) 1946 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: audit 2024-09-17T08:58:22.634472+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: cluster 2024-09-17T08:58:22.634716+0000 mon.a (mon.0) 1948 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: audit 2024-09-17T08:58:22.637992+0000 mon.a (mon.0) 1949 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-27", "mode": "writeback"}]: dispatch 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: audit 2024-09-17T08:58:22.638317+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]: dispatch 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: audit 2024-09-17T08:58:22.639691+0000 mon.c (mon.2) 225 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: audit 2024-09-17T08:58:22.649587+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: cluster 2024-09-17T08:58:22.860048+0000 mgr.y (mgr.14532) 278 : cluster [DBG] pgmap v329: 228 pgs: 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:24 smithi136 bash[24812]: cluster 2024-09-17T08:58:23.626072+0000 mon.a (mon.0) 1952 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:25.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:23.638393+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-27", "mode": "writeback"}]': finished 2024-09-17T08:58:25.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:23.638612+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: cluster 2024-09-17T08:58:24.077235+0000 mon.a (mon.0) 1955 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: cluster 2024-09-17T08:58:24.077666+0000 mon.a (mon.0) 1956 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.111825+0000 mon.c (mon.2) 226 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.112099+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.112812+0000 mon.c (mon.2) 227 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.113133+0000 mon.a (mon.0) 1958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.113549+0000 mon.c (mon.2) 228 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.113813+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.641508+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.642002+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: cluster 2024-09-17T08:58:24.643336+0000 mon.a (mon.0) 1962 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.649535+0000 mon.c (mon.2) 229 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:23.638393+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-27", "mode": "writeback"}]': finished 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:23.638612+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: cluster 2024-09-17T08:58:24.077235+0000 mon.a (mon.0) 1955 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: cluster 2024-09-17T08:58:24.077666+0000 mon.a (mon.0) 1956 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.111825+0000 mon.c (mon.2) 226 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.112099+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.112812+0000 mon.c (mon.2) 227 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.113133+0000 mon.a (mon.0) 1958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.113549+0000 mon.c (mon.2) 228 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.113813+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.641508+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.642002+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: cluster 2024-09-17T08:58:24.643336+0000 mon.a (mon.0) 1962 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.649535+0000 mon.c (mon.2) 229 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.652455+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: audit 2024-09-17T08:58:24.692622+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:25.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[32124]: cluster 2024-09-17T08:58:24.861041+0000 mgr.y (mgr.14532) 279 : cluster [DBG] pgmap v332: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:25.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.652455+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: audit 2024-09-17T08:58:24.692622+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:25.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:25 smithi078 bash[22670]: cluster 2024-09-17T08:58:24.861041+0000 mgr.y (mgr.14532) 279 : cluster [DBG] pgmap v332: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:23.638393+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-27", "mode": "writeback"}]': finished 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:23.638612+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? 172.21.15.78:0/3627087393' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi078-64680-36"}]': finished 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: cluster 2024-09-17T08:58:24.077235+0000 mon.a (mon.0) 1955 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: cluster 2024-09-17T08:58:24.077666+0000 mon.a (mon.0) 1956 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.111825+0000 mon.c (mon.2) 226 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.112099+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.112812+0000 mon.c (mon.2) 227 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.113133+0000 mon.a (mon.0) 1958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.113549+0000 mon.c (mon.2) 228 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.113813+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.641508+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.642002+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: cluster 2024-09-17T08:58:24.643336+0000 mon.a (mon.0) 1962 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.649535+0000 mon.c (mon.2) 229 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.652455+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: audit 2024-09-17T08:58:24.692622+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:25.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:25 smithi136 bash[24812]: cluster 2024-09-17T08:58:24.861041+0000 mgr.y (mgr.14532) 279 : cluster [DBG] pgmap v332: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:58:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:26 smithi136 bash[24812]: audit 2024-09-17T08:58:25.151338+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:26 smithi136 bash[24812]: audit 2024-09-17T08:58:25.153903+0000 mon.a (mon.0) 1966 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:26 smithi136 bash[24812]: audit 2024-09-17T08:58:26.091609+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:26 smithi136 bash[24812]: cluster 2024-09-17T08:58:26.091714+0000 mon.a (mon.0) 1968 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-09-17T08:58:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:26 smithi136 bash[24812]: audit 2024-09-17T08:58:26.093915+0000 mon.a (mon.0) 1969 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27"}]: dispatch 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[32124]: audit 2024-09-17T08:58:25.151338+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[32124]: audit 2024-09-17T08:58:25.153903+0000 mon.a (mon.0) 1966 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[32124]: audit 2024-09-17T08:58:26.091609+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[32124]: cluster 2024-09-17T08:58:26.091714+0000 mon.a (mon.0) 1968 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[32124]: audit 2024-09-17T08:58:26.093915+0000 mon.a (mon.0) 1969 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27"}]: dispatch 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[22670]: audit 2024-09-17T08:58:25.151338+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[22670]: audit 2024-09-17T08:58:25.153903+0000 mon.a (mon.0) 1966 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[22670]: audit 2024-09-17T08:58:26.091609+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[22670]: cluster 2024-09-17T08:58:26.091714+0000 mon.a (mon.0) 1968 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-09-17T08:58:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:26 smithi078 bash[22670]: audit 2024-09-17T08:58:26.093915+0000 mon.a (mon.0) 1969 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27"}]: dispatch 2024-09-17T08:58:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:27 smithi136 bash[24812]: cluster 2024-09-17T08:58:26.645034+0000 mon.a (mon.0) 1970 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:27 smithi136 bash[24812]: audit 2024-09-17T08:58:26.655787+0000 mon.a (mon.0) 1971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:27 smithi136 bash[24812]: audit 2024-09-17T08:58:26.656428+0000 mon.a (mon.0) 1972 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27"}]': finished 2024-09-17T08:58:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:27 smithi136 bash[24812]: cluster 2024-09-17T08:58:26.656758+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2024-09-17T08:58:27.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:27 smithi136 bash[24812]: audit 2024-09-17T08:58:26.665001+0000 mon.c (mon.2) 230 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:27.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:27 smithi136 bash[24812]: audit 2024-09-17T08:58:26.665599+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:27.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:27 smithi136 bash[24812]: cluster 2024-09-17T08:58:26.861891+0000 mgr.y (mgr.14532) 280 : cluster [DBG] pgmap v335: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22670]: cluster 2024-09-17T08:58:26.645034+0000 mon.a (mon.0) 1970 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22670]: audit 2024-09-17T08:58:26.655787+0000 mon.a (mon.0) 1971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22670]: audit 2024-09-17T08:58:26.656428+0000 mon.a (mon.0) 1972 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27"}]': finished 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22670]: cluster 2024-09-17T08:58:26.656758+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22670]: audit 2024-09-17T08:58:26.665001+0000 mon.c (mon.2) 230 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22670]: audit 2024-09-17T08:58:26.665599+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22670]: cluster 2024-09-17T08:58:26.861891+0000 mgr.y (mgr.14532) 280 : cluster [DBG] pgmap v335: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:27.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[32124]: cluster 2024-09-17T08:58:26.645034+0000 mon.a (mon.0) 1970 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[32124]: audit 2024-09-17T08:58:26.655787+0000 mon.a (mon.0) 1971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi078-64680-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[32124]: audit 2024-09-17T08:58:26.656428+0000 mon.a (mon.0) 1972 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-27"}]': finished 2024-09-17T08:58:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[32124]: cluster 2024-09-17T08:58:26.656758+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2024-09-17T08:58:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[32124]: audit 2024-09-17T08:58:26.665001+0000 mon.c (mon.2) 230 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[32124]: audit 2024-09-17T08:58:26.665599+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[32124]: cluster 2024-09-17T08:58:26.861891+0000 mgr.y (mgr.14532) 280 : cluster [DBG] pgmap v335: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 453 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:28.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:58:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:58:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:58:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:28 smithi136 bash[24812]: audit 2024-09-17T08:58:27.666370+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:28 smithi136 bash[24812]: cluster 2024-09-17T08:58:27.666706+0000 mon.a (mon.0) 1976 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2024-09-17T08:58:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:28 smithi136 bash[24812]: audit 2024-09-17T08:58:27.668692+0000 mon.c (mon.2) 231 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:28 smithi136 bash[24812]: audit 2024-09-17T08:58:27.670097+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[22670]: audit 2024-09-17T08:58:27.666370+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[22670]: cluster 2024-09-17T08:58:27.666706+0000 mon.a (mon.0) 1976 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[22670]: audit 2024-09-17T08:58:27.668692+0000 mon.c (mon.2) 231 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[22670]: audit 2024-09-17T08:58:27.670097+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[32124]: audit 2024-09-17T08:58:27.666370+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[32124]: cluster 2024-09-17T08:58:27.666706+0000 mon.a (mon.0) 1976 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[32124]: audit 2024-09-17T08:58:27.668692+0000 mon.c (mon.2) 231 : audit [INF] from='client.? 172.21.15.78:0/244220322' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:29.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:28 smithi078 bash[32124]: audit 2024-09-17T08:58:27.670097+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]: dispatch 2024-09-17T08:58:29.709 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.673895+0000 mon.a (mon.0) 1978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: cluster 2024-09-17T08:58:28.674202+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.679079+0000 mon.c (mon.2) 232 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.697696+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.699698+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.716913+0000 mon.c (mon.2) 233 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.717263+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.717942+0000 mon.c (mon.2) 234 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.718237+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.718771+0000 mon.c (mon.2) 235 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:28.719081+0000 mon.a (mon.0) 1984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: cluster 2024-09-17T08:58:28.862781+0000 mgr.y (mgr.14532) 281 : cluster [DBG] pgmap v338: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:29.676764+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:29.677620+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:29.677864+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: cluster 2024-09-17T08:58:29.678065+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:29.679490+0000 mon.c (mon.2) 236 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:29.680107+0000 mon.c (mon.2) 237 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:29.687085+0000 mon.a (mon.0) 1989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:29 smithi136 bash[24812]: audit 2024-09-17T08:58:29.688563+0000 mon.a (mon.0) 1990 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.673895+0000 mon.a (mon.0) 1978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:30.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: cluster 2024-09-17T08:58:28.674202+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2024-09-17T08:58:30.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.679079+0000 mon.c (mon.2) 232 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.697696+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.699698+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.716913+0000 mon.c (mon.2) 233 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.717263+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.717942+0000 mon.c (mon.2) 234 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.718237+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.718771+0000 mon.c (mon.2) 235 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:28.719081+0000 mon.a (mon.0) 1984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: cluster 2024-09-17T08:58:28.862781+0000 mgr.y (mgr.14532) 281 : cluster [DBG] pgmap v338: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:29.676764+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:30.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:29.677620+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.673895+0000 mon.a (mon.0) 1978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-46"}]': finished 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: cluster 2024-09-17T08:58:28.674202+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.679079+0000 mon.c (mon.2) 232 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.697696+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.699698+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.716913+0000 mon.c (mon.2) 233 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.717263+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.717942+0000 mon.c (mon.2) 234 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.718237+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.718771+0000 mon.c (mon.2) 235 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:28.719081+0000 mon.a (mon.0) 1984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:30.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: cluster 2024-09-17T08:58:28.862781+0000 mgr.y (mgr.14532) 281 : cluster [DBG] pgmap v338: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:29.676764+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:29.677620+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:29.677864+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: cluster 2024-09-17T08:58:29.678065+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:29.679490+0000 mon.c (mon.2) 236 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:29.680107+0000 mon.c (mon.2) 237 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:29.687085+0000 mon.a (mon.0) 1989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[22670]: audit 2024-09-17T08:58:29.688563+0000 mon.a (mon.0) 1990 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:29.677864+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi078-64688-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:30.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: cluster 2024-09-17T08:58:29.678065+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2024-09-17T08:58:30.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:29.679490+0000 mon.c (mon.2) 236 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:29.680107+0000 mon.c (mon.2) 237 : audit [INF] from='client.? 172.21.15.78:0/2207112118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:30.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:29.687085+0000 mon.a (mon.0) 1989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:30.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:29 smithi078 bash[32124]: audit 2024-09-17T08:58:29.688563+0000 mon.a (mon.0) 1990 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]: dispatch 2024-09-17T08:58:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:31 smithi136 bash[24812]: audit 2024-09-17T08:58:29.433187+0000 mgr.y (mgr.14532) 282 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:31 smithi078 bash[22670]: audit 2024-09-17T08:58:29.433187+0000 mgr.y (mgr.14532) 282 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:31 smithi078 bash[32124]: audit 2024-09-17T08:58:29.433187+0000 mgr.y (mgr.14532) 282 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: cluster 2024-09-17T08:58:30.863552+0000 mgr.y (mgr.14532) 283 : cluster [DBG] pgmap v341: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.124875+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: cluster 2024-09-17T08:58:31.125108+0000 mon.a (mon.0) 1992 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.167478+0000 mon.c (mon.2) 238 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.167784+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.168546+0000 mon.c (mon.2) 239 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.168836+0000 mon.a (mon.0) 1994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.169309+0000 mon.c (mon.2) 240 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.169594+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: cluster 2024-09-17T08:58:31.670326+0000 mon.a (mon.0) 1996 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:32.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.687219+0000 mon.a (mon.0) 1997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:32.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.687611+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:32.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: cluster 2024-09-17T08:58:31.687820+0000 mon.a (mon.0) 1999 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2024-09-17T08:58:32.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.697493+0000 mon.c (mon.2) 241 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.698494+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:32 smithi136 bash[24812]: audit 2024-09-17T08:58:31.702953+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: cluster 2024-09-17T08:58:30.863552+0000 mgr.y (mgr.14532) 283 : cluster [DBG] pgmap v341: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.124875+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: cluster 2024-09-17T08:58:31.125108+0000 mon.a (mon.0) 1992 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2024-09-17T08:58:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.167478+0000 mon.c (mon.2) 238 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.167784+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.168546+0000 mon.c (mon.2) 239 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.168836+0000 mon.a (mon.0) 1994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.169309+0000 mon.c (mon.2) 240 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.169594+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: cluster 2024-09-17T08:58:31.670326+0000 mon.a (mon.0) 1996 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.687219+0000 mon.a (mon.0) 1997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.687611+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: cluster 2024-09-17T08:58:31.687820+0000 mon.a (mon.0) 1999 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.697493+0000 mon.c (mon.2) 241 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.698494+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[22670]: audit 2024-09-17T08:58:31.702953+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: cluster 2024-09-17T08:58:30.863552+0000 mgr.y (mgr.14532) 283 : cluster [DBG] pgmap v341: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.124875+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi078-64680-37"}]': finished 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: cluster 2024-09-17T08:58:31.125108+0000 mon.a (mon.0) 1992 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.167478+0000 mon.c (mon.2) 238 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.167784+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.168546+0000 mon.c (mon.2) 239 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.168836+0000 mon.a (mon.0) 1994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.169309+0000 mon.c (mon.2) 240 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.169594+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: cluster 2024-09-17T08:58:31.670326+0000 mon.a (mon.0) 1996 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.687219+0000 mon.a (mon.0) 1997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi078-64688-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.687611+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi078-64680-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:32.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: cluster 2024-09-17T08:58:31.687820+0000 mon.a (mon.0) 1999 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2024-09-17T08:58:32.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.697493+0000 mon.c (mon.2) 241 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.698494+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:32.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:32 smithi078 bash[32124]: audit 2024-09-17T08:58:31.702953+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:33.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[32124]: cluster 2024-09-17T08:58:32.865482+0000 mgr.y (mgr.14532) 284 : cluster [DBG] pgmap v344: 236 pgs: 4 creating+activating, 2 creating+peering, 230 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-17T08:58:33.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[32124]: audit 2024-09-17T08:58:32.985146+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:33.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[32124]: cluster 2024-09-17T08:58:32.985514+0000 mon.a (mon.0) 2003 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2024-09-17T08:58:33.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[32124]: audit 2024-09-17T08:58:32.989641+0000 mon.a (mon.0) 2004 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-29"}]: dispatch 2024-09-17T08:58:33.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[22670]: cluster 2024-09-17T08:58:32.865482+0000 mgr.y (mgr.14532) 284 : cluster [DBG] pgmap v344: 236 pgs: 4 creating+activating, 2 creating+peering, 230 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-17T08:58:33.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[22670]: audit 2024-09-17T08:58:32.985146+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[22670]: cluster 2024-09-17T08:58:32.985514+0000 mon.a (mon.0) 2003 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2024-09-17T08:58:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:33 smithi078 bash[22670]: audit 2024-09-17T08:58:32.989641+0000 mon.a (mon.0) 2004 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-29"}]: dispatch 2024-09-17T08:58:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:33 smithi136 bash[24812]: cluster 2024-09-17T08:58:32.865482+0000 mgr.y (mgr.14532) 284 : cluster [DBG] pgmap v344: 236 pgs: 4 creating+activating, 2 creating+peering, 230 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-17T08:58:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:33 smithi136 bash[24812]: audit 2024-09-17T08:58:32.985146+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:33 smithi136 bash[24812]: cluster 2024-09-17T08:58:32.985514+0000 mon.a (mon.0) 2003 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2024-09-17T08:58:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:33 smithi136 bash[24812]: audit 2024-09-17T08:58:32.989641+0000 mon.a (mon.0) 2004 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-29"}]: dispatch 2024-09-17T08:58:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[32124]: audit 2024-09-17T08:58:33.565653+0000 mon.a (mon.0) 2005 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[32124]: audit 2024-09-17T08:58:33.565907+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-29"}]': finished 2024-09-17T08:58:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[32124]: cluster 2024-09-17T08:58:33.566113+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2024-09-17T08:58:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[32124]: audit 2024-09-17T08:58:33.567406+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-29", "mode": "writeback"}]: dispatch 2024-09-17T08:58:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[32124]: audit 2024-09-17T08:58:33.577125+0000 mon.c (mon.2) 242 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[32124]: audit 2024-09-17T08:58:33.577809+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[22670]: audit 2024-09-17T08:58:33.565653+0000 mon.a (mon.0) 2005 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[22670]: audit 2024-09-17T08:58:33.565907+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-29"}]': finished 2024-09-17T08:58:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[22670]: cluster 2024-09-17T08:58:33.566113+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2024-09-17T08:58:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[22670]: audit 2024-09-17T08:58:33.567406+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-29", "mode": "writeback"}]: dispatch 2024-09-17T08:58:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[22670]: audit 2024-09-17T08:58:33.577125+0000 mon.c (mon.2) 242 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:34 smithi078 bash[22670]: audit 2024-09-17T08:58:33.577809+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:35.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:34 smithi136 bash[24812]: audit 2024-09-17T08:58:33.565653+0000 mon.a (mon.0) 2005 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi078-64680-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:35.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:34 smithi136 bash[24812]: audit 2024-09-17T08:58:33.565907+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-29"}]': finished 2024-09-17T08:58:35.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:34 smithi136 bash[24812]: cluster 2024-09-17T08:58:33.566113+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2024-09-17T08:58:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:34 smithi136 bash[24812]: audit 2024-09-17T08:58:33.567406+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-29", "mode": "writeback"}]: dispatch 2024-09-17T08:58:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:34 smithi136 bash[24812]: audit 2024-09-17T08:58:33.577125+0000 mon.c (mon.2) 242 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:35.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:34 smithi136 bash[24812]: audit 2024-09-17T08:58:33.577809+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:35.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[22670]: cluster 2024-09-17T08:58:34.554417+0000 mon.a (mon.0) 2010 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:35.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[22670]: audit 2024-09-17T08:58:34.563865+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-29", "mode": "writeback"}]': finished 2024-09-17T08:58:35.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[22670]: audit 2024-09-17T08:58:34.564114+0000 mon.a (mon.0) 2012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:35.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[22670]: cluster 2024-09-17T08:58:34.564479+0000 mon.a (mon.0) 2013 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2024-09-17T08:58:35.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[22670]: audit 2024-09-17T08:58:34.566816+0000 mon.c (mon.2) 243 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:35.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[22670]: audit 2024-09-17T08:58:34.568962+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:35.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[22670]: cluster 2024-09-17T08:58:34.866242+0000 mgr.y (mgr.14532) 285 : cluster [DBG] pgmap v347: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-17T08:58:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[32124]: cluster 2024-09-17T08:58:34.554417+0000 mon.a (mon.0) 2010 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[32124]: audit 2024-09-17T08:58:34.563865+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-29", "mode": "writeback"}]': finished 2024-09-17T08:58:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[32124]: audit 2024-09-17T08:58:34.564114+0000 mon.a (mon.0) 2012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[32124]: cluster 2024-09-17T08:58:34.564479+0000 mon.a (mon.0) 2013 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2024-09-17T08:58:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[32124]: audit 2024-09-17T08:58:34.566816+0000 mon.c (mon.2) 243 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[32124]: audit 2024-09-17T08:58:34.568962+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:35.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:35 smithi078 bash[32124]: cluster 2024-09-17T08:58:34.866242+0000 mgr.y (mgr.14532) 285 : cluster [DBG] pgmap v347: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-17T08:58:36.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:35 smithi136 bash[24812]: cluster 2024-09-17T08:58:34.554417+0000 mon.a (mon.0) 2010 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:35 smithi136 bash[24812]: audit 2024-09-17T08:58:34.563865+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-29", "mode": "writeback"}]': finished 2024-09-17T08:58:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:35 smithi136 bash[24812]: audit 2024-09-17T08:58:34.564114+0000 mon.a (mon.0) 2012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:35 smithi136 bash[24812]: cluster 2024-09-17T08:58:34.564479+0000 mon.a (mon.0) 2013 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2024-09-17T08:58:36.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:35 smithi136 bash[24812]: audit 2024-09-17T08:58:34.566816+0000 mon.c (mon.2) 243 : audit [INF] from='client.? 172.21.15.78:0/308023895' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:36.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:35 smithi136 bash[24812]: audit 2024-09-17T08:58:34.568962+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]: dispatch 2024-09-17T08:58:36.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:35 smithi136 bash[24812]: cluster 2024-09-17T08:58:34.866242+0000 mgr.y (mgr.14532) 285 : cluster [DBG] pgmap v347: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-17T08:58:36.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:35.578908+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:36.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: cluster 2024-09-17T08:58:35.579143+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2024-09-17T08:58:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:35.583476+0000 mon.c (mon.2) 244 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:35.584856+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:35.613810+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:35.614919+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:35.615325+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi078-64688-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:36.571920+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:36.572169+0000 mon.a (mon.0) 2022 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi078-64688-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: cluster 2024-09-17T08:58:36.572633+0000 mon.a (mon.0) 2023 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2024-09-17T08:58:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:36.574578+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi078-64688-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:36.575959+0000 mon.c (mon.2) 245 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[32124]: audit 2024-09-17T08:58:36.576720+0000 mon.a (mon.0) 2025 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:35.578908+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: cluster 2024-09-17T08:58:35.579143+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2024-09-17T08:58:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:35.583476+0000 mon.c (mon.2) 244 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:35.584856+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:35.613810+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:35.614919+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:35.615325+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi078-64688-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:36.571920+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:36.572169+0000 mon.a (mon.0) 2022 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi078-64688-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: cluster 2024-09-17T08:58:36.572633+0000 mon.a (mon.0) 2023 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:36.574578+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi078-64688-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:36.575959+0000 mon.c (mon.2) 245 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:36.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:36 smithi078 bash[22670]: audit 2024-09-17T08:58:36.576720+0000 mon.a (mon.0) 2025 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:37.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:35.578908+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi078-64688-47"}]': finished 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: cluster 2024-09-17T08:58:35.579143+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:35.583476+0000 mon.c (mon.2) 244 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:35.584856+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:35.613810+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:35.614919+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:35.615325+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi078-64688-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:36.571920+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:36.572169+0000 mon.a (mon.0) 2022 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi078-64688-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:37.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: cluster 2024-09-17T08:58:36.572633+0000 mon.a (mon.0) 2023 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2024-09-17T08:58:37.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:36.574578+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi078-64688-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:37.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:36.575959+0000 mon.c (mon.2) 245 : audit [INF] from='client.? 172.21.15.78:0/3704358475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:37.042 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:36 smithi136 bash[24812]: audit 2024-09-17T08:58:36.576720+0000 mon.a (mon.0) 2025 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]: dispatch 2024-09-17T08:58:38.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:38 smithi136 bash[24812]: audit 2024-09-17T08:58:36.760864+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.3", "id": [7, 2]}]: dispatch 2024-09-17T08:58:38.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:38 smithi136 bash[24812]: audit 2024-09-17T08:58:36.761324+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.13", "id": [7, 2]}]: dispatch 2024-09-17T08:58:38.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:38 smithi136 bash[24812]: audit 2024-09-17T08:58:36.761691+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.1a", "id": [7, 4]}]: dispatch 2024-09-17T08:58:38.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:38 smithi136 bash[24812]: cluster 2024-09-17T08:58:36.867023+0000 mgr.y (mgr.14532) 286 : cluster [DBG] pgmap v350: 228 pgs: 228 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:38.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:38 smithi136 bash[24812]: cluster 2024-09-17T08:58:37.541695+0000 mon.a (mon.0) 2029 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:58:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:58:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:58:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[22670]: audit 2024-09-17T08:58:36.760864+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.3", "id": [7, 2]}]: dispatch 2024-09-17T08:58:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[22670]: audit 2024-09-17T08:58:36.761324+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.13", "id": [7, 2]}]: dispatch 2024-09-17T08:58:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[22670]: audit 2024-09-17T08:58:36.761691+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.1a", "id": [7, 4]}]: dispatch 2024-09-17T08:58:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[22670]: cluster 2024-09-17T08:58:36.867023+0000 mgr.y (mgr.14532) 286 : cluster [DBG] pgmap v350: 228 pgs: 228 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[22670]: cluster 2024-09-17T08:58:37.541695+0000 mon.a (mon.0) 2029 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[32124]: audit 2024-09-17T08:58:36.760864+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.3", "id": [7, 2]}]: dispatch 2024-09-17T08:58:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[32124]: audit 2024-09-17T08:58:36.761324+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.13", "id": [7, 2]}]: dispatch 2024-09-17T08:58:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[32124]: audit 2024-09-17T08:58:36.761691+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.1a", "id": [7, 4]}]: dispatch 2024-09-17T08:58:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[32124]: cluster 2024-09-17T08:58:36.867023+0000 mgr.y (mgr.14532) 286 : cluster [DBG] pgmap v350: 228 pgs: 228 active+clean; 4.6 MiB data, 470 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:38 smithi078 bash[32124]: cluster 2024-09-17T08:58:37.541695+0000 mon.a (mon.0) 2029 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.023602+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.023793+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.3", "id": [7, 2]}]': finished 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.024004+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.13", "id": [7, 2]}]': finished 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.024248+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.1a", "id": [7, 4]}]': finished 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: cluster 2024-09-17T08:58:38.024438+0000 mon.a (mon.0) 2034 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.045394+0000 mon.c (mon.2) 246 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.045693+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.046733+0000 mon.c (mon.2) 247 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.047023+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.047519+0000 mon.c (mon.2) 248 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.047786+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.072978+0000 mon.a (mon.0) 2038 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.579979+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi078-64688-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.580679+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.581082+0000 mon.a (mon.0) 2041 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: cluster 2024-09-17T08:58:38.581211+0000 mon.a (mon.0) 2042 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.583641+0000 mon.c (mon.2) 249 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.585322+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29"}]: dispatch 2024-09-17T08:58:39.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[24812]: audit 2024-09-17T08:58:38.585879+0000 mon.a (mon.0) 2044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.023602+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.023793+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.3", "id": [7, 2]}]': finished 2024-09-17T08:58:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.024004+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.13", "id": [7, 2]}]': finished 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.024248+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.1a", "id": [7, 4]}]': finished 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: cluster 2024-09-17T08:58:38.024438+0000 mon.a (mon.0) 2034 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.045394+0000 mon.c (mon.2) 246 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.045693+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.046733+0000 mon.c (mon.2) 247 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.047023+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.047519+0000 mon.c (mon.2) 248 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.047786+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.072978+0000 mon.a (mon.0) 2038 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.579979+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi078-64688-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.580679+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.023602+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi078-64680-38"}]': finished 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.023793+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.3", "id": [7, 2]}]': finished 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.024004+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.13", "id": [7, 2]}]': finished 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.024248+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "9.1a", "id": [7, 4]}]': finished 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: cluster 2024-09-17T08:58:38.024438+0000 mon.a (mon.0) 2034 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.045394+0000 mon.c (mon.2) 246 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.045693+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.046733+0000 mon.c (mon.2) 247 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.047023+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.047519+0000 mon.c (mon.2) 248 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.047786+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.072978+0000 mon.a (mon.0) 2038 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.579979+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi078-64688-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.580679+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi078-64680-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.581082+0000 mon.a (mon.0) 2041 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: cluster 2024-09-17T08:58:38.581211+0000 mon.a (mon.0) 2042 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.583641+0000 mon.c (mon.2) 249 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.585322+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29"}]: dispatch 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[32124]: audit 2024-09-17T08:58:38.585879+0000 mon.a (mon.0) 2044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.581082+0000 mon.a (mon.0) 2041 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:39.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: cluster 2024-09-17T08:58:38.581211+0000 mon.a (mon.0) 2042 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-09-17T08:58:39.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.583641+0000 mon.c (mon.2) 249 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.585322+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29"}]: dispatch 2024-09-17T08:58:39.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:39 smithi078 bash[22670]: audit 2024-09-17T08:58:38.585879+0000 mon.a (mon.0) 2044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:39.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:58:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:58:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:40 smithi136 bash[24812]: cluster 2024-09-17T08:58:38.867872+0000 mgr.y (mgr.14532) 287 : cluster [DBG] pgmap v353: 236 pgs: 8 unknown, 3 peering, 225 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-17T08:58:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:40 smithi136 bash[24812]: cluster 2024-09-17T08:58:39.571556+0000 mon.a (mon.0) 2045 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-17T08:58:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:40 smithi136 bash[24812]: cluster 2024-09-17T08:58:39.573676+0000 mon.a (mon.0) 2046 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:40 smithi136 bash[24812]: audit 2024-09-17T08:58:39.590833+0000 mon.a (mon.0) 2047 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29"}]': finished 2024-09-17T08:58:40.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:40 smithi136 bash[24812]: cluster 2024-09-17T08:58:40.034114+0000 mon.a (mon.0) 2048 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-09-17T08:58:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[22670]: cluster 2024-09-17T08:58:38.867872+0000 mgr.y (mgr.14532) 287 : cluster [DBG] pgmap v353: 236 pgs: 8 unknown, 3 peering, 225 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-17T08:58:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[22670]: cluster 2024-09-17T08:58:39.571556+0000 mon.a (mon.0) 2045 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-17T08:58:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[22670]: cluster 2024-09-17T08:58:39.573676+0000 mon.a (mon.0) 2046 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[22670]: audit 2024-09-17T08:58:39.590833+0000 mon.a (mon.0) 2047 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29"}]': finished 2024-09-17T08:58:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[22670]: cluster 2024-09-17T08:58:40.034114+0000 mon.a (mon.0) 2048 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-09-17T08:58:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[32124]: cluster 2024-09-17T08:58:38.867872+0000 mgr.y (mgr.14532) 287 : cluster [DBG] pgmap v353: 236 pgs: 8 unknown, 3 peering, 225 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-17T08:58:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[32124]: cluster 2024-09-17T08:58:39.571556+0000 mon.a (mon.0) 2045 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-17T08:58:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[32124]: cluster 2024-09-17T08:58:39.573676+0000 mon.a (mon.0) 2046 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[32124]: audit 2024-09-17T08:58:39.590833+0000 mon.a (mon.0) 2047 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-29"}]': finished 2024-09-17T08:58:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:40 smithi078 bash[32124]: cluster 2024-09-17T08:58:40.034114+0000 mon.a (mon.0) 2048 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-09-17T08:58:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[22670]: audit 2024-09-17T08:58:39.444686+0000 mgr.y (mgr.14532) 288 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[22670]: audit 2024-09-17T08:58:40.188633+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[22670]: audit 2024-09-17T08:58:40.190862+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[22670]: audit 2024-09-17T08:58:40.598776+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[22670]: cluster 2024-09-17T08:58:40.599082+0000 mon.a (mon.0) 2052 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-09-17T08:58:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[22670]: audit 2024-09-17T08:58:40.610407+0000 mon.a (mon.0) 2053 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[32124]: audit 2024-09-17T08:58:39.444686+0000 mgr.y (mgr.14532) 288 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[32124]: audit 2024-09-17T08:58:40.188633+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[32124]: audit 2024-09-17T08:58:40.190862+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[32124]: audit 2024-09-17T08:58:40.598776+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[32124]: cluster 2024-09-17T08:58:40.599082+0000 mon.a (mon.0) 2052 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-09-17T08:58:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:41 smithi078 bash[32124]: audit 2024-09-17T08:58:40.610407+0000 mon.a (mon.0) 2053 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:41 smithi136 bash[24812]: audit 2024-09-17T08:58:39.444686+0000 mgr.y (mgr.14532) 288 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:41 smithi136 bash[24812]: audit 2024-09-17T08:58:40.188633+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:41 smithi136 bash[24812]: audit 2024-09-17T08:58:40.190862+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:41 smithi136 bash[24812]: audit 2024-09-17T08:58:40.598776+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi078-64680-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:41 smithi136 bash[24812]: cluster 2024-09-17T08:58:40.599082+0000 mon.a (mon.0) 2052 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-09-17T08:58:41.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:41 smithi136 bash[24812]: audit 2024-09-17T08:58:40.610407+0000 mon.a (mon.0) 2053 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[22670]: cluster 2024-09-17T08:58:40.868722+0000 mgr.y (mgr.14532) 289 : cluster [DBG] pgmap v356: 204 pgs: 8 unknown, 3 peering, 193 active+clean; 583 KiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[22670]: audit 2024-09-17T08:58:41.603044+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[22670]: cluster 2024-09-17T08:58:41.603452+0000 mon.a (mon.0) 2055 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-09-17T08:58:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[22670]: audit 2024-09-17T08:58:41.605022+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[22670]: audit 2024-09-17T08:58:41.607385+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[32124]: cluster 2024-09-17T08:58:40.868722+0000 mgr.y (mgr.14532) 289 : cluster [DBG] pgmap v356: 204 pgs: 8 unknown, 3 peering, 193 active+clean; 583 KiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[32124]: audit 2024-09-17T08:58:41.603044+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:42.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[32124]: cluster 2024-09-17T08:58:41.603452+0000 mon.a (mon.0) 2055 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-09-17T08:58:42.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[32124]: audit 2024-09-17T08:58:41.605022+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:42.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:42 smithi078 bash[32124]: audit 2024-09-17T08:58:41.607385+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:42.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:42 smithi136 bash[24812]: cluster 2024-09-17T08:58:40.868722+0000 mgr.y (mgr.14532) 289 : cluster [DBG] pgmap v356: 204 pgs: 8 unknown, 3 peering, 193 active+clean; 583 KiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:42.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:42 smithi136 bash[24812]: audit 2024-09-17T08:58:41.603044+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:42.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:42 smithi136 bash[24812]: cluster 2024-09-17T08:58:41.603452+0000 mon.a (mon.0) 2055 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-09-17T08:58:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:42 smithi136 bash[24812]: audit 2024-09-17T08:58:41.605022+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]: dispatch 2024-09-17T08:58:42.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:42 smithi136 bash[24812]: audit 2024-09-17T08:58:41.607385+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.557054+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.557370+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: cluster 2024-09-17T08:58:42.558006+0000 mon.a (mon.0) 2060 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-09-17T08:58:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.563152+0000 mon.c (mon.2) 250 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.563916+0000 mon.a (mon.0) 2061 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.564850+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:43.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.612956+0000 mon.a (mon.0) 2063 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:43.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.614063+0000 mon.a (mon.0) 2064 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:43.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: audit 2024-09-17T08:58:42.614559+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi078-64688-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:43.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[22670]: cluster 2024-09-17T08:58:42.870734+0000 mgr.y (mgr.14532) 290 : cluster [DBG] pgmap v359: 228 pgs: 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.557054+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.557370+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: cluster 2024-09-17T08:58:42.558006+0000 mon.a (mon.0) 2060 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-09-17T08:58:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.563152+0000 mon.c (mon.2) 250 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.563916+0000 mon.a (mon.0) 2061 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.564850+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:43.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.612956+0000 mon.a (mon.0) 2063 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:43.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.614063+0000 mon.a (mon.0) 2064 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:43.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: audit 2024-09-17T08:58:42.614559+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi078-64688-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:43.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:43 smithi078 bash[32124]: cluster 2024-09-17T08:58:42.870734+0000 mgr.y (mgr.14532) 290 : cluster [DBG] pgmap v359: 228 pgs: 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:44.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.557054+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? 172.21.15.78:0/3255153114' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi078-64688-48"}]': finished 2024-09-17T08:58:44.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.557370+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: cluster 2024-09-17T08:58:42.558006+0000 mon.a (mon.0) 2060 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.563152+0000 mon.c (mon.2) 250 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.563916+0000 mon.a (mon.0) 2061 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.564850+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.612956+0000 mon.a (mon.0) 2063 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.614063+0000 mon.a (mon.0) 2064 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: audit 2024-09-17T08:58:42.614559+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi078-64688-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:44.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:43 smithi136 bash[24812]: cluster 2024-09-17T08:58:42.870734+0000 mgr.y (mgr.14532) 290 : cluster [DBG] pgmap v359: 228 pgs: 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:45.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: cluster 2024-09-17T08:58:43.548756+0000 mon.a (mon.0) 2066 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:45.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: cluster 2024-09-17T08:58:43.548814+0000 mon.a (mon.0) 2067 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-09-17T08:58:45.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: audit 2024-09-17T08:58:43.572304+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: audit 2024-09-17T08:58:43.572546+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: audit 2024-09-17T08:58:43.572761+0000 mon.a (mon.0) 2070 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi078-64688-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: cluster 2024-09-17T08:58:43.572941+0000 mon.a (mon.0) 2071 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-09-17T08:58:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: audit 2024-09-17T08:58:43.575548+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-31"}]: dispatch 2024-09-17T08:58:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: audit 2024-09-17T08:58:43.576085+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi078-64688-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: audit 2024-09-17T08:58:43.576593+0000 mon.c (mon.2) 251 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:45 smithi136 bash[24812]: audit 2024-09-17T08:58:43.578162+0000 mon.a (mon.0) 2074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: cluster 2024-09-17T08:58:43.548756+0000 mon.a (mon.0) 2066 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: cluster 2024-09-17T08:58:43.548814+0000 mon.a (mon.0) 2067 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: audit 2024-09-17T08:58:43.572304+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: audit 2024-09-17T08:58:43.572546+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: audit 2024-09-17T08:58:43.572761+0000 mon.a (mon.0) 2070 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi078-64688-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: cluster 2024-09-17T08:58:43.572941+0000 mon.a (mon.0) 2071 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: audit 2024-09-17T08:58:43.575548+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-31"}]: dispatch 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: audit 2024-09-17T08:58:43.576085+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi078-64688-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: audit 2024-09-17T08:58:43.576593+0000 mon.c (mon.2) 251 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:45.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[22670]: audit 2024-09-17T08:58:43.578162+0000 mon.a (mon.0) 2074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: cluster 2024-09-17T08:58:43.548756+0000 mon.a (mon.0) 2066 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: cluster 2024-09-17T08:58:43.548814+0000 mon.a (mon.0) 2067 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: audit 2024-09-17T08:58:43.572304+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: audit 2024-09-17T08:58:43.572546+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: audit 2024-09-17T08:58:43.572761+0000 mon.a (mon.0) 2070 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi078-64688-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: cluster 2024-09-17T08:58:43.572941+0000 mon.a (mon.0) 2071 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: audit 2024-09-17T08:58:43.575548+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-31"}]: dispatch 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: audit 2024-09-17T08:58:43.576085+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi078-64688-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: audit 2024-09-17T08:58:43.576593+0000 mon.c (mon.2) 251 : audit [INF] from='client.? 172.21.15.78:0/2192261501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:45 smithi078 bash[32124]: audit 2024-09-17T08:58:43.578162+0000 mon.a (mon.0) 2074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]: dispatch 2024-09-17T08:58:46.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:44.574007+0000 mon.a (mon.0) 2075 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-31"}]': finished 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: cluster 2024-09-17T08:58:44.871530+0000 mgr.y (mgr.14532) 291 : cluster [DBG] pgmap v362: 228 pgs: 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.020341+0000 mon.a (mon.0) 2076 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: cluster 2024-09-17T08:58:45.020546+0000 mon.a (mon.0) 2077 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.022004+0000 mon.a (mon.0) 2078 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-31", "mode": "writeback"}]: dispatch 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.041895+0000 mon.c (mon.2) 252 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.042177+0000 mon.a (mon.0) 2079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.042906+0000 mon.c (mon.2) 253 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.043213+0000 mon.a (mon.0) 2080 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.043616+0000 mon.c (mon.2) 254 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:46.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.043867+0000 mon.a (mon.0) 2081 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: cluster 2024-09-17T08:58:45.565639+0000 mon.a (mon.0) 2082 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.580416+0000 mon.a (mon.0) 2083 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi078-64688-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.580654+0000 mon.a (mon.0) 2084 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-31", "mode": "writeback"}]': finished 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.580909+0000 mon.a (mon.0) 2085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: cluster 2024-09-17T08:58:45.581103+0000 mon.a (mon.0) 2086 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.582203+0000 mon.c (mon.2) 255 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.583360+0000 mon.a (mon.0) 2087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:46 smithi136 bash[24812]: audit 2024-09-17T08:58:45.727235+0000 mon.a (mon.0) 2088 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:46.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:44.574007+0000 mon.a (mon.0) 2075 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-31"}]': finished 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: cluster 2024-09-17T08:58:44.871530+0000 mgr.y (mgr.14532) 291 : cluster [DBG] pgmap v362: 228 pgs: 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.020341+0000 mon.a (mon.0) 2076 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: cluster 2024-09-17T08:58:45.020546+0000 mon.a (mon.0) 2077 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.022004+0000 mon.a (mon.0) 2078 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-31", "mode": "writeback"}]: dispatch 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.041895+0000 mon.c (mon.2) 252 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.042177+0000 mon.a (mon.0) 2079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.042906+0000 mon.c (mon.2) 253 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.043213+0000 mon.a (mon.0) 2080 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.043616+0000 mon.c (mon.2) 254 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.043867+0000 mon.a (mon.0) 2081 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: cluster 2024-09-17T08:58:45.565639+0000 mon.a (mon.0) 2082 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:46.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.580416+0000 mon.a (mon.0) 2083 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi078-64688-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.580654+0000 mon.a (mon.0) 2084 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-31", "mode": "writeback"}]': finished 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:44.574007+0000 mon.a (mon.0) 2075 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-31"}]': finished 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: cluster 2024-09-17T08:58:44.871530+0000 mgr.y (mgr.14532) 291 : cluster [DBG] pgmap v362: 228 pgs: 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.020341+0000 mon.a (mon.0) 2076 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi078-64680-39"}]': finished 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: cluster 2024-09-17T08:58:45.020546+0000 mon.a (mon.0) 2077 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.022004+0000 mon.a (mon.0) 2078 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-31", "mode": "writeback"}]: dispatch 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.041895+0000 mon.c (mon.2) 252 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.042177+0000 mon.a (mon.0) 2079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.042906+0000 mon.c (mon.2) 253 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.043213+0000 mon.a (mon.0) 2080 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.043616+0000 mon.c (mon.2) 254 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.043867+0000 mon.a (mon.0) 2081 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: cluster 2024-09-17T08:58:45.565639+0000 mon.a (mon.0) 2082 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.580416+0000 mon.a (mon.0) 2083 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi078-64688-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.580654+0000 mon.a (mon.0) 2084 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-31", "mode": "writeback"}]': finished 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.580909+0000 mon.a (mon.0) 2085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: cluster 2024-09-17T08:58:45.581103+0000 mon.a (mon.0) 2086 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.582203+0000 mon.c (mon.2) 255 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.583360+0000 mon.a (mon.0) 2087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[22670]: audit 2024-09-17T08:58:45.727235+0000 mon.a (mon.0) 2088 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:46.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.580909+0000 mon.a (mon.0) 2085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi078-64680-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:46.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: cluster 2024-09-17T08:58:45.581103+0000 mon.a (mon.0) 2086 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-09-17T08:58:46.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.582203+0000 mon.c (mon.2) 255 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.583360+0000 mon.a (mon.0) 2087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:46.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:46 smithi078 bash[32124]: audit 2024-09-17T08:58:45.727235+0000 mon.a (mon.0) 2088 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[22670]: cluster 2024-09-17T08:58:46.872297+0000 mgr.y (mgr.14532) 292 : cluster [DBG] pgmap v365: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[22670]: audit 2024-09-17T08:58:47.021939+0000 mon.a (mon.0) 2089 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[22670]: cluster 2024-09-17T08:58:47.022155+0000 mon.a (mon.0) 2090 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[22670]: audit 2024-09-17T08:58:47.024736+0000 mon.a (mon.0) 2091 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31"}]: dispatch 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[32124]: cluster 2024-09-17T08:58:46.872297+0000 mgr.y (mgr.14532) 292 : cluster [DBG] pgmap v365: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[32124]: audit 2024-09-17T08:58:47.021939+0000 mon.a (mon.0) 2089 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[32124]: cluster 2024-09-17T08:58:47.022155+0000 mon.a (mon.0) 2090 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-09-17T08:58:47.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[32124]: audit 2024-09-17T08:58:47.024736+0000 mon.a (mon.0) 2091 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31"}]: dispatch 2024-09-17T08:58:48.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:47 smithi136 bash[24812]: cluster 2024-09-17T08:58:46.872297+0000 mgr.y (mgr.14532) 292 : cluster [DBG] pgmap v365: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:48.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:47 smithi136 bash[24812]: audit 2024-09-17T08:58:47.021939+0000 mon.a (mon.0) 2089 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:48.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:47 smithi136 bash[24812]: cluster 2024-09-17T08:58:47.022155+0000 mon.a (mon.0) 2090 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-09-17T08:58:48.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:47 smithi136 bash[24812]: audit 2024-09-17T08:58:47.024736+0000 mon.a (mon.0) 2091 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31"}]: dispatch 2024-09-17T08:58:48.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:58:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:58:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:58:49.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[22670]: cluster 2024-09-17T08:58:47.578256+0000 mon.a (mon.0) 2092 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:49.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[22670]: audit 2024-09-17T08:58:47.603534+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:49.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[22670]: audit 2024-09-17T08:58:47.603792+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31"}]': finished 2024-09-17T08:58:49.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[22670]: cluster 2024-09-17T08:58:47.603986+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-09-17T08:58:49.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[22670]: audit 2024-09-17T08:58:47.610421+0000 mon.a (mon.0) 2096 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:49.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[32124]: cluster 2024-09-17T08:58:47.578256+0000 mon.a (mon.0) 2092 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[32124]: audit 2024-09-17T08:58:47.603534+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[32124]: audit 2024-09-17T08:58:47.603792+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31"}]': finished 2024-09-17T08:58:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[32124]: cluster 2024-09-17T08:58:47.603986+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-09-17T08:58:49.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:49 smithi078 bash[32124]: audit 2024-09-17T08:58:47.610421+0000 mon.a (mon.0) 2096 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:49.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:49 smithi136 bash[24812]: cluster 2024-09-17T08:58:47.578256+0000 mon.a (mon.0) 2092 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:49.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:49 smithi136 bash[24812]: audit 2024-09-17T08:58:47.603534+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi078-64680-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:49.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:49 smithi136 bash[24812]: audit 2024-09-17T08:58:47.603792+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-31"}]': finished 2024-09-17T08:58:49.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:49 smithi136 bash[24812]: cluster 2024-09-17T08:58:47.603986+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-09-17T08:58:49.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:49 smithi136 bash[24812]: audit 2024-09-17T08:58:47.610421+0000 mon.a (mon.0) 2096 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:49.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:58:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:58:50.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:48.601041+0000 mon.a (mon.0) 2097 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:50.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: cluster 2024-09-17T08:58:48.601422+0000 mon.a (mon.0) 2098 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-09-17T08:58:50.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:48.611617+0000 mon.a (mon.0) 2099 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:50.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: cluster 2024-09-17T08:58:48.873035+0000 mgr.y (mgr.14532) 293 : cluster [DBG] pgmap v368: 204 pgs: 8 creating+peering, 196 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:49.611004+0000 mon.a (mon.0) 2100 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: cluster 2024-09-17T08:58:49.611300+0000 mon.a (mon.0) 2101 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:49.616888+0000 mon.c (mon.2) 256 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:49.629659+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:49.631193+0000 mon.a (mon.0) 2103 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:49.658778+0000 mon.a (mon.0) 2104 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:49.659829+0000 mon.a (mon.0) 2105 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[22670]: audit 2024-09-17T08:58:49.660174+0000 mon.a (mon.0) 2106 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi078-64688-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:48.601041+0000 mon.a (mon.0) 2097 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:50.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: cluster 2024-09-17T08:58:48.601422+0000 mon.a (mon.0) 2098 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:48.611617+0000 mon.a (mon.0) 2099 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: cluster 2024-09-17T08:58:48.873035+0000 mgr.y (mgr.14532) 293 : cluster [DBG] pgmap v368: 204 pgs: 8 creating+peering, 196 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:49.611004+0000 mon.a (mon.0) 2100 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: cluster 2024-09-17T08:58:49.611300+0000 mon.a (mon.0) 2101 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:49.616888+0000 mon.c (mon.2) 256 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:49.629659+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:49.631193+0000 mon.a (mon.0) 2103 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:49.658778+0000 mon.a (mon.0) 2104 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:49.659829+0000 mon.a (mon.0) 2105 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:50 smithi078 bash[32124]: audit 2024-09-17T08:58:49.660174+0000 mon.a (mon.0) 2106 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi078-64688-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:50.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:48.601041+0000 mon.a (mon.0) 2097 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:50.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: cluster 2024-09-17T08:58:48.601422+0000 mon.a (mon.0) 2098 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:48.611617+0000 mon.a (mon.0) 2099 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]: dispatch 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: cluster 2024-09-17T08:58:48.873035+0000 mgr.y (mgr.14532) 293 : cluster [DBG] pgmap v368: 204 pgs: 8 creating+peering, 196 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:49.611004+0000 mon.a (mon.0) 2100 : audit [INF] from='client.? 172.21.15.78:0/2678568438' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi078-64688-49"}]': finished 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: cluster 2024-09-17T08:58:49.611300+0000 mon.a (mon.0) 2101 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:49.616888+0000 mon.c (mon.2) 256 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:49.629659+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:49.631193+0000 mon.a (mon.0) 2103 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:49.658778+0000 mon.a (mon.0) 2104 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:49.659829+0000 mon.a (mon.0) 2105 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:50.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:50 smithi136 bash[24812]: audit 2024-09-17T08:58:49.660174+0000 mon.a (mon.0) 2106 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi078-64688-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:51.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:49.455970+0000 mgr.y (mgr.14532) 294 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:51.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:50.612369+0000 mon.a (mon.0) 2107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:50.612654+0000 mon.a (mon.0) 2108 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:50.613051+0000 mon.a (mon.0) 2109 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi078-64688-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: cluster 2024-09-17T08:58:50.613211+0000 mon.a (mon.0) 2110 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:50.615979+0000 mon.c (mon.2) 257 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:50.616019+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi078-64688-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:50.618370+0000 mon.a (mon.0) 2112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[22670]: audit 2024-09-17T08:58:50.620645+0000 mon.a (mon.0) 2113 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:49.455970+0000 mgr.y (mgr.14532) 294 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:51.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:50.612369+0000 mon.a (mon.0) 2107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:50.612654+0000 mon.a (mon.0) 2108 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:50.613051+0000 mon.a (mon.0) 2109 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi078-64688-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: cluster 2024-09-17T08:58:50.613211+0000 mon.a (mon.0) 2110 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-09-17T08:58:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:50.615979+0000 mon.c (mon.2) 257 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:50.616019+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi078-64688-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:50.618370+0000 mon.a (mon.0) 2112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:51 smithi078 bash[32124]: audit 2024-09-17T08:58:50.620645+0000 mon.a (mon.0) 2113 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:49.455970+0000 mgr.y (mgr.14532) 294 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:58:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:50.612369+0000 mon.a (mon.0) 2107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:50.612654+0000 mon.a (mon.0) 2108 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:51.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:50.613051+0000 mon.a (mon.0) 2109 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi078-64688-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:51.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: cluster 2024-09-17T08:58:50.613211+0000 mon.a (mon.0) 2110 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-09-17T08:58:51.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:50.615979+0000 mon.c (mon.2) 257 : audit [INF] from='client.? 172.21.15.78:0/617973133' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:51.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:50.616019+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi078-64688-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:51.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:50.618370+0000 mon.a (mon.0) 2112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]: dispatch 2024-09-17T08:58:51.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:51 smithi136 bash[24812]: audit 2024-09-17T08:58:50.620645+0000 mon.a (mon.0) 2113 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:52.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:52 smithi078 bash[32124]: cluster 2024-09-17T08:58:50.873871+0000 mgr.y (mgr.14532) 295 : cluster [DBG] pgmap v371: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:52.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:52 smithi078 bash[32124]: cluster 2024-09-17T08:58:51.605216+0000 mon.a (mon.0) 2114 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:52.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:52 smithi078 bash[22670]: cluster 2024-09-17T08:58:50.873871+0000 mgr.y (mgr.14532) 295 : cluster [DBG] pgmap v371: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:52.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:52 smithi078 bash[22670]: cluster 2024-09-17T08:58:51.605216+0000 mon.a (mon.0) 2114 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:52 smithi136 bash[24812]: cluster 2024-09-17T08:58:50.873871+0000 mgr.y (mgr.14532) 295 : cluster [DBG] pgmap v371: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 517 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:58:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:52 smithi136 bash[24812]: cluster 2024-09-17T08:58:51.605216+0000 mon.a (mon.0) 2114 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:53.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.064780+0000 mon.a (mon.0) 2115 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:53.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.064868+0000 mon.a (mon.0) 2116 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:53.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: cluster 2024-09-17T08:58:52.064916+0000 mon.a (mon.0) 2117 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-09-17T08:58:53.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.066629+0000 mon.a (mon.0) 2118 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-33"}]: dispatch 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.106654+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.107646+0000 mon.a (mon.0) 2120 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.108040+0000 mon.a (mon.0) 2121 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi078-64680-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.627140+0000 mon.a (mon.0) 2122 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi078-64688-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.627493+0000 mon.a (mon.0) 2123 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-33"}]': finished 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.627663+0000 mon.a (mon.0) 2124 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi078-64680-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: cluster 2024-09-17T08:58:52.627745+0000 mon.a (mon.0) 2125 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.631804+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-33", "mode": "writeback"}]: dispatch 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[22670]: audit 2024-09-17T08:58:52.632586+0000 mon.a (mon.0) 2127 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi078-64680-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.064780+0000 mon.a (mon.0) 2115 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.064868+0000 mon.a (mon.0) 2116 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: cluster 2024-09-17T08:58:52.064916+0000 mon.a (mon.0) 2117 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.066629+0000 mon.a (mon.0) 2118 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-33"}]: dispatch 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.106654+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.107646+0000 mon.a (mon.0) 2120 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.108040+0000 mon.a (mon.0) 2121 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi078-64680-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.627140+0000 mon.a (mon.0) 2122 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi078-64688-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.627493+0000 mon.a (mon.0) 2123 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-33"}]': finished 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.627663+0000 mon.a (mon.0) 2124 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi078-64680-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: cluster 2024-09-17T08:58:52.627745+0000 mon.a (mon.0) 2125 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.631804+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-33", "mode": "writeback"}]: dispatch 2024-09-17T08:58:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:53 smithi078 bash[32124]: audit 2024-09-17T08:58:52.632586+0000 mon.a (mon.0) 2127 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi078-64680-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.064780+0000 mon.a (mon.0) 2115 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi078-64680-40"}]': finished 2024-09-17T08:58:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.064868+0000 mon.a (mon.0) 2116 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:58:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: cluster 2024-09-17T08:58:52.064916+0000 mon.a (mon.0) 2117 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.066629+0000 mon.a (mon.0) 2118 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-33"}]: dispatch 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.106654+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.107646+0000 mon.a (mon.0) 2120 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.108040+0000 mon.a (mon.0) 2121 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi078-64680-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.627140+0000 mon.a (mon.0) 2122 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi078-64688-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.627493+0000 mon.a (mon.0) 2123 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-33"}]': finished 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.627663+0000 mon.a (mon.0) 2124 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi078-64680-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: cluster 2024-09-17T08:58:52.627745+0000 mon.a (mon.0) 2125 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.631804+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-33", "mode": "writeback"}]: dispatch 2024-09-17T08:58:53.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:53 smithi136 bash[24812]: audit 2024-09-17T08:58:52.632586+0000 mon.a (mon.0) 2127 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi078-64680-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:54.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:54 smithi078 bash[32124]: cluster 2024-09-17T08:58:52.875981+0000 mgr.y (mgr.14532) 296 : cluster [DBG] pgmap v374: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:54.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:54 smithi078 bash[32124]: cluster 2024-09-17T08:58:53.620907+0000 mon.a (mon.0) 2128 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:54.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:54 smithi078 bash[22670]: cluster 2024-09-17T08:58:52.875981+0000 mgr.y (mgr.14532) 296 : cluster [DBG] pgmap v374: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:54.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:54 smithi078 bash[22670]: cluster 2024-09-17T08:58:53.620907+0000 mon.a (mon.0) 2128 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:54 smithi136 bash[24812]: cluster 2024-09-17T08:58:52.875981+0000 mgr.y (mgr.14532) 296 : cluster [DBG] pgmap v374: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:54 smithi136 bash[24812]: cluster 2024-09-17T08:58:53.620907+0000 mon.a (mon.0) 2128 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:58:55.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: audit 2024-09-17T08:58:53.638466+0000 mon.a (mon.0) 2129 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-33", "mode": "writeback"}]': finished 2024-09-17T08:58:55.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: cluster 2024-09-17T08:58:54.080289+0000 mon.a (mon.0) 2130 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-09-17T08:58:55.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: audit 2024-09-17T08:58:54.278601+0000 mon.a (mon.0) 2131 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:55.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: audit 2024-09-17T08:58:54.640894+0000 mon.a (mon.0) 2132 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi078-64680-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: audit 2024-09-17T08:58:54.641169+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: cluster 2024-09-17T08:58:54.641295+0000 mon.a (mon.0) 2134 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: audit 2024-09-17T08:58:54.645154+0000 mon.a (mon.0) 2135 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33"}]: dispatch 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: audit 2024-09-17T08:58:54.646249+0000 mon.a (mon.0) 2136 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[22670]: cluster 2024-09-17T08:58:54.876822+0000 mgr.y (mgr.14532) 297 : cluster [DBG] pgmap v377: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: audit 2024-09-17T08:58:53.638466+0000 mon.a (mon.0) 2129 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-33", "mode": "writeback"}]': finished 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: cluster 2024-09-17T08:58:54.080289+0000 mon.a (mon.0) 2130 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: audit 2024-09-17T08:58:54.278601+0000 mon.a (mon.0) 2131 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: audit 2024-09-17T08:58:54.640894+0000 mon.a (mon.0) 2132 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi078-64680-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:58:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: audit 2024-09-17T08:58:54.641169+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: cluster 2024-09-17T08:58:54.641295+0000 mon.a (mon.0) 2134 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-09-17T08:58:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: audit 2024-09-17T08:58:54.645154+0000 mon.a (mon.0) 2135 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33"}]: dispatch 2024-09-17T08:58:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: audit 2024-09-17T08:58:54.646249+0000 mon.a (mon.0) 2136 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:55.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:55 smithi078 bash[32124]: cluster 2024-09-17T08:58:54.876822+0000 mgr.y (mgr.14532) 297 : cluster [DBG] pgmap v377: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: audit 2024-09-17T08:58:53.638466+0000 mon.a (mon.0) 2129 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-33", "mode": "writeback"}]': finished 2024-09-17T08:58:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: cluster 2024-09-17T08:58:54.080289+0000 mon.a (mon.0) 2130 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-09-17T08:58:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: audit 2024-09-17T08:58:54.278601+0000 mon.a (mon.0) 2131 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:58:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: audit 2024-09-17T08:58:54.640894+0000 mon.a (mon.0) 2132 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi078-64680-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:58:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: audit 2024-09-17T08:58:54.641169+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:58:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: cluster 2024-09-17T08:58:54.641295+0000 mon.a (mon.0) 2134 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-09-17T08:58:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: audit 2024-09-17T08:58:54.645154+0000 mon.a (mon.0) 2135 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33"}]: dispatch 2024-09-17T08:58:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: audit 2024-09-17T08:58:54.646249+0000 mon.a (mon.0) 2136 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:55.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:55 smithi136 bash[24812]: cluster 2024-09-17T08:58:54.876822+0000 mgr.y (mgr.14532) 297 : cluster [DBG] pgmap v377: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:58:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:56 smithi136 bash[24812]: audit 2024-09-17T08:58:55.225361+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:56 smithi136 bash[24812]: audit 2024-09-17T08:58:55.227717+0000 mon.a (mon.0) 2138 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:56 smithi136 bash[24812]: cluster 2024-09-17T08:58:55.635378+0000 mon.a (mon.0) 2139 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:56 smithi136 bash[24812]: audit 2024-09-17T08:58:55.649595+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33"}]': finished 2024-09-17T08:58:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:56 smithi136 bash[24812]: audit 2024-09-17T08:58:55.649798+0000 mon.a (mon.0) 2141 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:56 smithi136 bash[24812]: cluster 2024-09-17T08:58:55.650245+0000 mon.a (mon.0) 2142 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-09-17T08:58:56.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:56 smithi136 bash[24812]: audit 2024-09-17T08:58:55.651974+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[22670]: audit 2024-09-17T08:58:55.225361+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[22670]: audit 2024-09-17T08:58:55.227717+0000 mon.a (mon.0) 2138 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[22670]: cluster 2024-09-17T08:58:55.635378+0000 mon.a (mon.0) 2139 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[22670]: audit 2024-09-17T08:58:55.649595+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33"}]': finished 2024-09-17T08:58:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[22670]: audit 2024-09-17T08:58:55.649798+0000 mon.a (mon.0) 2141 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[22670]: cluster 2024-09-17T08:58:55.650245+0000 mon.a (mon.0) 2142 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[22670]: audit 2024-09-17T08:58:55.651974+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[32124]: audit 2024-09-17T08:58:55.225361+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[32124]: audit 2024-09-17T08:58:55.227717+0000 mon.a (mon.0) 2138 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[32124]: cluster 2024-09-17T08:58:55.635378+0000 mon.a (mon.0) 2139 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[32124]: audit 2024-09-17T08:58:55.649595+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-33"}]': finished 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[32124]: audit 2024-09-17T08:58:55.649798+0000 mon.a (mon.0) 2141 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[32124]: cluster 2024-09-17T08:58:55.650245+0000 mon.a (mon.0) 2142 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-09-17T08:58:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:56 smithi078 bash[32124]: audit 2024-09-17T08:58:55.651974+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]: dispatch 2024-09-17T08:58:57.919 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[32124]: audit 2024-09-17T08:58:56.653443+0000 mon.a (mon.0) 2144 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[32124]: cluster 2024-09-17T08:58:56.653692+0000 mon.a (mon.0) 2145 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[32124]: cluster 2024-09-17T08:58:56.877632+0000 mgr.y (mgr.14532) 298 : cluster [DBG] pgmap v380: 196 pgs: 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[32124]: audit 2024-09-17T08:58:57.108308+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[32124]: cluster 2024-09-17T08:58:57.550750+0000 mon.a (mon.0) 2147 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[22670]: audit 2024-09-17T08:58:56.653443+0000 mon.a (mon.0) 2144 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[22670]: cluster 2024-09-17T08:58:56.653692+0000 mon.a (mon.0) 2145 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[22670]: cluster 2024-09-17T08:58:56.877632+0000 mgr.y (mgr.14532) 298 : cluster [DBG] pgmap v380: 196 pgs: 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:57.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[22670]: audit 2024-09-17T08:58:57.108308+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:57.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[22670]: cluster 2024-09-17T08:58:57.550750+0000 mon.a (mon.0) 2147 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:58.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:57 smithi136 bash[24812]: audit 2024-09-17T08:58:56.653443+0000 mon.a (mon.0) 2144 : audit [INF] from='client.? 172.21.15.78:0/1656094957' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi078-64688-50"}]': finished 2024-09-17T08:58:58.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:57 smithi136 bash[24812]: cluster 2024-09-17T08:58:56.653692+0000 mon.a (mon.0) 2145 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-09-17T08:58:58.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:57 smithi136 bash[24812]: cluster 2024-09-17T08:58:56.877632+0000 mgr.y (mgr.14532) 298 : cluster [DBG] pgmap v380: 196 pgs: 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:58:58.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:57 smithi136 bash[24812]: audit 2024-09-17T08:58:57.108308+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:58.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:57 smithi136 bash[24812]: cluster 2024-09-17T08:58:57.550750+0000 mon.a (mon.0) 2147 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:58:58.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:58:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:58:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:58:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:58 smithi136 bash[24812]: audit 2024-09-17T08:58:57.666586+0000 mon.a (mon.0) 2148 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:58:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:58 smithi136 bash[24812]: cluster 2024-09-17T08:58:57.667048+0000 mon.a (mon.0) 2149 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-09-17T08:58:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:58 smithi136 bash[24812]: audit 2024-09-17T08:58:57.669489+0000 mon.c (mon.2) 258 : audit [INF] from='client.? 172.21.15.78:0/3236798399' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:58 smithi136 bash[24812]: audit 2024-09-17T08:58:57.670009+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:58 smithi136 bash[24812]: audit 2024-09-17T08:58:57.672065+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:58 smithi136 bash[24812]: audit 2024-09-17T08:58:57.672817+0000 mon.a (mon.0) 2152 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[22670]: audit 2024-09-17T08:58:57.666586+0000 mon.a (mon.0) 2148 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:58:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[22670]: cluster 2024-09-17T08:58:57.667048+0000 mon.a (mon.0) 2149 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-09-17T08:58:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[22670]: audit 2024-09-17T08:58:57.669489+0000 mon.c (mon.2) 258 : audit [INF] from='client.? 172.21.15.78:0/3236798399' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[22670]: audit 2024-09-17T08:58:57.670009+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[22670]: audit 2024-09-17T08:58:57.672065+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[22670]: audit 2024-09-17T08:58:57.672817+0000 mon.a (mon.0) 2152 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[32124]: audit 2024-09-17T08:58:57.666586+0000 mon.a (mon.0) 2148 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:58:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[32124]: cluster 2024-09-17T08:58:57.667048+0000 mon.a (mon.0) 2149 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-09-17T08:58:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[32124]: audit 2024-09-17T08:58:57.669489+0000 mon.c (mon.2) 258 : audit [INF] from='client.? 172.21.15.78:0/3236798399' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[32124]: audit 2024-09-17T08:58:57.670009+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]: dispatch 2024-09-17T08:58:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[32124]: audit 2024-09-17T08:58:57.672065+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:58 smithi078 bash[32124]: audit 2024-09-17T08:58:57.672817+0000 mon.a (mon.0) 2152 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:58:59.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:58:59.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.670253+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:58:59.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.671078+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:59.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.671936+0000 mon.a (mon.0) 2155 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:58:59.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: cluster 2024-09-17T08:58:58.672953+0000 mon.a (mon.0) 2156 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-09-17T08:58:59.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.690519+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:58:59.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.718516+0000 mon.a (mon.0) 2158 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:58:59.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.720480+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:58:59.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.721381+0000 mon.a (mon.0) 2159 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:58:59.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.723144+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:58:59.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.724541+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:59.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: audit 2024-09-17T08:58:58.726438+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:58:59.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:58:59 smithi136 bash[24812]: cluster 2024-09-17T08:58:58.878517+0000 mgr.y (mgr.14532) 299 : cluster [DBG] pgmap v383: 260 pgs: 64 creating+peering, 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:59:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.670253+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:59:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.671078+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.671936+0000 mon.a (mon.0) 2155 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: cluster 2024-09-17T08:58:58.672953+0000 mon.a (mon.0) 2156 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-09-17T08:59:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.690519+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.718516+0000 mon.a (mon.0) 2158 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.720480+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.721381+0000 mon.a (mon.0) 2159 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.723144+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.724541+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: audit 2024-09-17T08:58:58.726438+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[22670]: cluster 2024-09-17T08:58:58.878517+0000 mgr.y (mgr.14532) 299 : cluster [DBG] pgmap v383: 260 pgs: 64 creating+peering, 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.670253+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? 172.21.15.78:0/1228252055' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi078-64680-41"}]': finished 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.671078+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi078-64688-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.671936+0000 mon.a (mon.0) 2155 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: cluster 2024-09-17T08:58:58.672953+0000 mon.a (mon.0) 2156 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-09-17T08:59:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.690519+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.718516+0000 mon.a (mon.0) 2158 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.720480+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.721381+0000 mon.a (mon.0) 2159 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.723144+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.724541+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: audit 2024-09-17T08:58:58.726438+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:58:59 smithi078 bash[32124]: cluster 2024-09-17T08:58:58.878517+0000 mgr.y (mgr.14532) 299 : cluster [DBG] pgmap v383: 260 pgs: 64 creating+peering, 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:59:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.467317+0000 mgr.y (mgr.14532) 300 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.698055+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.698258+0000 mon.a (mon.0) 2162 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: cluster 2024-09-17T08:58:59.698684+0000 mon.a (mon.0) 2163 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.701035+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.702582+0000 mon.a (mon.0) 2165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.702775+0000 mon.b (mon.1) 77 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.745329+0000 mon.c (mon.2) 259 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.745795+0000 mon.a (mon.0) 2166 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.746522+0000 mon.c (mon.2) 260 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.746951+0000 mon.a (mon.0) 2167 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.747604+0000 mon.c (mon.2) 261 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:01.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:01 smithi136 bash[24812]: audit 2024-09-17T08:58:59.747929+0000 mon.a (mon.0) 2168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:01.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.467317+0000 mgr.y (mgr.14532) 300 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:01.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.698055+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:01.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.698258+0000 mon.a (mon.0) 2162 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:01.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: cluster 2024-09-17T08:58:59.698684+0000 mon.a (mon.0) 2163 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-09-17T08:59:01.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.701035+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.702582+0000 mon.a (mon.0) 2165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.702775+0000 mon.b (mon.1) 77 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.745329+0000 mon.c (mon.2) 259 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.745795+0000 mon.a (mon.0) 2166 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.746522+0000 mon.c (mon.2) 260 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.746951+0000 mon.a (mon.0) 2167 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.747604+0000 mon.c (mon.2) 261 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[32124]: audit 2024-09-17T08:58:59.747929+0000 mon.a (mon.0) 2168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.467317+0000 mgr.y (mgr.14532) 300 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.698055+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.698258+0000 mon.a (mon.0) 2162 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi078-64680-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: cluster 2024-09-17T08:58:59.698684+0000 mon.a (mon.0) 2163 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.701035+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.702582+0000 mon.a (mon.0) 2165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.702775+0000 mon.b (mon.1) 77 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.745329+0000 mon.c (mon.2) 259 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.745795+0000 mon.a (mon.0) 2166 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.746522+0000 mon.c (mon.2) 260 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.746951+0000 mon.a (mon.0) 2167 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.747604+0000 mon.c (mon.2) 261 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:01.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:01 smithi078 bash[22670]: audit 2024-09-17T08:58:59.747929+0000 mon.a (mon.0) 2168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:02.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: audit 2024-09-17T08:59:00.696199+0000 mon.a (mon.0) 2169 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:02.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: cluster 2024-09-17T08:59:00.879382+0000 mgr.y (mgr.14532) 301 : cluster [DBG] pgmap v386: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:59:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: audit 2024-09-17T08:59:01.136413+0000 mon.a (mon.0) 2170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: cluster 2024-09-17T08:59:01.136638+0000 mon.a (mon.0) 2171 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-09-17T08:59:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: audit 2024-09-17T08:59:01.137697+0000 mon.c (mon.2) 262 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: audit 2024-09-17T08:59:01.138517+0000 mon.a (mon.0) 2172 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-35", "mode": "writeback"}]: dispatch 2024-09-17T08:59:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: audit 2024-09-17T08:59:01.139057+0000 mon.a (mon.0) 2173 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:02 smithi136 bash[24812]: cluster 2024-09-17T08:59:01.691622+0000 mon.a (mon.0) 2174 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:02.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: audit 2024-09-17T08:59:00.696199+0000 mon.a (mon.0) 2169 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:02.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: cluster 2024-09-17T08:59:00.879382+0000 mgr.y (mgr.14532) 301 : cluster [DBG] pgmap v386: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:59:02.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: audit 2024-09-17T08:59:01.136413+0000 mon.a (mon.0) 2170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:02.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: cluster 2024-09-17T08:59:01.136638+0000 mon.a (mon.0) 2171 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: audit 2024-09-17T08:59:01.137697+0000 mon.c (mon.2) 262 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: audit 2024-09-17T08:59:01.138517+0000 mon.a (mon.0) 2172 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-35", "mode": "writeback"}]: dispatch 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: audit 2024-09-17T08:59:01.139057+0000 mon.a (mon.0) 2173 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[22670]: cluster 2024-09-17T08:59:01.691622+0000 mon.a (mon.0) 2174 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: audit 2024-09-17T08:59:00.696199+0000 mon.a (mon.0) 2169 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: cluster 2024-09-17T08:59:00.879382+0000 mgr.y (mgr.14532) 301 : cluster [DBG] pgmap v386: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 536 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: audit 2024-09-17T08:59:01.136413+0000 mon.a (mon.0) 2170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: cluster 2024-09-17T08:59:01.136638+0000 mon.a (mon.0) 2171 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: audit 2024-09-17T08:59:01.137697+0000 mon.c (mon.2) 262 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: audit 2024-09-17T08:59:01.138517+0000 mon.a (mon.0) 2172 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-35", "mode": "writeback"}]: dispatch 2024-09-17T08:59:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: audit 2024-09-17T08:59:01.139057+0000 mon.a (mon.0) 2173 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:02 smithi078 bash[32124]: cluster 2024-09-17T08:59:01.691622+0000 mon.a (mon.0) 2174 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:03.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:03 smithi136 bash[24812]: audit 2024-09-17T08:59:01.707212+0000 mon.a (mon.0) 2175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:03.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:03 smithi136 bash[24812]: audit 2024-09-17T08:59:01.707535+0000 mon.a (mon.0) 2176 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-35", "mode": "writeback"}]': finished 2024-09-17T08:59:03.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:03 smithi136 bash[24812]: cluster 2024-09-17T08:59:02.139631+0000 mon.a (mon.0) 2177 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-09-17T08:59:03.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:03 smithi136 bash[24812]: cluster 2024-09-17T08:59:02.552984+0000 mon.a (mon.0) 2178 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:03.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:03 smithi136 bash[24812]: audit 2024-09-17T08:59:02.712135+0000 mon.a (mon.0) 2179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:03.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:03 smithi136 bash[24812]: cluster 2024-09-17T08:59:02.712770+0000 mon.a (mon.0) 2180 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-09-17T08:59:03.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:03 smithi136 bash[24812]: cluster 2024-09-17T08:59:02.881583+0000 mgr.y (mgr.14532) 302 : cluster [DBG] pgmap v389: 244 pgs: 8 creating+peering, 236 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T08:59:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[32124]: audit 2024-09-17T08:59:01.707212+0000 mon.a (mon.0) 2175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[32124]: audit 2024-09-17T08:59:01.707535+0000 mon.a (mon.0) 2176 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-35", "mode": "writeback"}]': finished 2024-09-17T08:59:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[32124]: cluster 2024-09-17T08:59:02.139631+0000 mon.a (mon.0) 2177 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-09-17T08:59:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[32124]: cluster 2024-09-17T08:59:02.552984+0000 mon.a (mon.0) 2178 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[32124]: audit 2024-09-17T08:59:02.712135+0000 mon.a (mon.0) 2179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[32124]: cluster 2024-09-17T08:59:02.712770+0000 mon.a (mon.0) 2180 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[32124]: cluster 2024-09-17T08:59:02.881583+0000 mgr.y (mgr.14532) 302 : cluster [DBG] pgmap v389: 244 pgs: 8 creating+peering, 236 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[22670]: audit 2024-09-17T08:59:01.707212+0000 mon.a (mon.0) 2175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi078-64680-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[22670]: audit 2024-09-17T08:59:01.707535+0000 mon.a (mon.0) 2176 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-35", "mode": "writeback"}]': finished 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[22670]: cluster 2024-09-17T08:59:02.139631+0000 mon.a (mon.0) 2177 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[22670]: cluster 2024-09-17T08:59:02.552984+0000 mon.a (mon.0) 2178 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[22670]: audit 2024-09-17T08:59:02.712135+0000 mon.a (mon.0) 2179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi078-64688-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[22670]: cluster 2024-09-17T08:59:02.712770+0000 mon.a (mon.0) 2180 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-09-17T08:59:03.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:03 smithi078 bash[22670]: cluster 2024-09-17T08:59:02.881583+0000 mgr.y (mgr.14532) 302 : cluster [DBG] pgmap v389: 244 pgs: 8 creating+peering, 236 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T08:59:05.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:04 smithi136 bash[24812]: cluster 2024-09-17T08:59:03.713488+0000 mon.a (mon.0) 2181 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-09-17T08:59:05.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:04 smithi136 bash[24812]: audit 2024-09-17T08:59:03.720725+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:05.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:04 smithi136 bash[24812]: audit 2024-09-17T08:59:03.735286+0000 mon.a (mon.0) 2182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:05.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:04 smithi136 bash[24812]: audit 2024-09-17T08:59:03.819678+0000 mon.a (mon.0) 2183 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[32124]: cluster 2024-09-17T08:59:03.713488+0000 mon.a (mon.0) 2181 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[32124]: audit 2024-09-17T08:59:03.720725+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[32124]: audit 2024-09-17T08:59:03.735286+0000 mon.a (mon.0) 2182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[32124]: audit 2024-09-17T08:59:03.819678+0000 mon.a (mon.0) 2183 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[22670]: cluster 2024-09-17T08:59:03.713488+0000 mon.a (mon.0) 2181 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[22670]: audit 2024-09-17T08:59:03.720725+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[22670]: audit 2024-09-17T08:59:03.735286+0000 mon.a (mon.0) 2182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:05.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:04 smithi078 bash[22670]: audit 2024-09-17T08:59:03.819678+0000 mon.a (mon.0) 2183 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:05.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7039 ms) 2024-09-17T08:59:05.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-09-17T08:59:05.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6984 ms) 2024-09-17T08:59:05.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-09-17T08:59:05.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7021 ms) 2024-09-17T08:59:05.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-09-17T08:59:05.753 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6998 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7052 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7029 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7090 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7035 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6787 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7518 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7047 ms) 2024-09-17T08:59:05.754 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6898 ms) 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6997 ms) 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7044 ms) 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6615 ms) 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7069 ms) 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112224 ms total) 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: 2024-09-17T08:59:05.755 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [----------] Global test environment tear-down 2024-09-17T08:59:05.756 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (206101 ms total) 2024-09-17T08:59:05.756 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio: [ PASSED ] 42 tests. 2024-09-17T08:59:06.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: audit 2024-09-17T08:59:04.735287+0000 mon.a (mon.0) 2184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:06.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: audit 2024-09-17T08:59:04.735578+0000 mon.a (mon.0) 2185 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:06.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: cluster 2024-09-17T08:59:04.735726+0000 mon.a (mon.0) 2186 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-09-17T08:59:06.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: audit 2024-09-17T08:59:04.739639+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:06.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: audit 2024-09-17T08:59:04.740017+0000 mon.c (mon.2) 263 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:06.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: audit 2024-09-17T08:59:04.740318+0000 mon.b (mon.1) 79 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:06.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: audit 2024-09-17T08:59:04.741045+0000 mon.a (mon.0) 2188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:06.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: audit 2024-09-17T08:59:04.744643+0000 mon.a (mon.0) 2189 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:06.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:05 smithi136 bash[24812]: cluster 2024-09-17T08:59:04.882447+0000 mgr.y (mgr.14532) 303 : cluster [DBG] pgmap v392: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: audit 2024-09-17T08:59:04.735287+0000 mon.a (mon.0) 2184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: audit 2024-09-17T08:59:04.735578+0000 mon.a (mon.0) 2185 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: cluster 2024-09-17T08:59:04.735726+0000 mon.a (mon.0) 2186 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: audit 2024-09-17T08:59:04.739639+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: audit 2024-09-17T08:59:04.740017+0000 mon.c (mon.2) 263 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: audit 2024-09-17T08:59:04.740318+0000 mon.b (mon.1) 79 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: audit 2024-09-17T08:59:04.741045+0000 mon.a (mon.0) 2188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: audit 2024-09-17T08:59:04.744643+0000 mon.a (mon.0) 2189 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:06.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[32124]: cluster 2024-09-17T08:59:04.882447+0000 mgr.y (mgr.14532) 303 : cluster [DBG] pgmap v392: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: audit 2024-09-17T08:59:04.735287+0000 mon.a (mon.0) 2184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: audit 2024-09-17T08:59:04.735578+0000 mon.a (mon.0) 2185 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: cluster 2024-09-17T08:59:04.735726+0000 mon.a (mon.0) 2186 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: audit 2024-09-17T08:59:04.739639+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: audit 2024-09-17T08:59:04.740017+0000 mon.c (mon.2) 263 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: audit 2024-09-17T08:59:04.740318+0000 mon.b (mon.1) 79 : audit [INF] from='client.? 172.21.15.78:0/2757835193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]: dispatch 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: audit 2024-09-17T08:59:04.741045+0000 mon.a (mon.0) 2188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: audit 2024-09-17T08:59:04.744643+0000 mon.a (mon.0) 2189 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:05 smithi078 bash[22670]: cluster 2024-09-17T08:59:04.882447+0000 mgr.y (mgr.14532) 303 : cluster [DBG] pgmap v392: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T08:59:07.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:06 smithi136 bash[24812]: audit 2024-09-17T08:59:05.747965+0000 mon.a (mon.0) 2190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:07.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:06 smithi136 bash[24812]: audit 2024-09-17T08:59:05.748460+0000 mon.a (mon.0) 2191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:07.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:06 smithi136 bash[24812]: audit 2024-09-17T08:59:05.748642+0000 mon.a (mon.0) 2192 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:07.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:06 smithi136 bash[24812]: cluster 2024-09-17T08:59:05.748809+0000 mon.a (mon.0) 2193 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-09-17T08:59:07.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:06 smithi136 bash[24812]: audit 2024-09-17T08:59:05.751834+0000 mon.c (mon.2) 264 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:07.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:06 smithi136 bash[24812]: audit 2024-09-17T08:59:05.753157+0000 mon.a (mon.0) 2194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:07.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[32124]: audit 2024-09-17T08:59:05.747965+0000 mon.a (mon.0) 2190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:07.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[32124]: audit 2024-09-17T08:59:05.748460+0000 mon.a (mon.0) 2191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:07.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[32124]: audit 2024-09-17T08:59:05.748642+0000 mon.a (mon.0) 2192 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:07.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[32124]: cluster 2024-09-17T08:59:05.748809+0000 mon.a (mon.0) 2193 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-09-17T08:59:07.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[32124]: audit 2024-09-17T08:59:05.751834+0000 mon.c (mon.2) 264 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:07.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[32124]: audit 2024-09-17T08:59:05.753157+0000 mon.a (mon.0) 2194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:07.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[22670]: audit 2024-09-17T08:59:05.747965+0000 mon.a (mon.0) 2190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi078-64680-42"}]': finished 2024-09-17T08:59:07.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[22670]: audit 2024-09-17T08:59:05.748460+0000 mon.a (mon.0) 2191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:07.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[22670]: audit 2024-09-17T08:59:05.748642+0000 mon.a (mon.0) 2192 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:07.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[22670]: cluster 2024-09-17T08:59:05.748809+0000 mon.a (mon.0) 2193 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-09-17T08:59:07.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[22670]: audit 2024-09-17T08:59:05.751834+0000 mon.c (mon.2) 264 : audit [INF] from='client.? 172.21.15.78:0/576725339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:07.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:06 smithi078 bash[22670]: audit 2024-09-17T08:59:05.753157+0000 mon.a (mon.0) 2194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]: dispatch 2024-09-17T08:59:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:07 smithi136 bash[24812]: audit 2024-09-17T08:59:06.755534+0000 mon.a (mon.0) 2195 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:07 smithi136 bash[24812]: cluster 2024-09-17T08:59:06.755728+0000 mon.a (mon.0) 2196 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-09-17T08:59:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:07 smithi136 bash[24812]: audit 2024-09-17T08:59:06.814886+0000 mon.a (mon.0) 2197 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:07 smithi136 bash[24812]: audit 2024-09-17T08:59:06.816705+0000 mon.a (mon.0) 2198 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:08.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:07 smithi136 bash[24812]: audit 2024-09-17T08:59:06.817253+0000 mon.a (mon.0) 2199 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:08.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:07 smithi136 bash[24812]: audit 2024-09-17T08:59:06.828645+0000 mon.a (mon.0) 2200 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:08.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:07 smithi136 bash[24812]: cluster 2024-09-17T08:59:06.883311+0000 mgr.y (mgr.14532) 304 : cluster [DBG] pgmap v395: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:08.101 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:59:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:59:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22670]: audit 2024-09-17T08:59:06.755534+0000 mon.a (mon.0) 2195 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22670]: cluster 2024-09-17T08:59:06.755728+0000 mon.a (mon.0) 2196 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-09-17T08:59:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22670]: audit 2024-09-17T08:59:06.814886+0000 mon.a (mon.0) 2197 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22670]: audit 2024-09-17T08:59:06.816705+0000 mon.a (mon.0) 2198 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22670]: audit 2024-09-17T08:59:06.817253+0000 mon.a (mon.0) 2199 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22670]: audit 2024-09-17T08:59:06.828645+0000 mon.a (mon.0) 2200 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:08.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[22670]: cluster 2024-09-17T08:59:06.883311+0000 mgr.y (mgr.14532) 304 : cluster [DBG] pgmap v395: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:08.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[32124]: audit 2024-09-17T08:59:06.755534+0000 mon.a (mon.0) 2195 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi078-64688-52"}]': finished 2024-09-17T08:59:08.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[32124]: cluster 2024-09-17T08:59:06.755728+0000 mon.a (mon.0) 2196 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-09-17T08:59:08.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[32124]: audit 2024-09-17T08:59:06.814886+0000 mon.a (mon.0) 2197 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:08.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[32124]: audit 2024-09-17T08:59:06.816705+0000 mon.a (mon.0) 2198 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:08.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[32124]: audit 2024-09-17T08:59:06.817253+0000 mon.a (mon.0) 2199 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:08.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[32124]: audit 2024-09-17T08:59:06.828645+0000 mon.a (mon.0) 2200 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:08.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:07 smithi078 bash[32124]: cluster 2024-09-17T08:59:06.883311+0000 mgr.y (mgr.14532) 304 : cluster [DBG] pgmap v395: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:09.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:09 smithi136 bash[24812]: audit 2024-09-17T08:59:07.779069+0000 mon.a (mon.0) 2201 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:09.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:09 smithi136 bash[24812]: audit 2024-09-17T08:59:07.779283+0000 mon.a (mon.0) 2202 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:09.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:09 smithi136 bash[24812]: cluster 2024-09-17T08:59:07.779425+0000 mon.a (mon.0) 2203 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-09-17T08:59:09.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:09 smithi136 bash[24812]: audit 2024-09-17T08:59:07.781326+0000 mon.a (mon.0) 2204 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi078-64688-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:09.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:09 smithi136 bash[24812]: audit 2024-09-17T08:59:07.782193+0000 mon.a (mon.0) 2205 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[22670]: audit 2024-09-17T08:59:07.779069+0000 mon.a (mon.0) 2201 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[22670]: audit 2024-09-17T08:59:07.779283+0000 mon.a (mon.0) 2202 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[22670]: cluster 2024-09-17T08:59:07.779425+0000 mon.a (mon.0) 2203 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-09-17T08:59:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[22670]: audit 2024-09-17T08:59:07.781326+0000 mon.a (mon.0) 2204 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi078-64688-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[22670]: audit 2024-09-17T08:59:07.782193+0000 mon.a (mon.0) 2205 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[32124]: audit 2024-09-17T08:59:07.779069+0000 mon.a (mon.0) 2201 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[32124]: audit 2024-09-17T08:59:07.779283+0000 mon.a (mon.0) 2202 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[32124]: cluster 2024-09-17T08:59:07.779425+0000 mon.a (mon.0) 2203 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-09-17T08:59:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[32124]: audit 2024-09-17T08:59:07.781326+0000 mon.a (mon.0) 2204 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi078-64688-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:09 smithi078 bash[32124]: audit 2024-09-17T08:59:07.782193+0000 mon.a (mon.0) 2205 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35"}]: dispatch 2024-09-17T08:59:09.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:59:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:59:10.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:10 smithi136 bash[24812]: cluster 2024-09-17T08:59:08.770823+0000 mon.a (mon.0) 2206 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:10.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:10 smithi136 bash[24812]: cluster 2024-09-17T08:59:08.884078+0000 mgr.y (mgr.14532) 305 : cluster [DBG] pgmap v398: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-17T08:59:10.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:10 smithi136 bash[24812]: audit 2024-09-17T08:59:09.223889+0000 mon.a (mon.0) 2207 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:10.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:10 smithi136 bash[24812]: cluster 2024-09-17T08:59:09.223975+0000 mon.a (mon.0) 2208 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-09-17T08:59:10.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:10 smithi136 bash[24812]: audit 2024-09-17T08:59:09.797527+0000 mon.a (mon.0) 2209 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi078-64688-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:10.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:10 smithi136 bash[24812]: cluster 2024-09-17T08:59:09.797888+0000 mon.a (mon.0) 2210 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-09-17T08:59:10.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[22670]: cluster 2024-09-17T08:59:08.770823+0000 mon.a (mon.0) 2206 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[22670]: cluster 2024-09-17T08:59:08.884078+0000 mgr.y (mgr.14532) 305 : cluster [DBG] pgmap v398: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[22670]: audit 2024-09-17T08:59:09.223889+0000 mon.a (mon.0) 2207 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[22670]: cluster 2024-09-17T08:59:09.223975+0000 mon.a (mon.0) 2208 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[22670]: audit 2024-09-17T08:59:09.797527+0000 mon.a (mon.0) 2209 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi078-64688-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[22670]: cluster 2024-09-17T08:59:09.797888+0000 mon.a (mon.0) 2210 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[32124]: cluster 2024-09-17T08:59:08.770823+0000 mon.a (mon.0) 2206 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[32124]: cluster 2024-09-17T08:59:08.884078+0000 mgr.y (mgr.14532) 305 : cluster [DBG] pgmap v398: 228 pgs: 228 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[32124]: audit 2024-09-17T08:59:09.223889+0000 mon.a (mon.0) 2207 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-35"}]': finished 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[32124]: cluster 2024-09-17T08:59:09.223975+0000 mon.a (mon.0) 2208 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[32124]: audit 2024-09-17T08:59:09.797527+0000 mon.a (mon.0) 2209 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi078-64688-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:10 smithi078 bash[32124]: cluster 2024-09-17T08:59:09.797888+0000 mon.a (mon.0) 2210 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-09-17T08:59:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:11 smithi136 bash[24812]: audit 2024-09-17T08:59:09.478321+0000 mgr.y (mgr.14532) 306 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:11 smithi136 bash[24812]: audit 2024-09-17T08:59:10.262196+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:59:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:11 smithi136 bash[24812]: audit 2024-09-17T08:59:10.264112+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:11 smithi136 bash[24812]: cluster 2024-09-17T08:59:10.795768+0000 mon.a (mon.0) 2213 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-09-17T08:59:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:11 smithi136 bash[24812]: audit 2024-09-17T08:59:10.806550+0000 mon.a (mon.0) 2214 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:11 smithi136 bash[24812]: cluster 2024-09-17T08:59:10.884947+0000 mgr.y (mgr.14532) 307 : cluster [DBG] pgmap v401: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:59:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[22670]: audit 2024-09-17T08:59:09.478321+0000 mgr.y (mgr.14532) 306 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[22670]: audit 2024-09-17T08:59:10.262196+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:59:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[22670]: audit 2024-09-17T08:59:10.264112+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[22670]: cluster 2024-09-17T08:59:10.795768+0000 mon.a (mon.0) 2213 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-09-17T08:59:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[22670]: audit 2024-09-17T08:59:10.806550+0000 mon.a (mon.0) 2214 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[22670]: cluster 2024-09-17T08:59:10.884947+0000 mgr.y (mgr.14532) 307 : cluster [DBG] pgmap v401: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:59:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[32124]: audit 2024-09-17T08:59:09.478321+0000 mgr.y (mgr.14532) 306 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[32124]: audit 2024-09-17T08:59:10.262196+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:59:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[32124]: audit 2024-09-17T08:59:10.264112+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[32124]: cluster 2024-09-17T08:59:10.795768+0000 mon.a (mon.0) 2213 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-09-17T08:59:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[32124]: audit 2024-09-17T08:59:10.806550+0000 mon.a (mon.0) 2214 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:11 smithi078 bash[32124]: cluster 2024-09-17T08:59:10.884947+0000 mgr.y (mgr.14532) 307 : cluster [DBG] pgmap v401: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T08:59:12.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:12 smithi136 bash[24812]: cluster 2024-09-17T08:59:11.787702+0000 mon.a (mon.0) 2215 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:12.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:12 smithi136 bash[24812]: audit 2024-09-17T08:59:11.806953+0000 mon.a (mon.0) 2216 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:12.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:12 smithi136 bash[24812]: cluster 2024-09-17T08:59:11.807362+0000 mon.a (mon.0) 2217 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-09-17T08:59:12.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:12 smithi136 bash[24812]: audit 2024-09-17T08:59:11.818509+0000 mon.a (mon.0) 2218 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:12.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:12 smithi136 bash[24812]: audit 2024-09-17T08:59:11.819230+0000 mon.a (mon.0) 2219 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[22670]: cluster 2024-09-17T08:59:11.787702+0000 mon.a (mon.0) 2215 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[22670]: audit 2024-09-17T08:59:11.806953+0000 mon.a (mon.0) 2216 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[22670]: cluster 2024-09-17T08:59:11.807362+0000 mon.a (mon.0) 2217 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-09-17T08:59:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[22670]: audit 2024-09-17T08:59:11.818509+0000 mon.a (mon.0) 2218 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[22670]: audit 2024-09-17T08:59:11.819230+0000 mon.a (mon.0) 2219 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:12.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[32124]: cluster 2024-09-17T08:59:11.787702+0000 mon.a (mon.0) 2215 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:12.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[32124]: audit 2024-09-17T08:59:11.806953+0000 mon.a (mon.0) 2216 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[32124]: cluster 2024-09-17T08:59:11.807362+0000 mon.a (mon.0) 2217 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-09-17T08:59:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[32124]: audit 2024-09-17T08:59:11.818509+0000 mon.a (mon.0) 2218 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:12 smithi078 bash[32124]: audit 2024-09-17T08:59:11.819230+0000 mon.a (mon.0) 2219 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[22670]: audit 2024-09-17T08:59:12.571365+0000 mon.a (mon.0) 2220 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[22670]: audit 2024-09-17T08:59:12.571583+0000 mon.a (mon.0) 2221 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[22670]: cluster 2024-09-17T08:59:12.571742+0000 mon.a (mon.0) 2222 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-09-17T08:59:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[22670]: audit 2024-09-17T08:59:12.574849+0000 mon.a (mon.0) 2223 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-37"}]: dispatch 2024-09-17T08:59:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[22670]: audit 2024-09-17T08:59:12.575499+0000 mon.a (mon.0) 2224 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[22670]: cluster 2024-09-17T08:59:12.886981+0000 mgr.y (mgr.14532) 308 : cluster [DBG] pgmap v404: 228 pgs: 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-17T08:59:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[32124]: audit 2024-09-17T08:59:12.571365+0000 mon.a (mon.0) 2220 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[32124]: audit 2024-09-17T08:59:12.571583+0000 mon.a (mon.0) 2221 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[32124]: cluster 2024-09-17T08:59:12.571742+0000 mon.a (mon.0) 2222 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-09-17T08:59:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[32124]: audit 2024-09-17T08:59:12.574849+0000 mon.a (mon.0) 2223 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-37"}]: dispatch 2024-09-17T08:59:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[32124]: audit 2024-09-17T08:59:12.575499+0000 mon.a (mon.0) 2224 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:13.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:13 smithi078 bash[32124]: cluster 2024-09-17T08:59:12.886981+0000 mgr.y (mgr.14532) 308 : cluster [DBG] pgmap v404: 228 pgs: 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-17T08:59:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:13 smithi136 bash[24812]: audit 2024-09-17T08:59:12.571365+0000 mon.a (mon.0) 2220 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:13 smithi136 bash[24812]: audit 2024-09-17T08:59:12.571583+0000 mon.a (mon.0) 2221 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:13 smithi136 bash[24812]: cluster 2024-09-17T08:59:12.571742+0000 mon.a (mon.0) 2222 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-09-17T08:59:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:13 smithi136 bash[24812]: audit 2024-09-17T08:59:12.574849+0000 mon.a (mon.0) 2223 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-37"}]: dispatch 2024-09-17T08:59:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:13 smithi136 bash[24812]: audit 2024-09-17T08:59:12.575499+0000 mon.a (mon.0) 2224 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]: dispatch 2024-09-17T08:59:14.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:13 smithi136 bash[24812]: cluster 2024-09-17T08:59:12.886981+0000 mgr.y (mgr.14532) 308 : cluster [DBG] pgmap v404: 228 pgs: 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.576896+0000 mon.a (mon.0) 2225 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-37"}]': finished 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.577316+0000 mon.a (mon.0) 2226 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: cluster 2024-09-17T08:59:13.577525+0000 mon.a (mon.0) 2227 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.581444+0000 mon.a (mon.0) 2228 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-37", "mode": "writeback"}]: dispatch 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.613968+0000 mon.c (mon.2) 265 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.614342+0000 mon.a (mon.0) 2229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.615109+0000 mon.c (mon.2) 266 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.615466+0000 mon.a (mon.0) 2230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.615989+0000 mon.c (mon.2) 267 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: audit 2024-09-17T08:59:13.616322+0000 mon.a (mon.0) 2231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[22670]: cluster 2024-09-17T08:59:14.568850+0000 mon.a (mon.0) 2232 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.576896+0000 mon.a (mon.0) 2225 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-37"}]': finished 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.577316+0000 mon.a (mon.0) 2226 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: cluster 2024-09-17T08:59:13.577525+0000 mon.a (mon.0) 2227 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.581444+0000 mon.a (mon.0) 2228 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-37", "mode": "writeback"}]: dispatch 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.613968+0000 mon.c (mon.2) 265 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.614342+0000 mon.a (mon.0) 2229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.615109+0000 mon.c (mon.2) 266 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.615466+0000 mon.a (mon.0) 2230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:14.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.615989+0000 mon.c (mon.2) 267 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: audit 2024-09-17T08:59:13.616322+0000 mon.a (mon.0) 2231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:14.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:14 smithi078 bash[32124]: cluster 2024-09-17T08:59:14.568850+0000 mon.a (mon.0) 2232 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:15.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.576896+0000 mon.a (mon.0) 2225 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-37"}]': finished 2024-09-17T08:59:15.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.577316+0000 mon.a (mon.0) 2226 : audit [INF] from='client.? 172.21.15.78:0/3839807104' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi078-64688-53"}]': finished 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: cluster 2024-09-17T08:59:13.577525+0000 mon.a (mon.0) 2227 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.581444+0000 mon.a (mon.0) 2228 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-37", "mode": "writeback"}]: dispatch 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.613968+0000 mon.c (mon.2) 265 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.614342+0000 mon.a (mon.0) 2229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.615109+0000 mon.c (mon.2) 266 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.615466+0000 mon.a (mon.0) 2230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.615989+0000 mon.c (mon.2) 267 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: audit 2024-09-17T08:59:13.616322+0000 mon.a (mon.0) 2231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:15.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:14 smithi136 bash[24812]: cluster 2024-09-17T08:59:14.568850+0000 mon.a (mon.0) 2232 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:16 smithi136 bash[24812]: audit 2024-09-17T08:59:14.581451+0000 mon.a (mon.0) 2233 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-37", "mode": "writeback"}]': finished 2024-09-17T08:59:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:16 smithi136 bash[24812]: audit 2024-09-17T08:59:14.581698+0000 mon.a (mon.0) 2234 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:16 smithi136 bash[24812]: cluster 2024-09-17T08:59:14.581939+0000 mon.a (mon.0) 2235 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-09-17T08:59:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:16 smithi136 bash[24812]: audit 2024-09-17T08:59:14.585708+0000 mon.c (mon.2) 268 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:16 smithi136 bash[24812]: audit 2024-09-17T08:59:14.586849+0000 mon.a (mon.0) 2236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:16 smithi136 bash[24812]: audit 2024-09-17T08:59:14.668043+0000 mon.a (mon.0) 2237 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:16.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:16 smithi136 bash[24812]: cluster 2024-09-17T08:59:14.887734+0000 mgr.y (mgr.14532) 309 : cluster [DBG] pgmap v407: 228 pgs: 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[32124]: audit 2024-09-17T08:59:14.581451+0000 mon.a (mon.0) 2233 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-37", "mode": "writeback"}]': finished 2024-09-17T08:59:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[32124]: audit 2024-09-17T08:59:14.581698+0000 mon.a (mon.0) 2234 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[32124]: cluster 2024-09-17T08:59:14.581939+0000 mon.a (mon.0) 2235 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-09-17T08:59:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[32124]: audit 2024-09-17T08:59:14.585708+0000 mon.c (mon.2) 268 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[32124]: audit 2024-09-17T08:59:14.586849+0000 mon.a (mon.0) 2236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[32124]: audit 2024-09-17T08:59:14.668043+0000 mon.a (mon.0) 2237 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:16.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[32124]: cluster 2024-09-17T08:59:14.887734+0000 mgr.y (mgr.14532) 309 : cluster [DBG] pgmap v407: 228 pgs: 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[22670]: audit 2024-09-17T08:59:14.581451+0000 mon.a (mon.0) 2233 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-37", "mode": "writeback"}]': finished 2024-09-17T08:59:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[22670]: audit 2024-09-17T08:59:14.581698+0000 mon.a (mon.0) 2234 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi078-64688-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[22670]: cluster 2024-09-17T08:59:14.581939+0000 mon.a (mon.0) 2235 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-09-17T08:59:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[22670]: audit 2024-09-17T08:59:14.585708+0000 mon.c (mon.2) 268 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[22670]: audit 2024-09-17T08:59:14.586849+0000 mon.a (mon.0) 2236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[22670]: audit 2024-09-17T08:59:14.668043+0000 mon.a (mon.0) 2237 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:16 smithi078 bash[22670]: cluster 2024-09-17T08:59:14.887734+0000 mgr.y (mgr.14532) 309 : cluster [DBG] pgmap v407: 228 pgs: 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:17 smithi136 bash[24812]: audit 2024-09-17T08:59:16.025106+0000 mon.a (mon.0) 2238 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:17 smithi136 bash[24812]: cluster 2024-09-17T08:59:16.025290+0000 mon.a (mon.0) 2239 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-09-17T08:59:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:17 smithi136 bash[24812]: audit 2024-09-17T08:59:16.026255+0000 mon.a (mon.0) 2240 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37"}]: dispatch 2024-09-17T08:59:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:17 smithi136 bash[24812]: cluster 2024-09-17T08:59:16.575117+0000 mon.a (mon.0) 2241 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:17 smithi136 bash[24812]: audit 2024-09-17T08:59:16.585645+0000 mon.a (mon.0) 2242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:17 smithi136 bash[24812]: audit 2024-09-17T08:59:16.585962+0000 mon.a (mon.0) 2243 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37"}]': finished 2024-09-17T08:59:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:17 smithi136 bash[24812]: cluster 2024-09-17T08:59:16.586139+0000 mon.a (mon.0) 2244 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-09-17T08:59:17.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[32124]: audit 2024-09-17T08:59:16.025106+0000 mon.a (mon.0) 2238 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:17.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[32124]: cluster 2024-09-17T08:59:16.025290+0000 mon.a (mon.0) 2239 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-09-17T08:59:17.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[32124]: audit 2024-09-17T08:59:16.026255+0000 mon.a (mon.0) 2240 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37"}]: dispatch 2024-09-17T08:59:17.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[32124]: cluster 2024-09-17T08:59:16.575117+0000 mon.a (mon.0) 2241 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:17.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[32124]: audit 2024-09-17T08:59:16.585645+0000 mon.a (mon.0) 2242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:17.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[32124]: audit 2024-09-17T08:59:16.585962+0000 mon.a (mon.0) 2243 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37"}]': finished 2024-09-17T08:59:17.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[32124]: cluster 2024-09-17T08:59:16.586139+0000 mon.a (mon.0) 2244 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-09-17T08:59:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22670]: audit 2024-09-17T08:59:16.025106+0000 mon.a (mon.0) 2238 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22670]: cluster 2024-09-17T08:59:16.025290+0000 mon.a (mon.0) 2239 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-09-17T08:59:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22670]: audit 2024-09-17T08:59:16.026255+0000 mon.a (mon.0) 2240 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37"}]: dispatch 2024-09-17T08:59:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22670]: cluster 2024-09-17T08:59:16.575117+0000 mon.a (mon.0) 2241 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22670]: audit 2024-09-17T08:59:16.585645+0000 mon.a (mon.0) 2242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi078-64688-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22670]: audit 2024-09-17T08:59:16.585962+0000 mon.a (mon.0) 2243 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-37"}]': finished 2024-09-17T08:59:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22670]: cluster 2024-09-17T08:59:16.586139+0000 mon.a (mon.0) 2244 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-09-17T08:59:18.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:59:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:59:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:59:18.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:18 smithi078 bash[32124]: cluster 2024-09-17T08:59:16.888500+0000 mgr.y (mgr.14532) 310 : cluster [DBG] pgmap v410: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:18.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:18 smithi078 bash[32124]: cluster 2024-09-17T08:59:17.564330+0000 mon.a (mon.0) 2245 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:18.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:18 smithi078 bash[32124]: cluster 2024-09-17T08:59:17.593116+0000 mon.a (mon.0) 2246 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-09-17T08:59:18.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:18 smithi078 bash[22670]: cluster 2024-09-17T08:59:16.888500+0000 mgr.y (mgr.14532) 310 : cluster [DBG] pgmap v410: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:18.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:18 smithi078 bash[22670]: cluster 2024-09-17T08:59:17.564330+0000 mon.a (mon.0) 2245 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:18.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:18 smithi078 bash[22670]: cluster 2024-09-17T08:59:17.593116+0000 mon.a (mon.0) 2246 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-09-17T08:59:18.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:18 smithi136 bash[24812]: cluster 2024-09-17T08:59:16.888500+0000 mgr.y (mgr.14532) 310 : cluster [DBG] pgmap v410: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:18.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:18 smithi136 bash[24812]: cluster 2024-09-17T08:59:17.564330+0000 mon.a (mon.0) 2245 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:18.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:18 smithi136 bash[24812]: cluster 2024-09-17T08:59:17.593116+0000 mon.a (mon.0) 2246 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-09-17T08:59:19.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:59:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:59:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:19 smithi136 bash[24812]: cluster 2024-09-17T08:59:18.600762+0000 mon.a (mon.0) 2247 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-09-17T08:59:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:19 smithi136 bash[24812]: audit 2024-09-17T08:59:18.604034+0000 mon.c (mon.2) 269 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:19 smithi136 bash[24812]: audit 2024-09-17T08:59:18.613544+0000 mon.a (mon.0) 2248 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:19 smithi136 bash[24812]: audit 2024-09-17T08:59:18.613921+0000 mon.a (mon.0) 2249 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:19 smithi136 bash[24812]: cluster 2024-09-17T08:59:18.889340+0000 mgr.y (mgr.14532) 311 : cluster [DBG] pgmap v413: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[32124]: cluster 2024-09-17T08:59:18.600762+0000 mon.a (mon.0) 2247 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[32124]: audit 2024-09-17T08:59:18.604034+0000 mon.c (mon.2) 269 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[32124]: audit 2024-09-17T08:59:18.613544+0000 mon.a (mon.0) 2248 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[32124]: audit 2024-09-17T08:59:18.613921+0000 mon.a (mon.0) 2249 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[32124]: cluster 2024-09-17T08:59:18.889340+0000 mgr.y (mgr.14532) 311 : cluster [DBG] pgmap v413: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[22670]: cluster 2024-09-17T08:59:18.600762+0000 mon.a (mon.0) 2247 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[22670]: audit 2024-09-17T08:59:18.604034+0000 mon.c (mon.2) 269 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[22670]: audit 2024-09-17T08:59:18.613544+0000 mon.a (mon.0) 2248 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[22670]: audit 2024-09-17T08:59:18.613921+0000 mon.a (mon.0) 2249 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:19 smithi078 bash[22670]: cluster 2024-09-17T08:59:18.889340+0000 mgr.y (mgr.14532) 311 : cluster [DBG] pgmap v413: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[22670]: audit 2024-09-17T08:59:19.489621+0000 mgr.y (mgr.14532) 312 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[22670]: audit 2024-09-17T08:59:19.608875+0000 mon.a (mon.0) 2250 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[22670]: audit 2024-09-17T08:59:19.609298+0000 mon.a (mon.0) 2251 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[22670]: cluster 2024-09-17T08:59:19.609527+0000 mon.a (mon.0) 2252 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[22670]: audit 2024-09-17T08:59:19.614586+0000 mon.c (mon.2) 270 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[22670]: audit 2024-09-17T08:59:19.620312+0000 mon.a (mon.0) 2253 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[22670]: audit 2024-09-17T08:59:19.623808+0000 mon.a (mon.0) 2254 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[32124]: audit 2024-09-17T08:59:19.489621+0000 mgr.y (mgr.14532) 312 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[32124]: audit 2024-09-17T08:59:19.608875+0000 mon.a (mon.0) 2250 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[32124]: audit 2024-09-17T08:59:19.609298+0000 mon.a (mon.0) 2251 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[32124]: cluster 2024-09-17T08:59:19.609527+0000 mon.a (mon.0) 2252 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-09-17T08:59:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[32124]: audit 2024-09-17T08:59:19.614586+0000 mon.c (mon.2) 270 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[32124]: audit 2024-09-17T08:59:19.620312+0000 mon.a (mon.0) 2253 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:20 smithi078 bash[32124]: audit 2024-09-17T08:59:19.623808+0000 mon.a (mon.0) 2254 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:20 smithi136 bash[24812]: audit 2024-09-17T08:59:19.489621+0000 mgr.y (mgr.14532) 312 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:20 smithi136 bash[24812]: audit 2024-09-17T08:59:19.608875+0000 mon.a (mon.0) 2250 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:20 smithi136 bash[24812]: audit 2024-09-17T08:59:19.609298+0000 mon.a (mon.0) 2251 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:20 smithi136 bash[24812]: cluster 2024-09-17T08:59:19.609527+0000 mon.a (mon.0) 2252 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-09-17T08:59:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:20 smithi136 bash[24812]: audit 2024-09-17T08:59:19.614586+0000 mon.c (mon.2) 270 : audit [INF] from='client.? 172.21.15.78:0/1385801306' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:21.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:20 smithi136 bash[24812]: audit 2024-09-17T08:59:19.620312+0000 mon.a (mon.0) 2253 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]: dispatch 2024-09-17T08:59:21.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:20 smithi136 bash[24812]: audit 2024-09-17T08:59:19.623808+0000 mon.a (mon.0) 2254 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: audit 2024-09-17T08:59:20.618465+0000 mon.a (mon.0) 2255 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: audit 2024-09-17T08:59:20.618694+0000 mon.a (mon.0) 2256 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: cluster 2024-09-17T08:59:20.618863+0000 mon.a (mon.0) 2257 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-09-17T08:59:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: audit 2024-09-17T08:59:20.625970+0000 mon.a (mon.0) 2258 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-39"}]: dispatch 2024-09-17T08:59:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: audit 2024-09-17T08:59:20.646147+0000 mon.a (mon.0) 2259 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: audit 2024-09-17T08:59:20.647758+0000 mon.a (mon.0) 2260 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:22.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: audit 2024-09-17T08:59:20.648184+0000 mon.a (mon.0) 2261 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi078-64688-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:22.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: cluster 2024-09-17T08:59:20.890138+0000 mgr.y (mgr.14532) 313 : cluster [DBG] pgmap v416: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:22.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:21 smithi136 bash[24812]: audit 2024-09-17T08:59:21.381654+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: audit 2024-09-17T08:59:20.618465+0000 mon.a (mon.0) 2255 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: audit 2024-09-17T08:59:20.618694+0000 mon.a (mon.0) 2256 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: cluster 2024-09-17T08:59:20.618863+0000 mon.a (mon.0) 2257 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: audit 2024-09-17T08:59:20.625970+0000 mon.a (mon.0) 2258 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-39"}]: dispatch 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: audit 2024-09-17T08:59:20.646147+0000 mon.a (mon.0) 2259 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: audit 2024-09-17T08:59:20.647758+0000 mon.a (mon.0) 2260 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: audit 2024-09-17T08:59:20.648184+0000 mon.a (mon.0) 2261 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi078-64688-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:22.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: cluster 2024-09-17T08:59:20.890138+0000 mgr.y (mgr.14532) 313 : cluster [DBG] pgmap v416: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[22670]: audit 2024-09-17T08:59:21.381654+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: audit 2024-09-17T08:59:20.618465+0000 mon.a (mon.0) 2255 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi078-64688-54"}]': finished 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: audit 2024-09-17T08:59:20.618694+0000 mon.a (mon.0) 2256 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: cluster 2024-09-17T08:59:20.618863+0000 mon.a (mon.0) 2257 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: audit 2024-09-17T08:59:20.625970+0000 mon.a (mon.0) 2258 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-39"}]: dispatch 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: audit 2024-09-17T08:59:20.646147+0000 mon.a (mon.0) 2259 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: audit 2024-09-17T08:59:20.647758+0000 mon.a (mon.0) 2260 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: audit 2024-09-17T08:59:20.648184+0000 mon.a (mon.0) 2261 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi078-64688-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: cluster 2024-09-17T08:59:20.890138+0000 mgr.y (mgr.14532) 313 : cluster [DBG] pgmap v416: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:22.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:21 smithi078 bash[32124]: audit 2024-09-17T08:59:21.381654+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: audit 2024-09-17T08:59:21.631336+0000 mon.a (mon.0) 2263 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-39"}]': finished 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: audit 2024-09-17T08:59:21.631521+0000 mon.a (mon.0) 2264 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi078-64688-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: cluster 2024-09-17T08:59:21.632126+0000 mon.a (mon.0) 2265 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: audit 2024-09-17T08:59:21.633126+0000 mon.a (mon.0) 2266 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi078-64688-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: audit 2024-09-17T08:59:21.633596+0000 mon.a (mon.0) 2267 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-39", "mode": "writeback"}]: dispatch 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: audit 2024-09-17T08:59:21.925263+0000 mon.a (mon.0) 2268 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: audit 2024-09-17T08:59:21.926889+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[22670]: audit 2024-09-17T08:59:21.938604+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: audit 2024-09-17T08:59:21.631336+0000 mon.a (mon.0) 2263 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-39"}]': finished 2024-09-17T08:59:23.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: audit 2024-09-17T08:59:21.631521+0000 mon.a (mon.0) 2264 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi078-64688-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: cluster 2024-09-17T08:59:21.632126+0000 mon.a (mon.0) 2265 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-09-17T08:59:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: audit 2024-09-17T08:59:21.633126+0000 mon.a (mon.0) 2266 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi078-64688-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: audit 2024-09-17T08:59:21.633596+0000 mon.a (mon.0) 2267 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-39", "mode": "writeback"}]: dispatch 2024-09-17T08:59:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: audit 2024-09-17T08:59:21.925263+0000 mon.a (mon.0) 2268 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:59:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: audit 2024-09-17T08:59:21.926889+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:59:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:23 smithi078 bash[32124]: audit 2024-09-17T08:59:21.938604+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:59:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: audit 2024-09-17T08:59:21.631336+0000 mon.a (mon.0) 2263 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-39"}]': finished 2024-09-17T08:59:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: audit 2024-09-17T08:59:21.631521+0000 mon.a (mon.0) 2264 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi078-64688-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: cluster 2024-09-17T08:59:21.632126+0000 mon.a (mon.0) 2265 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-09-17T08:59:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: audit 2024-09-17T08:59:21.633126+0000 mon.a (mon.0) 2266 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi078-64688-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: audit 2024-09-17T08:59:21.633596+0000 mon.a (mon.0) 2267 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-39", "mode": "writeback"}]: dispatch 2024-09-17T08:59:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: audit 2024-09-17T08:59:21.925263+0000 mon.a (mon.0) 2268 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T08:59:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: audit 2024-09-17T08:59:21.926889+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T08:59:23.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:23 smithi136 bash[24812]: audit 2024-09-17T08:59:21.938604+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: cluster 2024-09-17T08:59:22.620928+0000 mon.a (mon.0) 2271 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: cluster 2024-09-17T08:59:22.892054+0000 mgr.y (mgr.14532) 314 : cluster [DBG] pgmap v419: 228 pgs: 228 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: audit 2024-09-17T08:59:23.071023+0000 mon.a (mon.0) 2272 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-39", "mode": "writeback"}]': finished 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: cluster 2024-09-17T08:59:23.071135+0000 mon.a (mon.0) 2273 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: audit 2024-09-17T08:59:23.196415+0000 mon.a (mon.0) 2274 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: audit 2024-09-17T08:59:23.644872+0000 mon.a (mon.0) 2275 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi078-64688-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: audit 2024-09-17T08:59:23.645102+0000 mon.a (mon.0) 2276 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: cluster 2024-09-17T08:59:23.645233+0000 mon.a (mon.0) 2277 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-09-17T08:59:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[22670]: audit 2024-09-17T08:59:23.650255+0000 mon.a (mon.0) 2278 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39"}]: dispatch 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: cluster 2024-09-17T08:59:22.620928+0000 mon.a (mon.0) 2271 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: cluster 2024-09-17T08:59:22.892054+0000 mgr.y (mgr.14532) 314 : cluster [DBG] pgmap v419: 228 pgs: 228 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: audit 2024-09-17T08:59:23.071023+0000 mon.a (mon.0) 2272 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-39", "mode": "writeback"}]': finished 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: cluster 2024-09-17T08:59:23.071135+0000 mon.a (mon.0) 2273 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: audit 2024-09-17T08:59:23.196415+0000 mon.a (mon.0) 2274 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: audit 2024-09-17T08:59:23.644872+0000 mon.a (mon.0) 2275 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi078-64688-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: audit 2024-09-17T08:59:23.645102+0000 mon.a (mon.0) 2276 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: cluster 2024-09-17T08:59:23.645233+0000 mon.a (mon.0) 2277 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-09-17T08:59:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:24 smithi078 bash[32124]: audit 2024-09-17T08:59:23.650255+0000 mon.a (mon.0) 2278 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39"}]: dispatch 2024-09-17T08:59:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: cluster 2024-09-17T08:59:22.620928+0000 mon.a (mon.0) 2271 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T08:59:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: cluster 2024-09-17T08:59:22.892054+0000 mgr.y (mgr.14532) 314 : cluster [DBG] pgmap v419: 228 pgs: 228 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: audit 2024-09-17T08:59:23.071023+0000 mon.a (mon.0) 2272 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-39", "mode": "writeback"}]': finished 2024-09-17T08:59:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: cluster 2024-09-17T08:59:23.071135+0000 mon.a (mon.0) 2273 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-09-17T08:59:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: audit 2024-09-17T08:59:23.196415+0000 mon.a (mon.0) 2274 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: audit 2024-09-17T08:59:23.644872+0000 mon.a (mon.0) 2275 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi078-64688-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: audit 2024-09-17T08:59:23.645102+0000 mon.a (mon.0) 2276 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T08:59:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: cluster 2024-09-17T08:59:23.645233+0000 mon.a (mon.0) 2277 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-09-17T08:59:24.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:24 smithi136 bash[24812]: audit 2024-09-17T08:59:23.650255+0000 mon.a (mon.0) 2278 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39"}]: dispatch 2024-09-17T08:59:25.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:25 smithi078 bash[22670]: cluster 2024-09-17T08:59:24.633840+0000 mon.a (mon.0) 2279 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:25 smithi078 bash[22670]: audit 2024-09-17T08:59:24.648093+0000 mon.a (mon.0) 2280 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39"}]': finished 2024-09-17T08:59:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:25 smithi078 bash[22670]: cluster 2024-09-17T08:59:24.648622+0000 mon.a (mon.0) 2281 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-09-17T08:59:25.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:25 smithi078 bash[32124]: cluster 2024-09-17T08:59:24.633840+0000 mon.a (mon.0) 2279 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:25.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:25 smithi078 bash[32124]: audit 2024-09-17T08:59:24.648093+0000 mon.a (mon.0) 2280 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39"}]': finished 2024-09-17T08:59:25.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:25 smithi078 bash[32124]: cluster 2024-09-17T08:59:24.648622+0000 mon.a (mon.0) 2281 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-09-17T08:59:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:25 smithi136 bash[24812]: cluster 2024-09-17T08:59:24.633840+0000 mon.a (mon.0) 2279 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T08:59:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:25 smithi136 bash[24812]: audit 2024-09-17T08:59:24.648093+0000 mon.a (mon.0) 2280 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-39"}]': finished 2024-09-17T08:59:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:25 smithi136 bash[24812]: cluster 2024-09-17T08:59:24.648622+0000 mon.a (mon.0) 2281 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: seed 64852 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (305 ms) 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-17T08:59:25.647 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (15999 ms) 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (27 ms) 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (16331 ms total) 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7189 ms) 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (10096 ms) 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9998 ms) 2024-09-17T08:59:25.648 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: my_snaps [4] 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: my_snaps [5,4] 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: my_snaps [6,5,4] 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: my_snaps [7,6,5,4] 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: promoting some heads 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: promoting from clones for snap 7 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: promoting from clones for snap 6 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: promoting from clones for snap 5 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: promoting from clones for snap 4 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: waiting for scrubs... 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: done waiting 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46372 ms) 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-17T08:59:25.649 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10033 ms) 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7998 ms) 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8509 ms) 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (7594 ms) 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10086 ms) 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8814 ms) 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10098 ms) 2024-09-17T08:59:25.650 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12941 ms) 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8001 ms) 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (8049 ms) 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13144 ms) 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7794 ms) 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-17T08:59:25.651 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8052 ms) 2024-09-17T08:59:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[32124]: cluster 2024-09-17T08:59:24.892847+0000 mgr.y (mgr.14532) 315 : cluster [DBG] pgmap v422: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[32124]: audit 2024-09-17T08:59:25.290848+0000 mon.a (mon.0) 2282 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[32124]: cluster 2024-09-17T08:59:25.637437+0000 mon.a (mon.0) 2283 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[32124]: cluster 2024-09-17T08:59:25.646812+0000 mon.a (mon.0) 2284 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-09-17T08:59:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[32124]: audit 2024-09-17T08:59:25.650963+0000 mon.a (mon.0) 2285 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[22670]: cluster 2024-09-17T08:59:24.892847+0000 mgr.y (mgr.14532) 315 : cluster [DBG] pgmap v422: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[22670]: audit 2024-09-17T08:59:25.290848+0000 mon.a (mon.0) 2282 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[22670]: cluster 2024-09-17T08:59:25.637437+0000 mon.a (mon.0) 2283 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[22670]: cluster 2024-09-17T08:59:25.646812+0000 mon.a (mon.0) 2284 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-09-17T08:59:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:26 smithi078 bash[22670]: audit 2024-09-17T08:59:25.650963+0000 mon.a (mon.0) 2285 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:26 smithi136 bash[24812]: cluster 2024-09-17T08:59:24.892847+0000 mgr.y (mgr.14532) 315 : cluster [DBG] pgmap v422: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:26 smithi136 bash[24812]: audit 2024-09-17T08:59:25.290848+0000 mon.a (mon.0) 2282 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:26 smithi136 bash[24812]: cluster 2024-09-17T08:59:25.637437+0000 mon.a (mon.0) 2283 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:26.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:26 smithi136 bash[24812]: cluster 2024-09-17T08:59:25.646812+0000 mon.a (mon.0) 2284 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-09-17T08:59:26.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:26 smithi136 bash[24812]: audit 2024-09-17T08:59:25.650963+0000 mon.a (mon.0) 2285 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:27.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[32124]: audit 2024-09-17T08:59:26.651611+0000 mon.a (mon.0) 2286 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:27.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[32124]: cluster 2024-09-17T08:59:26.651888+0000 mon.a (mon.0) 2287 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-09-17T08:59:27.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[32124]: audit 2024-09-17T08:59:26.654368+0000 mon.a (mon.0) 2288 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:27.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[32124]: audit 2024-09-17T08:59:26.657052+0000 mon.a (mon.0) 2289 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:27.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[32124]: cluster 2024-09-17T08:59:26.893669+0000 mgr.y (mgr.14532) 316 : cluster [DBG] pgmap v425: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:27.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[22670]: audit 2024-09-17T08:59:26.651611+0000 mon.a (mon.0) 2286 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:27.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[22670]: cluster 2024-09-17T08:59:26.651888+0000 mon.a (mon.0) 2287 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-09-17T08:59:27.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[22670]: audit 2024-09-17T08:59:26.654368+0000 mon.a (mon.0) 2288 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:27.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[22670]: audit 2024-09-17T08:59:26.657052+0000 mon.a (mon.0) 2289 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:27.921 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[22670]: cluster 2024-09-17T08:59:26.893669+0000 mgr.y (mgr.14532) 316 : cluster [DBG] pgmap v425: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:28.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:27 smithi136 bash[24812]: audit 2024-09-17T08:59:26.651611+0000 mon.a (mon.0) 2286 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:28.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:27 smithi136 bash[24812]: cluster 2024-09-17T08:59:26.651888+0000 mon.a (mon.0) 2287 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-09-17T08:59:28.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:27 smithi136 bash[24812]: audit 2024-09-17T08:59:26.654368+0000 mon.a (mon.0) 2288 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]: dispatch 2024-09-17T08:59:28.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:27 smithi136 bash[24812]: audit 2024-09-17T08:59:26.657052+0000 mon.a (mon.0) 2289 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:28.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:27 smithi136 bash[24812]: cluster 2024-09-17T08:59:26.893669+0000 mgr.y (mgr.14532) 316 : cluster [DBG] pgmap v425: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 569 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:28.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:59:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:59:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.663136+0000 mon.a (mon.0) 2290 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.663402+0000 mon.a (mon.0) 2291 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: cluster 2024-09-17T08:59:27.663859+0000 mon.a (mon.0) 2292 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.670521+0000 mon.a (mon.0) 2293 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.700148+0000 mon.c (mon.2) 271 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.700969+0000 mon.a (mon.0) 2294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.701902+0000 mon.c (mon.2) 272 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.702382+0000 mon.a (mon.0) 2295 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.702891+0000 mon.c (mon.2) 273 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:28 smithi136 bash[24812]: audit 2024-09-17T08:59:27.703160+0000 mon.a (mon.0) 2296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.663136+0000 mon.a (mon.0) 2290 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.663402+0000 mon.a (mon.0) 2291 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: cluster 2024-09-17T08:59:27.663859+0000 mon.a (mon.0) 2292 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-09-17T08:59:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.670521+0000 mon.a (mon.0) 2293 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.700148+0000 mon.c (mon.2) 271 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.700969+0000 mon.a (mon.0) 2294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.701902+0000 mon.c (mon.2) 272 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.702382+0000 mon.a (mon.0) 2295 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.702891+0000 mon.c (mon.2) 273 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[22670]: audit 2024-09-17T08:59:27.703160+0000 mon.a (mon.0) 2296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.663136+0000 mon.a (mon.0) 2290 : audit [INF] from='client.? 172.21.15.78:0/2340278625' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi078-64688-55"}]': finished 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.663402+0000 mon.a (mon.0) 2291 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: cluster 2024-09-17T08:59:27.663859+0000 mon.a (mon.0) 2292 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.670521+0000 mon.a (mon.0) 2293 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.700148+0000 mon.c (mon.2) 271 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.700969+0000 mon.a (mon.0) 2294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.701902+0000 mon.c (mon.2) 272 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.702382+0000 mon.a (mon.0) 2295 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:29.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.702891+0000 mon.c (mon.2) 273 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:29.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:28 smithi078 bash[32124]: audit 2024-09-17T08:59:27.703160+0000 mon.a (mon.0) 2296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:29.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:59:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:59:30.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:30 smithi136 bash[24812]: audit 2024-09-17T08:59:28.662456+0000 mon.a (mon.0) 2297 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:30.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:30 smithi136 bash[24812]: audit 2024-09-17T08:59:28.663022+0000 mon.a (mon.0) 2298 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:30.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:30 smithi136 bash[24812]: cluster 2024-09-17T08:59:28.663347+0000 mon.a (mon.0) 2299 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-09-17T08:59:30.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:30 smithi136 bash[24812]: audit 2024-09-17T08:59:28.665287+0000 mon.a (mon.0) 2300 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T08:59:30.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:30 smithi136 bash[24812]: audit 2024-09-17T08:59:28.665543+0000 mon.c (mon.2) 274 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:30.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:30 smithi136 bash[24812]: audit 2024-09-17T08:59:28.676064+0000 mon.a (mon.0) 2301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:30.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:30 smithi136 bash[24812]: cluster 2024-09-17T08:59:28.894505+0000 mgr.y (mgr.14532) 317 : cluster [DBG] pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T08:59:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[22670]: audit 2024-09-17T08:59:28.662456+0000 mon.a (mon.0) 2297 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[22670]: audit 2024-09-17T08:59:28.663022+0000 mon.a (mon.0) 2298 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[22670]: cluster 2024-09-17T08:59:28.663347+0000 mon.a (mon.0) 2299 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-09-17T08:59:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[22670]: audit 2024-09-17T08:59:28.665287+0000 mon.a (mon.0) 2300 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T08:59:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[22670]: audit 2024-09-17T08:59:28.665543+0000 mon.c (mon.2) 274 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[22670]: audit 2024-09-17T08:59:28.676064+0000 mon.a (mon.0) 2301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[22670]: cluster 2024-09-17T08:59:28.894505+0000 mgr.y (mgr.14532) 317 : cluster [DBG] pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[32124]: audit 2024-09-17T08:59:28.662456+0000 mon.a (mon.0) 2297 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[32124]: audit 2024-09-17T08:59:28.663022+0000 mon.a (mon.0) 2298 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi078-64688-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[32124]: cluster 2024-09-17T08:59:28.663347+0000 mon.a (mon.0) 2299 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[32124]: audit 2024-09-17T08:59:28.665287+0000 mon.a (mon.0) 2300 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[32124]: audit 2024-09-17T08:59:28.665543+0000 mon.c (mon.2) 274 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[32124]: audit 2024-09-17T08:59:28.676064+0000 mon.a (mon.0) 2301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:30 smithi078 bash[32124]: cluster 2024-09-17T08:59:28.894505+0000 mgr.y (mgr.14532) 317 : cluster [DBG] pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: audit 2024-09-17T08:59:29.500865+0000 mgr.y (mgr.14532) 318 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: audit 2024-09-17T08:59:29.665882+0000 mon.a (mon.0) 2302 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_count","val": "2"}]': finished 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: cluster 2024-09-17T08:59:30.112198+0000 mon.a (mon.0) 2303 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: audit 2024-09-17T08:59:30.113558+0000 mon.a (mon.0) 2304 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: audit 2024-09-17T08:59:30.672483+0000 mon.a (mon.0) 2305 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: audit 2024-09-17T08:59:30.672763+0000 mon.a (mon.0) 2306 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_period","val": "600"}]': finished 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: cluster 2024-09-17T08:59:30.672909+0000 mon.a (mon.0) 2307 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: audit 2024-09-17T08:59:30.675034+0000 mon.a (mon.0) 2308 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T08:59:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:31 smithi136 bash[24812]: cluster 2024-09-17T08:59:30.895291+0000 mgr.y (mgr.14532) 319 : cluster [DBG] pgmap v431: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: audit 2024-09-17T08:59:29.500865+0000 mgr.y (mgr.14532) 318 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: audit 2024-09-17T08:59:29.665882+0000 mon.a (mon.0) 2302 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_count","val": "2"}]': finished 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: cluster 2024-09-17T08:59:30.112198+0000 mon.a (mon.0) 2303 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: audit 2024-09-17T08:59:30.113558+0000 mon.a (mon.0) 2304 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: audit 2024-09-17T08:59:30.672483+0000 mon.a (mon.0) 2305 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: audit 2024-09-17T08:59:30.672763+0000 mon.a (mon.0) 2306 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_period","val": "600"}]': finished 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: cluster 2024-09-17T08:59:30.672909+0000 mon.a (mon.0) 2307 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: audit 2024-09-17T08:59:30.675034+0000 mon.a (mon.0) 2308 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T08:59:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[22670]: cluster 2024-09-17T08:59:30.895291+0000 mgr.y (mgr.14532) 319 : cluster [DBG] pgmap v431: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: audit 2024-09-17T08:59:29.500865+0000 mgr.y (mgr.14532) 318 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: audit 2024-09-17T08:59:29.665882+0000 mon.a (mon.0) 2302 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_count","val": "2"}]': finished 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: cluster 2024-09-17T08:59:30.112198+0000 mon.a (mon.0) 2303 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: audit 2024-09-17T08:59:30.113558+0000 mon.a (mon.0) 2304 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: audit 2024-09-17T08:59:30.672483+0000 mon.a (mon.0) 2305 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi078-64688-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: audit 2024-09-17T08:59:30.672763+0000 mon.a (mon.0) 2306 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_period","val": "600"}]': finished 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: cluster 2024-09-17T08:59:30.672909+0000 mon.a (mon.0) 2307 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: audit 2024-09-17T08:59:30.675034+0000 mon.a (mon.0) 2308 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T08:59:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:31 smithi078 bash[32124]: cluster 2024-09-17T08:59:30.895291+0000 mgr.y (mgr.14532) 319 : cluster [DBG] pgmap v431: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T08:59:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:32 smithi136 bash[24812]: cluster 2024-09-17T08:59:31.662115+0000 mon.a (mon.0) 2309 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:32 smithi136 bash[24812]: audit 2024-09-17T08:59:31.684717+0000 mon.a (mon.0) 2310 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T08:59:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:32 smithi136 bash[24812]: cluster 2024-09-17T08:59:31.685186+0000 mon.a (mon.0) 2311 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-09-17T08:59:32.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:32 smithi078 bash[32124]: cluster 2024-09-17T08:59:31.662115+0000 mon.a (mon.0) 2309 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:32.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:32 smithi078 bash[32124]: audit 2024-09-17T08:59:31.684717+0000 mon.a (mon.0) 2310 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T08:59:32.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:32 smithi078 bash[32124]: cluster 2024-09-17T08:59:31.685186+0000 mon.a (mon.0) 2311 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-09-17T08:59:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:32 smithi078 bash[22670]: cluster 2024-09-17T08:59:31.662115+0000 mon.a (mon.0) 2309 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:32 smithi078 bash[22670]: audit 2024-09-17T08:59:31.684717+0000 mon.a (mon.0) 2310 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T08:59:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:32 smithi078 bash[22670]: cluster 2024-09-17T08:59:31.685186+0000 mon.a (mon.0) 2311 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-09-17T08:59:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:33 smithi136 bash[24812]: cluster 2024-09-17T08:59:32.684717+0000 mon.a (mon.0) 2312 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-09-17T08:59:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:33 smithi136 bash[24812]: audit 2024-09-17T08:59:32.689443+0000 mon.c (mon.2) 275 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:33 smithi136 bash[24812]: audit 2024-09-17T08:59:32.693016+0000 mon.a (mon.0) 2313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:33 smithi136 bash[24812]: audit 2024-09-17T08:59:32.759237+0000 mon.a (mon.0) 2314 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:33 smithi136 bash[24812]: audit 2024-09-17T08:59:32.760052+0000 mon.a (mon.0) 2315 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41"}]: dispatch 2024-09-17T08:59:34.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:33 smithi136 bash[24812]: cluster 2024-09-17T08:59:32.897374+0000 mgr.y (mgr.14532) 320 : cluster [DBG] pgmap v434: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[22670]: cluster 2024-09-17T08:59:32.684717+0000 mon.a (mon.0) 2312 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[22670]: audit 2024-09-17T08:59:32.689443+0000 mon.c (mon.2) 275 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[22670]: audit 2024-09-17T08:59:32.693016+0000 mon.a (mon.0) 2313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[22670]: audit 2024-09-17T08:59:32.759237+0000 mon.a (mon.0) 2314 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[22670]: audit 2024-09-17T08:59:32.760052+0000 mon.a (mon.0) 2315 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41"}]: dispatch 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[22670]: cluster 2024-09-17T08:59:32.897374+0000 mgr.y (mgr.14532) 320 : cluster [DBG] pgmap v434: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[32124]: cluster 2024-09-17T08:59:32.684717+0000 mon.a (mon.0) 2312 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[32124]: audit 2024-09-17T08:59:32.689443+0000 mon.c (mon.2) 275 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:34.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[32124]: audit 2024-09-17T08:59:32.693016+0000 mon.a (mon.0) 2313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[32124]: audit 2024-09-17T08:59:32.759237+0000 mon.a (mon.0) 2314 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[32124]: audit 2024-09-17T08:59:32.760052+0000 mon.a (mon.0) 2315 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41"}]: dispatch 2024-09-17T08:59:34.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:33 smithi078 bash[32124]: cluster 2024-09-17T08:59:32.897374+0000 mgr.y (mgr.14532) 320 : cluster [DBG] pgmap v434: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:35 smithi136 bash[24812]: audit 2024-09-17T08:59:33.699913+0000 mon.a (mon.0) 2316 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:35 smithi136 bash[24812]: audit 2024-09-17T08:59:33.700149+0000 mon.a (mon.0) 2317 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41"}]': finished 2024-09-17T08:59:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:35 smithi136 bash[24812]: cluster 2024-09-17T08:59:33.700321+0000 mon.a (mon.0) 2318 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-09-17T08:59:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:35 smithi136 bash[24812]: audit 2024-09-17T08:59:33.705403+0000 mon.c (mon.2) 276 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:35 smithi136 bash[24812]: audit 2024-09-17T08:59:33.707215+0000 mon.a (mon.0) 2319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[22670]: audit 2024-09-17T08:59:33.699913+0000 mon.a (mon.0) 2316 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[22670]: audit 2024-09-17T08:59:33.700149+0000 mon.a (mon.0) 2317 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41"}]': finished 2024-09-17T08:59:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[22670]: cluster 2024-09-17T08:59:33.700321+0000 mon.a (mon.0) 2318 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-09-17T08:59:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[22670]: audit 2024-09-17T08:59:33.705403+0000 mon.c (mon.2) 276 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[22670]: audit 2024-09-17T08:59:33.707215+0000 mon.a (mon.0) 2319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:35.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[32124]: audit 2024-09-17T08:59:33.699913+0000 mon.a (mon.0) 2316 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:35.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[32124]: audit 2024-09-17T08:59:33.700149+0000 mon.a (mon.0) 2317 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-41"}]': finished 2024-09-17T08:59:35.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[32124]: cluster 2024-09-17T08:59:33.700321+0000 mon.a (mon.0) 2318 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-09-17T08:59:35.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[32124]: audit 2024-09-17T08:59:33.705403+0000 mon.c (mon.2) 276 : audit [INF] from='client.? 172.21.15.78:0/2100899955' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:35.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:35 smithi078 bash[32124]: audit 2024-09-17T08:59:33.707215+0000 mon.a (mon.0) 2319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]: dispatch 2024-09-17T08:59:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: audit 2024-09-17T08:59:34.699568+0000 mon.a (mon.0) 2320 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: cluster 2024-09-17T08:59:34.699843+0000 mon.a (mon.0) 2321 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-09-17T08:59:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: cluster 2024-09-17T08:59:34.898089+0000 mgr.y (mgr.14532) 321 : cluster [DBG] pgmap v437: 196 pgs: 196 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: audit 2024-09-17T08:59:35.193470+0000 mon.a (mon.0) 2322 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: audit 2024-09-17T08:59:35.194390+0000 mon.a (mon.0) 2323 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: audit 2024-09-17T08:59:35.194758+0000 mon.a (mon.0) 2324 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi078-64688-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:36.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: audit 2024-09-17T08:59:35.709777+0000 mon.a (mon.0) 2325 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi078-64688-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: cluster 2024-09-17T08:59:35.709979+0000 mon.a (mon.0) 2326 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-09-17T08:59:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: audit 2024-09-17T08:59:35.711785+0000 mon.a (mon.0) 2327 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi078-64688-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:36 smithi136 bash[24812]: audit 2024-09-17T08:59:35.721787+0000 mon.a (mon.0) 2328 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: audit 2024-09-17T08:59:34.699568+0000 mon.a (mon.0) 2320 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: cluster 2024-09-17T08:59:34.699843+0000 mon.a (mon.0) 2321 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: cluster 2024-09-17T08:59:34.898089+0000 mgr.y (mgr.14532) 321 : cluster [DBG] pgmap v437: 196 pgs: 196 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: audit 2024-09-17T08:59:35.193470+0000 mon.a (mon.0) 2322 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: audit 2024-09-17T08:59:35.194390+0000 mon.a (mon.0) 2323 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: audit 2024-09-17T08:59:35.194758+0000 mon.a (mon.0) 2324 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi078-64688-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: audit 2024-09-17T08:59:35.709777+0000 mon.a (mon.0) 2325 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi078-64688-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: cluster 2024-09-17T08:59:35.709979+0000 mon.a (mon.0) 2326 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-09-17T08:59:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: audit 2024-09-17T08:59:35.711785+0000 mon.a (mon.0) 2327 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi078-64688-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[32124]: audit 2024-09-17T08:59:35.721787+0000 mon.a (mon.0) 2328 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: audit 2024-09-17T08:59:34.699568+0000 mon.a (mon.0) 2320 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi078-64688-56"}]': finished 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: cluster 2024-09-17T08:59:34.699843+0000 mon.a (mon.0) 2321 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: cluster 2024-09-17T08:59:34.898089+0000 mgr.y (mgr.14532) 321 : cluster [DBG] pgmap v437: 196 pgs: 196 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: audit 2024-09-17T08:59:35.193470+0000 mon.a (mon.0) 2322 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: audit 2024-09-17T08:59:35.194390+0000 mon.a (mon.0) 2323 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: audit 2024-09-17T08:59:35.194758+0000 mon.a (mon.0) 2324 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi078-64688-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: audit 2024-09-17T08:59:35.709777+0000 mon.a (mon.0) 2325 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi078-64688-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: cluster 2024-09-17T08:59:35.709979+0000 mon.a (mon.0) 2326 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-09-17T08:59:36.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: audit 2024-09-17T08:59:35.711785+0000 mon.a (mon.0) 2327 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi078-64688-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:36.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:36 smithi078 bash[22670]: audit 2024-09-17T08:59:35.721787+0000 mon.a (mon.0) 2328 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:37 smithi136 bash[24812]: cluster 2024-09-17T08:59:36.898834+0000 mgr.y (mgr.14532) 322 : cluster [DBG] pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:37 smithi136 bash[24812]: audit 2024-09-17T08:59:37.161757+0000 mon.a (mon.0) 2329 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:37 smithi136 bash[24812]: cluster 2024-09-17T08:59:37.162192+0000 mon.a (mon.0) 2330 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-09-17T08:59:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:37 smithi136 bash[24812]: audit 2024-09-17T08:59:37.167210+0000 mon.a (mon.0) 2331 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi078-64852-6","var": "pg_num","format": "json"}]: dispatch 2024-09-17T08:59:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:37 smithi136 bash[24812]: audit 2024-09-17T08:59:37.168557+0000 mon.a (mon.0) 2332 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:38.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:37 smithi136 bash[24812]: cluster 2024-09-17T08:59:37.569928+0000 mon.a (mon.0) 2333 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:38.101 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:59:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[22670]: cluster 2024-09-17T08:59:36.898834+0000 mgr.y (mgr.14532) 322 : cluster [DBG] pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[22670]: audit 2024-09-17T08:59:37.161757+0000 mon.a (mon.0) 2329 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[22670]: cluster 2024-09-17T08:59:37.162192+0000 mon.a (mon.0) 2330 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[22670]: audit 2024-09-17T08:59:37.167210+0000 mon.a (mon.0) 2331 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi078-64852-6","var": "pg_num","format": "json"}]: dispatch 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[22670]: audit 2024-09-17T08:59:37.168557+0000 mon.a (mon.0) 2332 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[22670]: cluster 2024-09-17T08:59:37.569928+0000 mon.a (mon.0) 2333 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[32124]: cluster 2024-09-17T08:59:36.898834+0000 mgr.y (mgr.14532) 322 : cluster [DBG] pgmap v440: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:38.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[32124]: audit 2024-09-17T08:59:37.161757+0000 mon.a (mon.0) 2329 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:38.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[32124]: cluster 2024-09-17T08:59:37.162192+0000 mon.a (mon.0) 2330 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-09-17T08:59:38.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[32124]: audit 2024-09-17T08:59:37.167210+0000 mon.a (mon.0) 2331 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi078-64852-6","var": "pg_num","format": "json"}]: dispatch 2024-09-17T08:59:38.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[32124]: audit 2024-09-17T08:59:37.168557+0000 mon.a (mon.0) 2332 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:38.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:37 smithi078 bash[32124]: cluster 2024-09-17T08:59:37.569928+0000 mon.a (mon.0) 2333 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:39.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:38 smithi136 bash[24812]: audit 2024-09-17T08:59:37.726482+0000 mon.a (mon.0) 2334 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi078-64688-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:39.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:38 smithi136 bash[24812]: audit 2024-09-17T08:59:37.727038+0000 mon.a (mon.0) 2335 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:39.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:38 smithi136 bash[24812]: cluster 2024-09-17T08:59:37.727223+0000 mon.a (mon.0) 2336 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-09-17T08:59:39.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:38 smithi136 bash[24812]: audit 2024-09-17T08:59:37.729288+0000 mon.a (mon.0) 2337 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-17T08:59:39.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[22670]: audit 2024-09-17T08:59:37.726482+0000 mon.a (mon.0) 2334 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi078-64688-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:39.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[22670]: audit 2024-09-17T08:59:37.727038+0000 mon.a (mon.0) 2335 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:39.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[22670]: cluster 2024-09-17T08:59:37.727223+0000 mon.a (mon.0) 2336 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-09-17T08:59:39.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[22670]: audit 2024-09-17T08:59:37.729288+0000 mon.a (mon.0) 2337 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-17T08:59:39.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[32124]: audit 2024-09-17T08:59:37.726482+0000 mon.a (mon.0) 2334 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi078-64688-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:39.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[32124]: audit 2024-09-17T08:59:37.727038+0000 mon.a (mon.0) 2335 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:39.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[32124]: cluster 2024-09-17T08:59:37.727223+0000 mon.a (mon.0) 2336 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-09-17T08:59:39.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:38 smithi078 bash[32124]: audit 2024-09-17T08:59:37.729288+0000 mon.a (mon.0) 2337 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-17T08:59:39.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: audit 2024-09-17T08:59:38.732344+0000 mon.a (mon.0) 2338 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_count","val": "8"}]': finished 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: cluster 2024-09-17T08:59:38.732827+0000 mon.a (mon.0) 2339 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: audit 2024-09-17T08:59:38.735808+0000 mon.a (mon.0) 2340 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: cluster 2024-09-17T08:59:38.899674+0000 mgr.y (mgr.14532) 323 : cluster [DBG] pgmap v443: 236 pgs: 7 creating+peering, 1 unknown, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: audit 2024-09-17T08:59:39.731027+0000 mon.a (mon.0) 2341 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_period","val": "600"}]': finished 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: cluster 2024-09-17T08:59:39.731301+0000 mon.a (mon.0) 2342 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: audit 2024-09-17T08:59:39.734172+0000 mon.a (mon.0) 2343 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:39.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:39 smithi136 bash[24812]: audit 2024-09-17T08:59:39.735670+0000 mon.a (mon.0) 2344 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: audit 2024-09-17T08:59:38.732344+0000 mon.a (mon.0) 2338 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_count","val": "8"}]': finished 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: cluster 2024-09-17T08:59:38.732827+0000 mon.a (mon.0) 2339 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: audit 2024-09-17T08:59:38.735808+0000 mon.a (mon.0) 2340 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: cluster 2024-09-17T08:59:38.899674+0000 mgr.y (mgr.14532) 323 : cluster [DBG] pgmap v443: 236 pgs: 7 creating+peering, 1 unknown, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: audit 2024-09-17T08:59:39.731027+0000 mon.a (mon.0) 2341 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_period","val": "600"}]': finished 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: cluster 2024-09-17T08:59:39.731301+0000 mon.a (mon.0) 2342 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: audit 2024-09-17T08:59:39.734172+0000 mon.a (mon.0) 2343 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[22670]: audit 2024-09-17T08:59:39.735670+0000 mon.a (mon.0) 2344 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-17T08:59:40.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: audit 2024-09-17T08:59:38.732344+0000 mon.a (mon.0) 2338 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_count","val": "8"}]': finished 2024-09-17T08:59:40.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: cluster 2024-09-17T08:59:38.732827+0000 mon.a (mon.0) 2339 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-09-17T08:59:40.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: audit 2024-09-17T08:59:38.735808+0000 mon.a (mon.0) 2340 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T08:59:40.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: cluster 2024-09-17T08:59:38.899674+0000 mgr.y (mgr.14532) 323 : cluster [DBG] pgmap v443: 236 pgs: 7 creating+peering, 1 unknown, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:40.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: audit 2024-09-17T08:59:39.731027+0000 mon.a (mon.0) 2341 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_period","val": "600"}]': finished 2024-09-17T08:59:40.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: cluster 2024-09-17T08:59:39.731301+0000 mon.a (mon.0) 2342 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-09-17T08:59:40.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: audit 2024-09-17T08:59:39.734172+0000 mon.a (mon.0) 2343 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:40.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:39 smithi078 bash[32124]: audit 2024-09-17T08:59:39.735670+0000 mon.a (mon.0) 2344 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-17T08:59:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:40 smithi136 bash[24812]: audit 2024-09-17T08:59:39.510572+0000 mgr.y (mgr.14532) 324 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:40 smithi136 bash[24812]: audit 2024-09-17T08:59:40.320400+0000 mon.a (mon.0) 2345 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:40 smithi136 bash[24812]: audit 2024-09-17T08:59:40.732799+0000 mon.a (mon.0) 2346 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:40 smithi136 bash[24812]: audit 2024-09-17T08:59:40.733027+0000 mon.a (mon.0) 2347 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-17T08:59:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:40 smithi136 bash[24812]: cluster 2024-09-17T08:59:40.733171+0000 mon.a (mon.0) 2348 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-09-17T08:59:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:40 smithi136 bash[24812]: audit 2024-09-17T08:59:40.735324+0000 mon.a (mon.0) 2349 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:41.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[22670]: audit 2024-09-17T08:59:39.510572+0000 mgr.y (mgr.14532) 324 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[22670]: audit 2024-09-17T08:59:40.320400+0000 mon.a (mon.0) 2345 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[22670]: audit 2024-09-17T08:59:40.732799+0000 mon.a (mon.0) 2346 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[22670]: audit 2024-09-17T08:59:40.733027+0000 mon.a (mon.0) 2347 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[22670]: cluster 2024-09-17T08:59:40.733171+0000 mon.a (mon.0) 2348 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[22670]: audit 2024-09-17T08:59:40.735324+0000 mon.a (mon.0) 2349 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[32124]: audit 2024-09-17T08:59:39.510572+0000 mgr.y (mgr.14532) 324 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[32124]: audit 2024-09-17T08:59:40.320400+0000 mon.a (mon.0) 2345 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[32124]: audit 2024-09-17T08:59:40.732799+0000 mon.a (mon.0) 2346 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:41.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[32124]: audit 2024-09-17T08:59:40.733027+0000 mon.a (mon.0) 2347 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-17T08:59:41.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[32124]: cluster 2024-09-17T08:59:40.733171+0000 mon.a (mon.0) 2348 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-09-17T08:59:41.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:40 smithi078 bash[32124]: audit 2024-09-17T08:59:40.735324+0000 mon.a (mon.0) 2349 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]: dispatch 2024-09-17T08:59:41.318 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-17T08:59:41.318 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-17T08:59:41.318 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: ok, hit_set contains 194:602f83fe:::foo:head 2024-09-17T08:59:41.318 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9052 ms) 2024-09-17T08:59:41.318 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-17T08:59:41.318 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg_num = 32 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 0 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 1 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 2 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 3 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 4 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 5 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 6 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 7 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 8 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 9 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 10 ls 1726563581,0 2024-09-17T08:59:41.319 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 11 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 12 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 13 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 14 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 15 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 16 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 17 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 18 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 19 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 20 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 21 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 22 ls 1726563581,0 2024-09-17T08:59:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 23 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 24 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 25 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 26 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 27 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 28 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 29 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 30 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg 31 ls 1726563581,0 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: pg_num = 32 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6cac518f:::0:head 2024-09-17T08:59:41.321 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:02547ec2:::1:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f905c69b:::2:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:cfc208b3:::3:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d83876eb:::4:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b29083e3:::5:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c4fdafeb:::6:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:5c6b0b28:::7:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:bd63b0f1:::8:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:e960b815:::9:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:52ea6a34:::10:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:89d3ae78:::11:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:de5d7c5f:::12:head 2024-09-17T08:59:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:566253c9:::13:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:62a1935d:::14:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:863748b0:::15:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:3958e169:::16:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:4d4dabf9:::17:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:8391935d:::18:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:28883081:::19:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:69259c59:::20:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:4bdb80b7:::21:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a11c5d71:::22:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:271af37b:::23:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:95b121be:::24:head 2024-09-17T08:59:41.323 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:58d1031b:::25:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:0a050783:::26:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c709704c:::27:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:cbe56eaf:::28:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:86b4b162:::29:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:70d89383:::30:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:dd450c7c:::31:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6d5729b1:::32:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c388f3fb:::33:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:56cfea31:::34:head 2024-09-17T08:59:41.324 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:9dbc1bf7:::35:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:40b74ccd:::36:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:4d5aaf42:::37:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:920f362c:::38:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6cc53222:::39:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:9cad833f:::40:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:1ea84d41:::41:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c4480ef6:::42:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a694361e:::43:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d1bd33e9:::44:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:ddc2cd5d:::45:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:2b782207:::46:head 2024-09-17T08:59:41.325 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:7b187fca:::47:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:90ecdf6f:::48:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a5ed95fe:::49:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:ea0eaa55:::50:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f33ef17b:::51:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a0d1b2f6:::52:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:60c5229e:::53:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:edcbc575:::54:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:102cf253:::55:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:efb7fb0b:::56:head 2024-09-17T08:59:41.326 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:50d0a326:::57:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d4dc5daf:::58:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:3a130462:::59:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:ec87ed71:::60:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d5bc9454:::61:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:3ddfe313:::62:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:7c2816b9:::63:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:47e00e4d:::64:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c6410c18:::65:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b48ed237:::66:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:cd63ad31:::67:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b179e92b:::68:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:0d9f741a:::69:head 2024-09-17T08:59:41.327 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6d3352ae:::70:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c6d5c19e:::71:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:bc4729c3:::72:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:77e930b9:::73:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:0abeecfd:::74:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b7c37e15:::75:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b6378398:::76:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:02bd68de:::77:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:cc795d2d:::78:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:630d4fea:::79:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:e0d29ef5:::80:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:fd6f13d2:::81:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:606461d5:::82:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:eadbdc43:::83:head 2024-09-17T08:59:41.328 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:8761d0bb:::84:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:9ef0186f:::85:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:e0d41294:::86:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:961de695:::87:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:1423148f:::88:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:633a8fa2:::89:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a8653809:::90:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:3dac8b33:::91:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:35aad435:::92:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f6dcc343:::93:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:dbbdad87:::94:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:1cb48ce0:::95:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:03cd461c:::96:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:17a4ea99:::97:head 2024-09-17T08:59:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:9993c9a7:::98:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6394211c:::99:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:94c7ae57:::100:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6fdee5bb:::101:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:9a477fd1:::102:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:eb850916:::103:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:affc56b9:::104:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b42dc814:::105:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f319f8f0:::106:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:9a40b9de:::107:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:8b524f28:::108:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:e3de589f:::109:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:90f90a5b:::110:head 2024-09-17T08:59:41.330 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a7b4f1d7:::111:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:af51766e:::112:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b6f90bd1:::113:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:e0261208:::114:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c9569ef7:::115:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:61bebe50:::116:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:fe93412b:::117:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d3d38bee:::118:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:3100ba0c:::119:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d0560ada:::120:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f0ea8b35:::121:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:766f231a:::122:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a07a2582:::123:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:bd7c6b3a:::124:head 2024-09-17T08:59:41.331 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:fb2ddaff:::125:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:4408e1fe:::126:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:ee1df7a7:::127:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c3002909:::128:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:4f48ffa9:::129:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:edf38733:::130:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c08425c0:::131:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:5f902d98:::132:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:41ea2c93:::133:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:813cee13:::134:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:0131818d:::135:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:26ba5a85:::136:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:381b8a5a:::137:head 2024-09-17T08:59:41.332 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:28797e47:::138:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:bfca7f22:::139:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:36807075:::140:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:80b03975:::141:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:5c15709b:::142:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f39ea15e:::143:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:ea992956:::144:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:48887b1c:::145:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:9f24a9dd:::146:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:987f100b:::147:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d2dd3581:::148:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:7fed1808:::149:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c80b70e9:::150:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:85ed90f9:::151:head 2024-09-17T08:59:41.333 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:36428b24:::152:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d044c34a:::153:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:7c18bf58:::154:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d1c21232:::155:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a7a3c575:::156:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:87da0633:::157:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d5ac3822:::158:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:3f20522d:::159:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6ca26563:::160:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:532ce135:::161:head 2024-09-17T08:59:41.334 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:c78863e6:::162:head 2024-09-17T08:59:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:41 smithi136 bash[24812]: cluster 2024-09-17T08:59:40.900482+0000 mgr.y (mgr.14532) 325 : cluster [DBG] pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:41 smithi136 bash[24812]: audit 2024-09-17T08:59:41.320713+0000 mon.a (mon.0) 2350 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi078-64852-43","var": "pg_num","format": "json"}]: dispatch 2024-09-17T08:59:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:41 smithi136 bash[24812]: audit 2024-09-17T08:59:41.612873+0000 mon.a (mon.0) 2351 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:41 smithi136 bash[24812]: audit 2024-09-17T08:59:41.613748+0000 mon.a (mon.0) 2352 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43"}]: dispatch 2024-09-17T08:59:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:41 smithi136 bash[24812]: audit 2024-09-17T08:59:41.736771+0000 mon.a (mon.0) 2353 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:41 smithi136 bash[24812]: audit 2024-09-17T08:59:41.736956+0000 mon.a (mon.0) 2354 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43"}]': finished 2024-09-17T08:59:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:41 smithi136 bash[24812]: cluster 2024-09-17T08:59:41.737080+0000 mon.a (mon.0) 2355 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-09-17T08:59:42.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[22670]: cluster 2024-09-17T08:59:40.900482+0000 mgr.y (mgr.14532) 325 : cluster [DBG] pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[22670]: audit 2024-09-17T08:59:41.320713+0000 mon.a (mon.0) 2350 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi078-64852-43","var": "pg_num","format": "json"}]: dispatch 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[22670]: audit 2024-09-17T08:59:41.612873+0000 mon.a (mon.0) 2351 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[22670]: audit 2024-09-17T08:59:41.613748+0000 mon.a (mon.0) 2352 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43"}]: dispatch 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[22670]: audit 2024-09-17T08:59:41.736771+0000 mon.a (mon.0) 2353 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[22670]: audit 2024-09-17T08:59:41.736956+0000 mon.a (mon.0) 2354 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43"}]': finished 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[22670]: cluster 2024-09-17T08:59:41.737080+0000 mon.a (mon.0) 2355 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[32124]: cluster 2024-09-17T08:59:40.900482+0000 mgr.y (mgr.14532) 325 : cluster [DBG] pgmap v446: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:42.105 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[32124]: audit 2024-09-17T08:59:41.320713+0000 mon.a (mon.0) 2350 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi078-64852-43","var": "pg_num","format": "json"}]: dispatch 2024-09-17T08:59:42.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[32124]: audit 2024-09-17T08:59:41.612873+0000 mon.a (mon.0) 2351 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T08:59:42.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[32124]: audit 2024-09-17T08:59:41.613748+0000 mon.a (mon.0) 2352 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43"}]: dispatch 2024-09-17T08:59:42.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[32124]: audit 2024-09-17T08:59:41.736771+0000 mon.a (mon.0) 2353 : audit [INF] from='client.? 172.21.15.78:0/99966929' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi078-64688-57"}]': finished 2024-09-17T08:59:42.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[32124]: audit 2024-09-17T08:59:41.736956+0000 mon.a (mon.0) 2354 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-43"}]': finished 2024-09-17T08:59:42.106 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:41 smithi078 bash[32124]: cluster 2024-09-17T08:59:41.737080+0000 mon.a (mon.0) 2355 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-09-17T08:59:43.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:43 smithi136 bash[24812]: audit 2024-09-17T08:59:41.778062+0000 mon.a (mon.0) 2356 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:43.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:43 smithi136 bash[24812]: audit 2024-09-17T08:59:41.779289+0000 mon.a (mon.0) 2357 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:43.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:43 smithi136 bash[24812]: audit 2024-09-17T08:59:41.779774+0000 mon.a (mon.0) 2358 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi078-64688-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:43 smithi078 bash[22670]: audit 2024-09-17T08:59:41.778062+0000 mon.a (mon.0) 2356 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:43 smithi078 bash[22670]: audit 2024-09-17T08:59:41.779289+0000 mon.a (mon.0) 2357 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:43 smithi078 bash[22670]: audit 2024-09-17T08:59:41.779774+0000 mon.a (mon.0) 2358 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi078-64688-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:43 smithi078 bash[32124]: audit 2024-09-17T08:59:41.778062+0000 mon.a (mon.0) 2356 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:43 smithi078 bash[32124]: audit 2024-09-17T08:59:41.779289+0000 mon.a (mon.0) 2357 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:43 smithi078 bash[32124]: audit 2024-09-17T08:59:41.779774+0000 mon.a (mon.0) 2358 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi078-64688-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:44.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:44 smithi136 bash[24812]: audit 2024-09-17T08:59:42.776917+0000 mon.a (mon.0) 2359 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi078-64688-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:44.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:44 smithi136 bash[24812]: cluster 2024-09-17T08:59:42.777174+0000 mon.a (mon.0) 2360 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-09-17T08:59:44.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:44 smithi136 bash[24812]: audit 2024-09-17T08:59:42.780435+0000 mon.a (mon.0) 2361 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi078-64688-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:44.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:44 smithi136 bash[24812]: cluster 2024-09-17T08:59:42.902297+0000 mgr.y (mgr.14532) 326 : cluster [DBG] pgmap v449: 196 pgs: 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:44.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[22670]: audit 2024-09-17T08:59:42.776917+0000 mon.a (mon.0) 2359 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi078-64688-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:44.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[22670]: cluster 2024-09-17T08:59:42.777174+0000 mon.a (mon.0) 2360 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-09-17T08:59:44.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[22670]: audit 2024-09-17T08:59:42.780435+0000 mon.a (mon.0) 2361 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi078-64688-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:44.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[22670]: cluster 2024-09-17T08:59:42.902297+0000 mgr.y (mgr.14532) 326 : cluster [DBG] pgmap v449: 196 pgs: 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:44.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[32124]: audit 2024-09-17T08:59:42.776917+0000 mon.a (mon.0) 2359 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi078-64688-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:44.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[32124]: cluster 2024-09-17T08:59:42.777174+0000 mon.a (mon.0) 2360 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-09-17T08:59:44.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[32124]: audit 2024-09-17T08:59:42.780435+0000 mon.a (mon.0) 2361 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi078-64688-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:44.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:44 smithi078 bash[32124]: cluster 2024-09-17T08:59:42.902297+0000 mgr.y (mgr.14532) 326 : cluster [DBG] pgmap v449: 196 pgs: 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:45 smithi136 bash[24812]: cluster 2024-09-17T08:59:44.227094+0000 mon.a (mon.0) 2362 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-09-17T08:59:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:45 smithi136 bash[24812]: audit 2024-09-17T08:59:44.229735+0000 mon.a (mon.0) 2363 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:45 smithi136 bash[24812]: audit 2024-09-17T08:59:44.795303+0000 mon.a (mon.0) 2364 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi078-64688-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:45 smithi136 bash[24812]: audit 2024-09-17T08:59:44.795832+0000 mon.a (mon.0) 2365 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:45 smithi136 bash[24812]: cluster 2024-09-17T08:59:44.796107+0000 mon.a (mon.0) 2366 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-09-17T08:59:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:45 smithi136 bash[24812]: audit 2024-09-17T08:59:44.811326+0000 mon.a (mon.0) 2367 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:45 smithi136 bash[24812]: cluster 2024-09-17T08:59:44.903158+0000 mgr.y (mgr.14532) 327 : cluster [DBG] pgmap v452: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[32124]: cluster 2024-09-17T08:59:44.227094+0000 mon.a (mon.0) 2362 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[32124]: audit 2024-09-17T08:59:44.229735+0000 mon.a (mon.0) 2363 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[32124]: audit 2024-09-17T08:59:44.795303+0000 mon.a (mon.0) 2364 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi078-64688-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[32124]: audit 2024-09-17T08:59:44.795832+0000 mon.a (mon.0) 2365 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[32124]: cluster 2024-09-17T08:59:44.796107+0000 mon.a (mon.0) 2366 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[32124]: audit 2024-09-17T08:59:44.811326+0000 mon.a (mon.0) 2367 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[32124]: cluster 2024-09-17T08:59:44.903158+0000 mgr.y (mgr.14532) 327 : cluster [DBG] pgmap v452: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[22670]: cluster 2024-09-17T08:59:44.227094+0000 mon.a (mon.0) 2362 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-09-17T08:59:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[22670]: audit 2024-09-17T08:59:44.229735+0000 mon.a (mon.0) 2363 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[22670]: audit 2024-09-17T08:59:44.795303+0000 mon.a (mon.0) 2364 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi078-64688-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[22670]: audit 2024-09-17T08:59:44.795832+0000 mon.a (mon.0) 2365 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[22670]: cluster 2024-09-17T08:59:44.796107+0000 mon.a (mon.0) 2366 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-09-17T08:59:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[22670]: audit 2024-09-17T08:59:44.811326+0000 mon.a (mon.0) 2367 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T08:59:45.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:45 smithi078 bash[22670]: cluster 2024-09-17T08:59:44.903158+0000 mgr.y (mgr.14532) 327 : cluster [DBG] pgmap v452: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:46 smithi136 bash[24812]: cluster 2024-09-17T08:59:45.782440+0000 mon.a (mon.0) 2368 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:46 smithi136 bash[24812]: audit 2024-09-17T08:59:45.793880+0000 mon.a (mon.0) 2369 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:46 smithi136 bash[24812]: cluster 2024-09-17T08:59:45.794145+0000 mon.a (mon.0) 2370 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-09-17T08:59:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:46 smithi136 bash[24812]: audit 2024-09-17T08:59:45.795830+0000 mon.a (mon.0) 2371 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[22670]: cluster 2024-09-17T08:59:45.782440+0000 mon.a (mon.0) 2368 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[22670]: audit 2024-09-17T08:59:45.793880+0000 mon.a (mon.0) 2369 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[22670]: cluster 2024-09-17T08:59:45.794145+0000 mon.a (mon.0) 2370 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[22670]: audit 2024-09-17T08:59:45.795830+0000 mon.a (mon.0) 2371 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[32124]: cluster 2024-09-17T08:59:45.782440+0000 mon.a (mon.0) 2368 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[32124]: audit 2024-09-17T08:59:45.793880+0000 mon.a (mon.0) 2369 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[32124]: cluster 2024-09-17T08:59:45.794145+0000 mon.a (mon.0) 2370 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-09-17T08:59:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:46 smithi078 bash[32124]: audit 2024-09-17T08:59:45.795830+0000 mon.a (mon.0) 2371 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-17T08:59:48.101 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:59:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:59:48.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[22670]: audit 2024-09-17T08:59:46.793609+0000 mon.a (mon.0) 2372 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_count","val": "3"}]': finished 2024-09-17T08:59:48.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[22670]: cluster 2024-09-17T08:59:46.793882+0000 mon.a (mon.0) 2373 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-09-17T08:59:48.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[22670]: audit 2024-09-17T08:59:46.794907+0000 mon.a (mon.0) 2374 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-17T08:59:48.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[22670]: audit 2024-09-17T08:59:46.798812+0000 mon.a (mon.0) 2375 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:48.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[22670]: cluster 2024-09-17T08:59:46.903957+0000 mgr.y (mgr.14532) 328 : cluster [DBG] pgmap v455: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[32124]: audit 2024-09-17T08:59:46.793609+0000 mon.a (mon.0) 2372 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_count","val": "3"}]': finished 2024-09-17T08:59:48.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[32124]: cluster 2024-09-17T08:59:46.793882+0000 mon.a (mon.0) 2373 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-09-17T08:59:48.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[32124]: audit 2024-09-17T08:59:46.794907+0000 mon.a (mon.0) 2374 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-17T08:59:48.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[32124]: audit 2024-09-17T08:59:46.798812+0000 mon.a (mon.0) 2375 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:48.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:47 smithi078 bash[32124]: cluster 2024-09-17T08:59:46.903957+0000 mgr.y (mgr.14532) 328 : cluster [DBG] pgmap v455: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:48.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:47 smithi136 bash[24812]: audit 2024-09-17T08:59:46.793609+0000 mon.a (mon.0) 2372 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_count","val": "3"}]': finished 2024-09-17T08:59:48.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:47 smithi136 bash[24812]: cluster 2024-09-17T08:59:46.793882+0000 mon.a (mon.0) 2373 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-09-17T08:59:48.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:47 smithi136 bash[24812]: audit 2024-09-17T08:59:46.794907+0000 mon.a (mon.0) 2374 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-17T08:59:48.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:47 smithi136 bash[24812]: audit 2024-09-17T08:59:46.798812+0000 mon.a (mon.0) 2375 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:48.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:47 smithi136 bash[24812]: cluster 2024-09-17T08:59:46.903957+0000 mgr.y (mgr.14532) 328 : cluster [DBG] pgmap v455: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:49.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[22670]: audit 2024-09-17T08:59:47.811222+0000 mon.a (mon.0) 2376 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_period","val": "3"}]': finished 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[22670]: audit 2024-09-17T08:59:47.811426+0000 mon.a (mon.0) 2377 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[22670]: cluster 2024-09-17T08:59:47.811568+0000 mon.a (mon.0) 2378 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[22670]: audit 2024-09-17T08:59:47.812741+0000 mon.a (mon.0) 2379 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[22670]: audit 2024-09-17T08:59:47.813817+0000 mon.a (mon.0) 2380 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[32124]: audit 2024-09-17T08:59:47.811222+0000 mon.a (mon.0) 2376 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_period","val": "3"}]': finished 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[32124]: audit 2024-09-17T08:59:47.811426+0000 mon.a (mon.0) 2377 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[32124]: cluster 2024-09-17T08:59:47.811568+0000 mon.a (mon.0) 2378 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-09-17T08:59:49.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[32124]: audit 2024-09-17T08:59:47.812741+0000 mon.a (mon.0) 2379 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T08:59:49.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:48 smithi078 bash[32124]: audit 2024-09-17T08:59:47.813817+0000 mon.a (mon.0) 2380 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:49.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:48 smithi136 bash[24812]: audit 2024-09-17T08:59:47.811222+0000 mon.a (mon.0) 2376 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_period","val": "3"}]': finished 2024-09-17T08:59:49.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:48 smithi136 bash[24812]: audit 2024-09-17T08:59:47.811426+0000 mon.a (mon.0) 2377 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:49.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:48 smithi136 bash[24812]: cluster 2024-09-17T08:59:47.811568+0000 mon.a (mon.0) 2378 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-09-17T08:59:49.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:48 smithi136 bash[24812]: audit 2024-09-17T08:59:47.812741+0000 mon.a (mon.0) 2379 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T08:59:49.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:48 smithi136 bash[24812]: audit 2024-09-17T08:59:47.813817+0000 mon.a (mon.0) 2380 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]: dispatch 2024-09-17T08:59:49.790 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:48.812263+0000 mon.a (mon.0) 2381 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:48.812467+0000 mon.a (mon.0) 2382 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: cluster 2024-09-17T08:59:48.812882+0000 mon.a (mon.0) 2383 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:48.816961+0000 mon.a (mon.0) 2384 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:48.865765+0000 mon.a (mon.0) 2385 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:48.866739+0000 mon.a (mon.0) 2386 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:48.867099+0000 mon.a (mon.0) 2387 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: cluster 2024-09-17T08:59:48.904725+0000 mgr.y (mgr.14532) 329 : cluster [DBG] pgmap v458: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:49.810819+0000 mon.a (mon.0) 2388 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-17T08:59:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:49.811328+0000 mon.a (mon.0) 2389 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: cluster 2024-09-17T08:59:49.811497+0000 mon.a (mon.0) 2390 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[22670]: audit 2024-09-17T08:59:49.812860+0000 mon.a (mon.0) 2391 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi078-64688-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:48.812263+0000 mon.a (mon.0) 2381 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:48.812467+0000 mon.a (mon.0) 2382 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: cluster 2024-09-17T08:59:48.812882+0000 mon.a (mon.0) 2383 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:48.816961+0000 mon.a (mon.0) 2384 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:48.865765+0000 mon.a (mon.0) 2385 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:48.866739+0000 mon.a (mon.0) 2386 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:48.867099+0000 mon.a (mon.0) 2387 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: cluster 2024-09-17T08:59:48.904725+0000 mgr.y (mgr.14532) 329 : cluster [DBG] pgmap v458: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:49.810819+0000 mon.a (mon.0) 2388 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-17T08:59:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:49.811328+0000 mon.a (mon.0) 2389 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: cluster 2024-09-17T08:59:49.811497+0000 mon.a (mon.0) 2390 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-09-17T08:59:50.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:49 smithi078 bash[32124]: audit 2024-09-17T08:59:49.812860+0000 mon.a (mon.0) 2391 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi078-64688-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:48.812263+0000 mon.a (mon.0) 2381 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:48.812467+0000 mon.a (mon.0) 2382 : audit [INF] from='client.? 172.21.15.78:0/2993143547' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi078-64688-58"}]': finished 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: cluster 2024-09-17T08:59:48.812882+0000 mon.a (mon.0) 2383 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:48.816961+0000 mon.a (mon.0) 2384 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:48.865765+0000 mon.a (mon.0) 2385 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:48.866739+0000 mon.a (mon.0) 2386 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:48.867099+0000 mon.a (mon.0) 2387 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T08:59:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: cluster 2024-09-17T08:59:48.904725+0000 mgr.y (mgr.14532) 329 : cluster [DBG] pgmap v458: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:50.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:49.810819+0000 mon.a (mon.0) 2388 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-17T08:59:50.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:49.811328+0000 mon.a (mon.0) 2389 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T08:59:50.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: cluster 2024-09-17T08:59:49.811497+0000 mon.a (mon.0) 2390 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-09-17T08:59:50.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:49 smithi136 bash[24812]: audit 2024-09-17T08:59:49.812860+0000 mon.a (mon.0) 2391 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi078-64688-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:51.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:51 smithi136 bash[24812]: audit 2024-09-17T08:59:49.518068+0000 mgr.y (mgr.14532) 330 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:51.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:51 smithi078 bash[22670]: audit 2024-09-17T08:59:49.518068+0000 mgr.y (mgr.14532) 330 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:51 smithi078 bash[32124]: audit 2024-09-17T08:59:49.518068+0000 mgr.y (mgr.14532) 330 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T08:59:52.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:52 smithi136 bash[24812]: cluster 2024-09-17T08:59:50.905448+0000 mgr.y (mgr.14532) 331 : cluster [DBG] pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:52 smithi136 bash[24812]: cluster 2024-09-17T08:59:51.256706+0000 mon.a (mon.0) 2392 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-09-17T08:59:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:52 smithi136 bash[24812]: audit 2024-09-17T08:59:51.822473+0000 mon.a (mon.0) 2393 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi078-64688-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:52 smithi136 bash[24812]: cluster 2024-09-17T08:59:51.822738+0000 mon.a (mon.0) 2394 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-09-17T08:59:52.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[22670]: cluster 2024-09-17T08:59:50.905448+0000 mgr.y (mgr.14532) 331 : cluster [DBG] pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[22670]: cluster 2024-09-17T08:59:51.256706+0000 mon.a (mon.0) 2392 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-09-17T08:59:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[22670]: audit 2024-09-17T08:59:51.822473+0000 mon.a (mon.0) 2393 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi078-64688-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[22670]: cluster 2024-09-17T08:59:51.822738+0000 mon.a (mon.0) 2394 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-09-17T08:59:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[32124]: cluster 2024-09-17T08:59:50.905448+0000 mgr.y (mgr.14532) 331 : cluster [DBG] pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T08:59:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[32124]: cluster 2024-09-17T08:59:51.256706+0000 mon.a (mon.0) 2392 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-09-17T08:59:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[32124]: audit 2024-09-17T08:59:51.822473+0000 mon.a (mon.0) 2393 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi078-64688-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:52 smithi078 bash[32124]: cluster 2024-09-17T08:59:51.822738+0000 mon.a (mon.0) 2394 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-09-17T08:59:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:53 smithi136 bash[24812]: cluster 2024-09-17T08:59:52.579037+0000 mon.a (mon.0) 2395 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:53.622 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:53 smithi136 bash[24812]: cluster 2024-09-17T08:59:52.828777+0000 mon.a (mon.0) 2396 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-09-17T08:59:53.622 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:53 smithi136 bash[24812]: cluster 2024-09-17T08:59:52.907638+0000 mgr.y (mgr.14532) 332 : cluster [DBG] pgmap v464: 236 pgs: 2 creating+peering, 5 creating+activating, 229 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:59:53.623 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:53 smithi078 bash[22670]: cluster 2024-09-17T08:59:52.579037+0000 mon.a (mon.0) 2395 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:53.623 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:53 smithi078 bash[22670]: cluster 2024-09-17T08:59:52.828777+0000 mon.a (mon.0) 2396 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-09-17T08:59:53.623 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:53 smithi078 bash[22670]: cluster 2024-09-17T08:59:52.907638+0000 mgr.y (mgr.14532) 332 : cluster [DBG] pgmap v464: 236 pgs: 2 creating+peering, 5 creating+activating, 229 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:59:53.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:53 smithi078 bash[32124]: cluster 2024-09-17T08:59:52.579037+0000 mon.a (mon.0) 2395 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:53.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:53 smithi078 bash[32124]: cluster 2024-09-17T08:59:52.828777+0000 mon.a (mon.0) 2396 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-09-17T08:59:53.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:53 smithi078 bash[32124]: cluster 2024-09-17T08:59:52.907638+0000 mgr.y (mgr.14532) 332 : cluster [DBG] pgmap v464: 236 pgs: 2 creating+peering, 5 creating+activating, 229 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T08:59:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:54 smithi078 bash[32124]: cluster 2024-09-17T08:59:53.833215+0000 mon.a (mon.0) 2397 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-09-17T08:59:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:54 smithi078 bash[32124]: audit 2024-09-17T08:59:53.835682+0000 mon.a (mon.0) 2398 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:55.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:54 smithi078 bash[22670]: cluster 2024-09-17T08:59:53.833215+0000 mon.a (mon.0) 2397 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-09-17T08:59:55.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:54 smithi078 bash[22670]: audit 2024-09-17T08:59:53.835682+0000 mon.a (mon.0) 2398 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:55.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:54 smithi136 bash[24812]: cluster 2024-09-17T08:59:53.833215+0000 mon.a (mon.0) 2397 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-09-17T08:59:55.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:54 smithi136 bash[24812]: audit 2024-09-17T08:59:53.835682+0000 mon.a (mon.0) 2398 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:55 smithi136 bash[24812]: audit 2024-09-17T08:59:54.837567+0000 mon.a (mon.0) 2399 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:55 smithi136 bash[24812]: cluster 2024-09-17T08:59:54.837785+0000 mon.a (mon.0) 2400 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-09-17T08:59:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:55 smithi136 bash[24812]: audit 2024-09-17T08:59:54.840025+0000 mon.a (mon.0) 2401 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:55 smithi136 bash[24812]: cluster 2024-09-17T08:59:54.908481+0000 mgr.y (mgr.14532) 333 : cluster [DBG] pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:55 smithi136 bash[24812]: audit 2024-09-17T08:59:55.349283+0000 mon.a (mon.0) 2402 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:56.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[22670]: audit 2024-09-17T08:59:54.837567+0000 mon.a (mon.0) 2399 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[22670]: cluster 2024-09-17T08:59:54.837785+0000 mon.a (mon.0) 2400 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[22670]: audit 2024-09-17T08:59:54.840025+0000 mon.a (mon.0) 2401 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[22670]: cluster 2024-09-17T08:59:54.908481+0000 mgr.y (mgr.14532) 333 : cluster [DBG] pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[22670]: audit 2024-09-17T08:59:55.349283+0000 mon.a (mon.0) 2402 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[32124]: audit 2024-09-17T08:59:54.837567+0000 mon.a (mon.0) 2399 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[32124]: cluster 2024-09-17T08:59:54.837785+0000 mon.a (mon.0) 2400 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[32124]: audit 2024-09-17T08:59:54.840025+0000 mon.a (mon.0) 2401 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]: dispatch 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[32124]: cluster 2024-09-17T08:59:54.908481+0000 mgr.y (mgr.14532) 333 : cluster [DBG] pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T08:59:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:55 smithi078 bash[32124]: audit 2024-09-17T08:59:55.349283+0000 mon.a (mon.0) 2402 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T08:59:57.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:56 smithi136 bash[24812]: audit 2024-09-17T08:59:55.841591+0000 mon.a (mon.0) 2403 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:57.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:56 smithi136 bash[24812]: cluster 2024-09-17T08:59:55.841763+0000 mon.a (mon.0) 2404 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-09-17T08:59:57.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:56 smithi078 bash[22670]: audit 2024-09-17T08:59:55.841591+0000 mon.a (mon.0) 2403 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:57.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:56 smithi078 bash[22670]: cluster 2024-09-17T08:59:55.841763+0000 mon.a (mon.0) 2404 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-09-17T08:59:57.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:56 smithi078 bash[32124]: audit 2024-09-17T08:59:55.841591+0000 mon.a (mon.0) 2403 : audit [INF] from='client.? 172.21.15.78:0/4203520340' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi078-64688-59"}]': finished 2024-09-17T08:59:57.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:56 smithi078 bash[32124]: cluster 2024-09-17T08:59:55.841763+0000 mon.a (mon.0) 2404 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-09-17T08:59:58.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:57 smithi136 bash[24812]: cluster 2024-09-17T08:59:56.876011+0000 mon.a (mon.0) 2405 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-09-17T08:59:58.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:57 smithi136 bash[24812]: audit 2024-09-17T08:59:56.884670+0000 mon.a (mon.0) 2406 : audit [INF] from='client.? 172.21.15.78:0/1509896050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:58.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:57 smithi136 bash[24812]: cluster 2024-09-17T08:59:56.909323+0000 mgr.y (mgr.14532) 334 : cluster [DBG] pgmap v470: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:58.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 08:59:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:08:59:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T08:59:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:57 smithi078 bash[32124]: cluster 2024-09-17T08:59:56.876011+0000 mon.a (mon.0) 2405 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-09-17T08:59:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:57 smithi078 bash[32124]: audit 2024-09-17T08:59:56.884670+0000 mon.a (mon.0) 2406 : audit [INF] from='client.? 172.21.15.78:0/1509896050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:57 smithi078 bash[32124]: cluster 2024-09-17T08:59:56.909323+0000 mgr.y (mgr.14532) 334 : cluster [DBG] pgmap v470: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:58.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:57 smithi078 bash[22670]: cluster 2024-09-17T08:59:56.876011+0000 mon.a (mon.0) 2405 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-09-17T08:59:58.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:57 smithi078 bash[22670]: audit 2024-09-17T08:59:56.884670+0000 mon.a (mon.0) 2406 : audit [INF] from='client.? 172.21.15.78:0/1509896050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T08:59:58.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:57 smithi078 bash[22670]: cluster 2024-09-17T08:59:56.909323+0000 mgr.y (mgr.14532) 334 : cluster [DBG] pgmap v470: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 586 MiB used, 715 GiB / 715 GiB avail 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:7462ddf6::o.RoundTripAppendPP (2576 ms) 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3032 ms) 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (2959 ms) 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3021 ms) 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: setting pool EIO 2024-09-17T08:59:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: max_success 57, min_failed 58 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4024 ms) 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3027 ms) 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (128964 ms total) 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3010 ms) 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9061 ms) 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14868 ms) 2024-09-17T08:59:58.900 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3459 ms) 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30399 ms total) 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2619 ms) 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2619 ms total) 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-17T08:59:58.901 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13946 ms) 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6981 ms) 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7070 ms) 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7027 ms) 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3045 ms) 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7070 ms) 2024-09-17T08:59:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6808 ms) 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7038 ms) 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7048 ms) 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7488 ms) 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6585 ms) 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-17T08:59:58.903 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7084 ms) 2024-09-17T08:59:58.904 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-17T08:59:58.904 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7020 ms) 2024-09-17T08:59:58.904 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-17T08:59:59.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:58 smithi136 bash[24812]: cluster 2024-09-17T08:59:57.868527+0000 mon.a (mon.0) 2407 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:59.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:58 smithi136 bash[24812]: audit 2024-09-17T08:59:57.889973+0000 mon.a (mon.0) 2408 : audit [INF] from='client.? 172.21.15.78:0/1509896050' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:59.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:58 smithi136 bash[24812]: cluster 2024-09-17T08:59:57.890432+0000 mon.a (mon.0) 2409 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-09-17T08:59:59.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:58 smithi078 bash[32124]: cluster 2024-09-17T08:59:57.868527+0000 mon.a (mon.0) 2407 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:58 smithi078 bash[32124]: audit 2024-09-17T08:59:57.889973+0000 mon.a (mon.0) 2408 : audit [INF] from='client.? 172.21.15.78:0/1509896050' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:58 smithi078 bash[32124]: cluster 2024-09-17T08:59:57.890432+0000 mon.a (mon.0) 2409 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-09-17T08:59:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:58 smithi078 bash[22670]: cluster 2024-09-17T08:59:57.868527+0000 mon.a (mon.0) 2407 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T08:59:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:58 smithi078 bash[22670]: audit 2024-09-17T08:59:57.889973+0000 mon.a (mon.0) 2408 : audit [INF] from='client.? 172.21.15.78:0/1509896050' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi078-64688-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T08:59:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:58 smithi078 bash[22670]: cluster 2024-09-17T08:59:57.890432+0000 mon.a (mon.0) 2409 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-09-17T08:59:59.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 08:59:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:00:00.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:59 smithi136 bash[24812]: cluster 2024-09-17T08:59:58.897720+0000 mon.a (mon.0) 2410 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-09-17T09:00:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:59 smithi136 bash[24812]: cluster 2024-09-17T08:59:58.910001+0000 mgr.y (mgr.14532) 335 : cluster [DBG] pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:00:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:59 smithi136 bash[24812]: audit 2024-09-17T08:59:58.927260+0000 mon.a (mon.0) 2411 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:59 smithi136 bash[24812]: audit 2024-09-17T08:59:58.928380+0000 mon.a (mon.0) 2412 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 08:59:59 smithi136 bash[24812]: audit 2024-09-17T08:59:58.928817+0000 mon.a (mon.0) 2413 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi078-64688-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:00.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[22670]: cluster 2024-09-17T08:59:58.897720+0000 mon.a (mon.0) 2410 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-09-17T09:00:00.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[22670]: cluster 2024-09-17T08:59:58.910001+0000 mgr.y (mgr.14532) 335 : cluster [DBG] pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[22670]: audit 2024-09-17T08:59:58.927260+0000 mon.a (mon.0) 2411 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[22670]: audit 2024-09-17T08:59:58.928380+0000 mon.a (mon.0) 2412 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[22670]: audit 2024-09-17T08:59:58.928817+0000 mon.a (mon.0) 2413 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi078-64688-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[32124]: cluster 2024-09-17T08:59:58.897720+0000 mon.a (mon.0) 2410 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[32124]: cluster 2024-09-17T08:59:58.910001+0000 mgr.y (mgr.14532) 335 : cluster [DBG] pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[32124]: audit 2024-09-17T08:59:58.927260+0000 mon.a (mon.0) 2411 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[32124]: audit 2024-09-17T08:59:58.928380+0000 mon.a (mon.0) 2412 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 08:59:59 smithi078 bash[32124]: audit 2024-09-17T08:59:58.928817+0000 mon.a (mon.0) 2413 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi078-64688-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: audit 2024-09-17T08:59:59.527406+0000 mgr.y (mgr.14532) 336 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: audit 2024-09-17T08:59:59.904548+0000 mon.a (mon.0) 2414 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi078-64688-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: cluster 2024-09-17T08:59:59.905414+0000 mon.a (mon.0) 2415 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: audit 2024-09-17T08:59:59.908574+0000 mon.a (mon.0) 2416 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi078-64688-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: cluster 2024-09-17T09:00:00.000127+0000 mon.a (mon.0) 2417 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: cluster 2024-09-17T09:00:00.000161+0000 mon.a (mon.0) 2418 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: cluster 2024-09-17T09:00:00.000178+0000 mon.a (mon.0) 2419 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[22670]: cluster 2024-09-17T09:00:00.000194+0000 mon.a (mon.0) 2420 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-17T09:00:01.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: audit 2024-09-17T08:59:59.527406+0000 mgr.y (mgr.14532) 336 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: audit 2024-09-17T08:59:59.904548+0000 mon.a (mon.0) 2414 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi078-64688-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: cluster 2024-09-17T08:59:59.905414+0000 mon.a (mon.0) 2415 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-09-17T09:00:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: audit 2024-09-17T08:59:59.908574+0000 mon.a (mon.0) 2416 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi078-64688-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: cluster 2024-09-17T09:00:00.000127+0000 mon.a (mon.0) 2417 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-17T09:00:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: cluster 2024-09-17T09:00:00.000161+0000 mon.a (mon.0) 2418 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-17T09:00:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: cluster 2024-09-17T09:00:00.000178+0000 mon.a (mon.0) 2419 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-17T09:00:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:01 smithi078 bash[32124]: cluster 2024-09-17T09:00:00.000194+0000 mon.a (mon.0) 2420 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: audit 2024-09-17T08:59:59.527406+0000 mgr.y (mgr.14532) 336 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: audit 2024-09-17T08:59:59.904548+0000 mon.a (mon.0) 2414 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi078-64688-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: cluster 2024-09-17T08:59:59.905414+0000 mon.a (mon.0) 2415 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: audit 2024-09-17T08:59:59.908574+0000 mon.a (mon.0) 2416 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi078-64688-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: cluster 2024-09-17T09:00:00.000127+0000 mon.a (mon.0) 2417 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: cluster 2024-09-17T09:00:00.000161+0000 mon.a (mon.0) 2418 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: cluster 2024-09-17T09:00:00.000178+0000 mon.a (mon.0) 2419 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-17T09:00:01.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:01 smithi136 bash[24812]: cluster 2024-09-17T09:00:00.000194+0000 mon.a (mon.0) 2420 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-17T09:00:02.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:02 smithi136 bash[24812]: cluster 2024-09-17T09:00:00.910797+0000 mgr.y (mgr.14532) 337 : cluster [DBG] pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:00:02.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:02 smithi136 bash[24812]: cluster 2024-09-17T09:00:01.348791+0000 mon.a (mon.0) 2421 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-09-17T09:00:02.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:02 smithi136 bash[24812]: audit 2024-09-17T09:00:01.914861+0000 mon.a (mon.0) 2422 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi078-64688-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:02.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:02 smithi136 bash[24812]: cluster 2024-09-17T09:00:01.915083+0000 mon.a (mon.0) 2423 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-09-17T09:00:02.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:02 smithi136 bash[24812]: audit 2024-09-17T09:00:01.937441+0000 mon.a (mon.0) 2424 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:02.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:02 smithi136 bash[24812]: audit 2024-09-17T09:00:01.938008+0000 mon.a (mon.0) 2425 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45"}]: dispatch 2024-09-17T09:00:02.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[32124]: cluster 2024-09-17T09:00:00.910797+0000 mgr.y (mgr.14532) 337 : cluster [DBG] pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:00:02.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[32124]: cluster 2024-09-17T09:00:01.348791+0000 mon.a (mon.0) 2421 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-09-17T09:00:02.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[32124]: audit 2024-09-17T09:00:01.914861+0000 mon.a (mon.0) 2422 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi078-64688-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:02.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[32124]: cluster 2024-09-17T09:00:01.915083+0000 mon.a (mon.0) 2423 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-09-17T09:00:02.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[32124]: audit 2024-09-17T09:00:01.937441+0000 mon.a (mon.0) 2424 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:02.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[32124]: audit 2024-09-17T09:00:01.938008+0000 mon.a (mon.0) 2425 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45"}]: dispatch 2024-09-17T09:00:02.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[22670]: cluster 2024-09-17T09:00:00.910797+0000 mgr.y (mgr.14532) 337 : cluster [DBG] pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:00:02.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[22670]: cluster 2024-09-17T09:00:01.348791+0000 mon.a (mon.0) 2421 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-09-17T09:00:02.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[22670]: audit 2024-09-17T09:00:01.914861+0000 mon.a (mon.0) 2422 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi078-64688-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:02.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[22670]: cluster 2024-09-17T09:00:01.915083+0000 mon.a (mon.0) 2423 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-09-17T09:00:02.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[22670]: audit 2024-09-17T09:00:01.937441+0000 mon.a (mon.0) 2424 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:02.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:02 smithi078 bash[22670]: audit 2024-09-17T09:00:01.938008+0000 mon.a (mon.0) 2425 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45"}]: dispatch 2024-09-17T09:00:04.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:03 smithi136 bash[24812]: cluster 2024-09-17T09:00:02.913196+0000 mgr.y (mgr.14532) 338 : cluster [DBG] pgmap v478: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-17T09:00:04.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:03 smithi136 bash[24812]: audit 2024-09-17T09:00:02.924169+0000 mon.a (mon.0) 2426 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45"}]': finished 2024-09-17T09:00:04.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:03 smithi136 bash[24812]: cluster 2024-09-17T09:00:02.924332+0000 mon.a (mon.0) 2427 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-09-17T09:00:04.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:03 smithi078 bash[32124]: cluster 2024-09-17T09:00:02.913196+0000 mgr.y (mgr.14532) 338 : cluster [DBG] pgmap v478: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-17T09:00:04.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:03 smithi078 bash[32124]: audit 2024-09-17T09:00:02.924169+0000 mon.a (mon.0) 2426 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45"}]': finished 2024-09-17T09:00:04.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:03 smithi078 bash[32124]: cluster 2024-09-17T09:00:02.924332+0000 mon.a (mon.0) 2427 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-09-17T09:00:04.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:03 smithi078 bash[22670]: cluster 2024-09-17T09:00:02.913196+0000 mgr.y (mgr.14532) 338 : cluster [DBG] pgmap v478: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-17T09:00:04.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:03 smithi078 bash[22670]: audit 2024-09-17T09:00:02.924169+0000 mon.a (mon.0) 2426 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-45"}]': finished 2024-09-17T09:00:04.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:03 smithi078 bash[22670]: cluster 2024-09-17T09:00:02.924332+0000 mon.a (mon.0) 2427 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-09-17T09:00:05.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:04 smithi136 bash[24812]: cluster 2024-09-17T09:00:03.913136+0000 mon.a (mon.0) 2428 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:05.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:04 smithi136 bash[24812]: cluster 2024-09-17T09:00:03.929426+0000 mon.a (mon.0) 2429 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-09-17T09:00:05.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:04 smithi136 bash[24812]: audit 2024-09-17T09:00:03.931686+0000 mon.a (mon.0) 2430 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:05.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:04 smithi078 bash[22670]: cluster 2024-09-17T09:00:03.913136+0000 mon.a (mon.0) 2428 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:05.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:04 smithi078 bash[22670]: cluster 2024-09-17T09:00:03.929426+0000 mon.a (mon.0) 2429 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-09-17T09:00:05.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:04 smithi078 bash[22670]: audit 2024-09-17T09:00:03.931686+0000 mon.a (mon.0) 2430 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:05.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:04 smithi078 bash[32124]: cluster 2024-09-17T09:00:03.913136+0000 mon.a (mon.0) 2428 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:05.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:04 smithi078 bash[32124]: cluster 2024-09-17T09:00:03.929426+0000 mon.a (mon.0) 2429 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-09-17T09:00:05.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:04 smithi078 bash[32124]: audit 2024-09-17T09:00:03.931686+0000 mon.a (mon.0) 2430 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:06.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:05 smithi136 bash[24812]: cluster 2024-09-17T09:00:04.913992+0000 mgr.y (mgr.14532) 339 : cluster [DBG] pgmap v481: 196 pgs: 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:05 smithi136 bash[24812]: audit 2024-09-17T09:00:04.940727+0000 mon.a (mon.0) 2431 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:05 smithi136 bash[24812]: cluster 2024-09-17T09:00:04.940994+0000 mon.a (mon.0) 2432 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-09-17T09:00:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:05 smithi136 bash[24812]: audit 2024-09-17T09:00:04.943303+0000 mon.a (mon.0) 2433 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:05 smithi136 bash[24812]: audit 2024-09-17T09:00:04.949295+0000 mon.a (mon.0) 2434 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:06.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[22670]: cluster 2024-09-17T09:00:04.913992+0000 mgr.y (mgr.14532) 339 : cluster [DBG] pgmap v481: 196 pgs: 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[22670]: audit 2024-09-17T09:00:04.940727+0000 mon.a (mon.0) 2431 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[22670]: cluster 2024-09-17T09:00:04.940994+0000 mon.a (mon.0) 2432 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[22670]: audit 2024-09-17T09:00:04.943303+0000 mon.a (mon.0) 2433 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[22670]: audit 2024-09-17T09:00:04.949295+0000 mon.a (mon.0) 2434 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[32124]: cluster 2024-09-17T09:00:04.913992+0000 mgr.y (mgr.14532) 339 : cluster [DBG] pgmap v481: 196 pgs: 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[32124]: audit 2024-09-17T09:00:04.940727+0000 mon.a (mon.0) 2431 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[32124]: cluster 2024-09-17T09:00:04.940994+0000 mon.a (mon.0) 2432 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[32124]: audit 2024-09-17T09:00:04.943303+0000 mon.a (mon.0) 2433 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]: dispatch 2024-09-17T09:00:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:05 smithi078 bash[32124]: audit 2024-09-17T09:00:04.949295+0000 mon.a (mon.0) 2434 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.945910+0000 mon.a (mon.0) 2435 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.946367+0000 mon.a (mon.0) 2436 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: cluster 2024-09-17T09:00:05.946738+0000 mon.a (mon.0) 2437 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-09-17T09:00:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.992775+0000 mon.c (mon.2) 277 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.993101+0000 mon.a (mon.0) 2438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.993768+0000 mon.c (mon.2) 278 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.994066+0000 mon.a (mon.0) 2439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.994557+0000 mon.c (mon.2) 279 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:07.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:05.994840+0000 mon.a (mon.0) 2440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:07.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:06 smithi136 bash[24812]: audit 2024-09-17T09:00:06.039281+0000 mon.a (mon.0) 2441 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.945910+0000 mon.a (mon.0) 2435 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.946367+0000 mon.a (mon.0) 2436 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: cluster 2024-09-17T09:00:05.946738+0000 mon.a (mon.0) 2437 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.992775+0000 mon.c (mon.2) 277 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.993101+0000 mon.a (mon.0) 2438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.993768+0000 mon.c (mon.2) 278 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.994066+0000 mon.a (mon.0) 2439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.994557+0000 mon.c (mon.2) 279 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:05.994840+0000 mon.a (mon.0) 2440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[22670]: audit 2024-09-17T09:00:06.039281+0000 mon.a (mon.0) 2441 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.945910+0000 mon.a (mon.0) 2435 : audit [INF] from='client.? 172.21.15.78:0/3640405673' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi078-64688-61"}]': finished 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.946367+0000 mon.a (mon.0) 2436 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: cluster 2024-09-17T09:00:05.946738+0000 mon.a (mon.0) 2437 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.992775+0000 mon.c (mon.2) 277 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.993101+0000 mon.a (mon.0) 2438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.993768+0000 mon.c (mon.2) 278 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.994066+0000 mon.a (mon.0) 2439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.994557+0000 mon.c (mon.2) 279 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:05.994840+0000 mon.a (mon.0) 2440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:07.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:06 smithi078 bash[32124]: audit 2024-09-17T09:00:06.039281+0000 mon.a (mon.0) 2441 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:08.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:00:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:00:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:00:08.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:08 smithi136 bash[24812]: cluster 2024-09-17T09:00:06.914783+0000 mgr.y (mgr.14532) 340 : cluster [DBG] pgmap v484: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:08.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:08 smithi136 bash[24812]: audit 2024-09-17T09:00:06.962764+0000 mon.a (mon.0) 2442 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:08.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:08 smithi136 bash[24812]: audit 2024-09-17T09:00:06.963029+0000 mon.a (mon.0) 2443 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:08.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:08 smithi136 bash[24812]: cluster 2024-09-17T09:00:06.963249+0000 mon.a (mon.0) 2444 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-09-17T09:00:08.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:08 smithi136 bash[24812]: audit 2024-09-17T09:00:06.964785+0000 mon.c (mon.2) 280 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:08.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:08 smithi136 bash[24812]: audit 2024-09-17T09:00:06.964963+0000 mon.a (mon.0) 2445 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:08.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:08 smithi136 bash[24812]: audit 2024-09-17T09:00:06.975683+0000 mon.a (mon.0) 2446 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[32124]: cluster 2024-09-17T09:00:06.914783+0000 mgr.y (mgr.14532) 340 : cluster [DBG] pgmap v484: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[32124]: audit 2024-09-17T09:00:06.962764+0000 mon.a (mon.0) 2442 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[32124]: audit 2024-09-17T09:00:06.963029+0000 mon.a (mon.0) 2443 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[32124]: cluster 2024-09-17T09:00:06.963249+0000 mon.a (mon.0) 2444 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[32124]: audit 2024-09-17T09:00:06.964785+0000 mon.c (mon.2) 280 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[32124]: audit 2024-09-17T09:00:06.964963+0000 mon.a (mon.0) 2445 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[32124]: audit 2024-09-17T09:00:06.975683+0000 mon.a (mon.0) 2446 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[22670]: cluster 2024-09-17T09:00:06.914783+0000 mgr.y (mgr.14532) 340 : cluster [DBG] pgmap v484: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:08.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[22670]: audit 2024-09-17T09:00:06.962764+0000 mon.a (mon.0) 2442 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:08.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[22670]: audit 2024-09-17T09:00:06.963029+0000 mon.a (mon.0) 2443 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:08.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[22670]: cluster 2024-09-17T09:00:06.963249+0000 mon.a (mon.0) 2444 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-09-17T09:00:08.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[22670]: audit 2024-09-17T09:00:06.964785+0000 mon.c (mon.2) 280 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:08.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[22670]: audit 2024-09-17T09:00:06.964963+0000 mon.a (mon.0) 2445 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:08.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:08 smithi078 bash[22670]: audit 2024-09-17T09:00:06.975683+0000 mon.a (mon.0) 2446 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:09.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: audit 2024-09-17T09:00:07.965927+0000 mon.a (mon.0) 2447 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-47"}]': finished 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: cluster 2024-09-17T09:00:08.401789+0000 mon.a (mon.0) 2448 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: audit 2024-09-17T09:00:08.402948+0000 mon.a (mon.0) 2449 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-47", "mode": "writeback"}]: dispatch 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: cluster 2024-09-17T09:00:08.915503+0000 mgr.y (mgr.14532) 341 : cluster [DBG] pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: cluster 2024-09-17T09:00:08.959768+0000 mon.a (mon.0) 2450 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: audit 2024-09-17T09:00:08.970267+0000 mon.a (mon.0) 2451 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: audit 2024-09-17T09:00:08.970604+0000 mon.a (mon.0) 2452 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-47", "mode": "writeback"}]': finished 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: cluster 2024-09-17T09:00:08.970778+0000 mon.a (mon.0) 2453 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-09-17T09:00:09.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:09 smithi136 bash[24812]: audit 2024-09-17T09:00:08.973030+0000 mon.a (mon.0) 2454 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: audit 2024-09-17T09:00:07.965927+0000 mon.a (mon.0) 2447 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-47"}]': finished 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: cluster 2024-09-17T09:00:08.401789+0000 mon.a (mon.0) 2448 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: audit 2024-09-17T09:00:08.402948+0000 mon.a (mon.0) 2449 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-47", "mode": "writeback"}]: dispatch 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: cluster 2024-09-17T09:00:08.915503+0000 mgr.y (mgr.14532) 341 : cluster [DBG] pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: cluster 2024-09-17T09:00:08.959768+0000 mon.a (mon.0) 2450 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: audit 2024-09-17T09:00:08.970267+0000 mon.a (mon.0) 2451 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: audit 2024-09-17T09:00:08.970604+0000 mon.a (mon.0) 2452 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-47", "mode": "writeback"}]': finished 2024-09-17T09:00:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: cluster 2024-09-17T09:00:08.970778+0000 mon.a (mon.0) 2453 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[22670]: audit 2024-09-17T09:00:08.973030+0000 mon.a (mon.0) 2454 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: audit 2024-09-17T09:00:07.965927+0000 mon.a (mon.0) 2447 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-47"}]': finished 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: cluster 2024-09-17T09:00:08.401789+0000 mon.a (mon.0) 2448 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: audit 2024-09-17T09:00:08.402948+0000 mon.a (mon.0) 2449 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-47", "mode": "writeback"}]: dispatch 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: cluster 2024-09-17T09:00:08.915503+0000 mgr.y (mgr.14532) 341 : cluster [DBG] pgmap v487: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: cluster 2024-09-17T09:00:08.959768+0000 mon.a (mon.0) 2450 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: audit 2024-09-17T09:00:08.970267+0000 mon.a (mon.0) 2451 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi078-64688-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: audit 2024-09-17T09:00:08.970604+0000 mon.a (mon.0) 2452 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-47", "mode": "writeback"}]': finished 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: cluster 2024-09-17T09:00:08.970778+0000 mon.a (mon.0) 2453 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-09-17T09:00:09.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:09 smithi078 bash[32124]: audit 2024-09-17T09:00:08.973030+0000 mon.a (mon.0) 2454 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:00:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:10 smithi136 bash[24812]: audit 2024-09-17T09:00:09.537896+0000 mgr.y (mgr.14532) 342 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:10 smithi136 bash[24812]: audit 2024-09-17T09:00:09.975370+0000 mon.a (mon.0) 2455 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:00:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:10 smithi136 bash[24812]: cluster 2024-09-17T09:00:09.975667+0000 mon.a (mon.0) 2456 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-09-17T09:00:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:10 smithi136 bash[24812]: audit 2024-09-17T09:00:09.979845+0000 mon.a (mon.0) 2457 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:00:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:10 smithi136 bash[24812]: audit 2024-09-17T09:00:10.384394+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:10 smithi136 bash[24812]: audit 2024-09-17T09:00:10.386750+0000 mon.a (mon.0) 2459 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:11.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[32124]: audit 2024-09-17T09:00:09.537896+0000 mgr.y (mgr.14532) 342 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[32124]: audit 2024-09-17T09:00:09.975370+0000 mon.a (mon.0) 2455 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[32124]: cluster 2024-09-17T09:00:09.975667+0000 mon.a (mon.0) 2456 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[32124]: audit 2024-09-17T09:00:09.979845+0000 mon.a (mon.0) 2457 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[32124]: audit 2024-09-17T09:00:10.384394+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[32124]: audit 2024-09-17T09:00:10.386750+0000 mon.a (mon.0) 2459 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[22670]: audit 2024-09-17T09:00:09.537896+0000 mgr.y (mgr.14532) 342 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[22670]: audit 2024-09-17T09:00:09.975370+0000 mon.a (mon.0) 2455 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:00:11.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[22670]: cluster 2024-09-17T09:00:09.975667+0000 mon.a (mon.0) 2456 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-09-17T09:00:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[22670]: audit 2024-09-17T09:00:09.979845+0000 mon.a (mon.0) 2457 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:00:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[22670]: audit 2024-09-17T09:00:10.384394+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:10 smithi078 bash[22670]: audit 2024-09-17T09:00:10.386750+0000 mon.a (mon.0) 2459 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: cluster 2024-09-17T09:00:10.916394+0000 mgr.y (mgr.14532) 343 : cluster [DBG] pgmap v490: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:00:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:10.975652+0000 mon.a (mon.0) 2460 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:00:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: cluster 2024-09-17T09:00:10.975859+0000 mon.a (mon.0) 2461 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-09-17T09:00:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:10.982297+0000 mon.c (mon.2) 281 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:10.984538+0000 mon.a (mon.0) 2462 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:00:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:10.985329+0000 mon.a (mon.0) 2463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: cluster 2024-09-17T09:00:11.379878+0000 mon.a (mon.0) 2464 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: cluster 2024-09-17T09:00:11.968483+0000 mon.a (mon.0) 2465 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:11.978124+0000 mon.a (mon.0) 2466 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:00:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:11.978309+0000 mon.a (mon.0) 2467 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: cluster 2024-09-17T09:00:11.978481+0000 mon.a (mon.0) 2468 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-09-17T09:00:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:11.980478+0000 mon.c (mon.2) 282 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:11.980688+0000 mon.a (mon.0) 2469 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:00:12.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:11 smithi136 bash[24812]: audit 2024-09-17T09:00:11.981189+0000 mon.a (mon.0) 2470 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: cluster 2024-09-17T09:00:10.916394+0000 mgr.y (mgr.14532) 343 : cluster [DBG] pgmap v490: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:00:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:10.975652+0000 mon.a (mon.0) 2460 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:00:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: cluster 2024-09-17T09:00:10.975859+0000 mon.a (mon.0) 2461 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-09-17T09:00:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:10.982297+0000 mon.c (mon.2) 281 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:10.984538+0000 mon.a (mon.0) 2462 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:00:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:10.985329+0000 mon.a (mon.0) 2463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: cluster 2024-09-17T09:00:11.379878+0000 mon.a (mon.0) 2464 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: cluster 2024-09-17T09:00:11.968483+0000 mon.a (mon.0) 2465 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:11.978124+0000 mon.a (mon.0) 2466 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:00:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:11.978309+0000 mon.a (mon.0) 2467 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: cluster 2024-09-17T09:00:11.978481+0000 mon.a (mon.0) 2468 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-09-17T09:00:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:11.980478+0000 mon.c (mon.2) 282 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:11.980688+0000 mon.a (mon.0) 2469 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[32124]: audit 2024-09-17T09:00:11.981189+0000 mon.a (mon.0) 2470 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: cluster 2024-09-17T09:00:10.916394+0000 mgr.y (mgr.14532) 343 : cluster [DBG] pgmap v490: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:10.975652+0000 mon.a (mon.0) 2460 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: cluster 2024-09-17T09:00:10.975859+0000 mon.a (mon.0) 2461 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:10.982297+0000 mon.c (mon.2) 281 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:10.984538+0000 mon.a (mon.0) 2462 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:10.985329+0000 mon.a (mon.0) 2463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: cluster 2024-09-17T09:00:11.379878+0000 mon.a (mon.0) 2464 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:12.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: cluster 2024-09-17T09:00:11.968483+0000 mon.a (mon.0) 2465 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:12.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:11.978124+0000 mon.a (mon.0) 2466 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:00:12.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:11.978309+0000 mon.a (mon.0) 2467 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:12.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: cluster 2024-09-17T09:00:11.978481+0000 mon.a (mon.0) 2468 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-09-17T09:00:12.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:11.980478+0000 mon.c (mon.2) 282 : audit [INF] from='client.? 172.21.15.78:0/1674728763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:12.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:11.980688+0000 mon.a (mon.0) 2469 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:00:12.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:11 smithi078 bash[22670]: audit 2024-09-17T09:00:11.981189+0000 mon.a (mon.0) 2470 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]: dispatch 2024-09-17T09:00:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: cluster 2024-09-17T09:00:12.918510+0000 mgr.y (mgr.14532) 344 : cluster [DBG] pgmap v493: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: audit 2024-09-17T09:00:12.981896+0000 mon.a (mon.0) 2471 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:00:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: audit 2024-09-17T09:00:12.982072+0000 mon.a (mon.0) 2472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: cluster 2024-09-17T09:00:12.982584+0000 mon.a (mon.0) 2473 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-09-17T09:00:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: audit 2024-09-17T09:00:12.987029+0000 mon.a (mon.0) 2474 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-17T09:00:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: audit 2024-09-17T09:00:13.028437+0000 mon.a (mon.0) 2475 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: audit 2024-09-17T09:00:13.029371+0000 mon.a (mon.0) 2476 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:14.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:14 smithi136 bash[24812]: audit 2024-09-17T09:00:13.029804+0000 mon.a (mon.0) 2477 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi078-64688-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:13 smithi078 bash[22670]: cluster 2024-09-17T09:00:12.918510+0000 mgr.y (mgr.14532) 344 : cluster [DBG] pgmap v493: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:13 smithi078 bash[22670]: audit 2024-09-17T09:00:12.981896+0000 mon.a (mon.0) 2471 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:13 smithi078 bash[22670]: audit 2024-09-17T09:00:12.982072+0000 mon.a (mon.0) 2472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[22670]: cluster 2024-09-17T09:00:12.982584+0000 mon.a (mon.0) 2473 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[22670]: audit 2024-09-17T09:00:12.987029+0000 mon.a (mon.0) 2474 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[22670]: audit 2024-09-17T09:00:13.028437+0000 mon.a (mon.0) 2475 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[22670]: audit 2024-09-17T09:00:13.029371+0000 mon.a (mon.0) 2476 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[22670]: audit 2024-09-17T09:00:13.029804+0000 mon.a (mon.0) 2477 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi078-64688-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: cluster 2024-09-17T09:00:12.918510+0000 mgr.y (mgr.14532) 344 : cluster [DBG] pgmap v493: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: audit 2024-09-17T09:00:12.981896+0000 mon.a (mon.0) 2471 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: audit 2024-09-17T09:00:12.982072+0000 mon.a (mon.0) 2472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi078-64688-62"}]': finished 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: cluster 2024-09-17T09:00:12.982584+0000 mon.a (mon.0) 2473 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: audit 2024-09-17T09:00:12.987029+0000 mon.a (mon.0) 2474 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: audit 2024-09-17T09:00:13.028437+0000 mon.a (mon.0) 2475 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: audit 2024-09-17T09:00:13.029371+0000 mon.a (mon.0) 2476 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:14 smithi078 bash[32124]: audit 2024-09-17T09:00:13.029804+0000 mon.a (mon.0) 2477 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi078-64688-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:15.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:15 smithi136 bash[24812]: audit 2024-09-17T09:00:13.984190+0000 mon.a (mon.0) 2478 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-17T09:00:15.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:15 smithi136 bash[24812]: audit 2024-09-17T09:00:13.984616+0000 mon.a (mon.0) 2479 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi078-64688-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:15.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:15 smithi136 bash[24812]: cluster 2024-09-17T09:00:13.984824+0000 mon.a (mon.0) 2480 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-09-17T09:00:15.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:15 smithi136 bash[24812]: audit 2024-09-17T09:00:13.986811+0000 mon.a (mon.0) 2481 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-17T09:00:15.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:15 smithi136 bash[24812]: audit 2024-09-17T09:00:13.987177+0000 mon.a (mon.0) 2482 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi078-64688-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[32124]: audit 2024-09-17T09:00:13.984190+0000 mon.a (mon.0) 2478 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-17T09:00:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[32124]: audit 2024-09-17T09:00:13.984616+0000 mon.a (mon.0) 2479 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi078-64688-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[32124]: cluster 2024-09-17T09:00:13.984824+0000 mon.a (mon.0) 2480 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-09-17T09:00:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[32124]: audit 2024-09-17T09:00:13.986811+0000 mon.a (mon.0) 2481 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-17T09:00:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[32124]: audit 2024-09-17T09:00:13.987177+0000 mon.a (mon.0) 2482 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi078-64688-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[22670]: audit 2024-09-17T09:00:13.984190+0000 mon.a (mon.0) 2478 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-17T09:00:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[22670]: audit 2024-09-17T09:00:13.984616+0000 mon.a (mon.0) 2479 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi078-64688-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[22670]: cluster 2024-09-17T09:00:13.984824+0000 mon.a (mon.0) 2480 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-09-17T09:00:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[22670]: audit 2024-09-17T09:00:13.986811+0000 mon.a (mon.0) 2481 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-17T09:00:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:15 smithi078 bash[22670]: audit 2024-09-17T09:00:13.987177+0000 mon.a (mon.0) 2482 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi078-64688-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:16.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:16 smithi136 bash[24812]: cluster 2024-09-17T09:00:14.919337+0000 mgr.y (mgr.14532) 345 : cluster [DBG] pgmap v496: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:16.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:16 smithi136 bash[24812]: audit 2024-09-17T09:00:14.992636+0000 mon.a (mon.0) 2483 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-17T09:00:16.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:16 smithi136 bash[24812]: cluster 2024-09-17T09:00:15.431768+0000 mon.a (mon.0) 2484 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-09-17T09:00:16.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:16 smithi136 bash[24812]: audit 2024-09-17T09:00:15.993014+0000 mon.a (mon.0) 2485 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi078-64688-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:16.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:16 smithi136 bash[24812]: cluster 2024-09-17T09:00:15.993239+0000 mon.a (mon.0) 2486 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-09-17T09:00:16.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[22670]: cluster 2024-09-17T09:00:14.919337+0000 mgr.y (mgr.14532) 345 : cluster [DBG] pgmap v496: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:16.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[22670]: audit 2024-09-17T09:00:14.992636+0000 mon.a (mon.0) 2483 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[22670]: cluster 2024-09-17T09:00:15.431768+0000 mon.a (mon.0) 2484 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[22670]: audit 2024-09-17T09:00:15.993014+0000 mon.a (mon.0) 2485 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi078-64688-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[22670]: cluster 2024-09-17T09:00:15.993239+0000 mon.a (mon.0) 2486 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[32124]: cluster 2024-09-17T09:00:14.919337+0000 mgr.y (mgr.14532) 345 : cluster [DBG] pgmap v496: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[32124]: audit 2024-09-17T09:00:14.992636+0000 mon.a (mon.0) 2483 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[32124]: cluster 2024-09-17T09:00:15.431768+0000 mon.a (mon.0) 2484 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[32124]: audit 2024-09-17T09:00:15.993014+0000 mon.a (mon.0) 2485 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi078-64688-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:16.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:16 smithi078 bash[32124]: cluster 2024-09-17T09:00:15.993239+0000 mon.a (mon.0) 2486 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-09-17T09:00:17.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:17 smithi136 bash[24812]: audit 2024-09-17T09:00:16.536005+0000 mon.a (mon.0) 2487 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:17 smithi136 bash[24812]: cluster 2024-09-17T09:00:16.920079+0000 mgr.y (mgr.14532) 346 : cluster [DBG] pgmap v499: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:17 smithi136 bash[24812]: audit 2024-09-17T09:00:16.992805+0000 mon.a (mon.0) 2488 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:17 smithi136 bash[24812]: cluster 2024-09-17T09:00:16.992956+0000 mon.a (mon.0) 2489 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-09-17T09:00:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:17 smithi136 bash[24812]: audit 2024-09-17T09:00:16.995031+0000 mon.a (mon.0) 2490 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:17.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[32124]: audit 2024-09-17T09:00:16.536005+0000 mon.a (mon.0) 2487 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[32124]: cluster 2024-09-17T09:00:16.920079+0000 mgr.y (mgr.14532) 346 : cluster [DBG] pgmap v499: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[32124]: audit 2024-09-17T09:00:16.992805+0000 mon.a (mon.0) 2488 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[32124]: cluster 2024-09-17T09:00:16.992956+0000 mon.a (mon.0) 2489 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[32124]: audit 2024-09-17T09:00:16.995031+0000 mon.a (mon.0) 2490 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[22670]: audit 2024-09-17T09:00:16.536005+0000 mon.a (mon.0) 2487 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[22670]: cluster 2024-09-17T09:00:16.920079+0000 mgr.y (mgr.14532) 346 : cluster [DBG] pgmap v499: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[22670]: audit 2024-09-17T09:00:16.992805+0000 mon.a (mon.0) 2488 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[22670]: cluster 2024-09-17T09:00:16.992956+0000 mon.a (mon.0) 2489 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-09-17T09:00:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[22670]: audit 2024-09-17T09:00:16.995031+0000 mon.a (mon.0) 2490 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:18.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:00:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:00:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:00:18.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:18 smithi136 bash[24812]: cluster 2024-09-17T09:00:17.447896+0000 mon.a (mon.0) 2491 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:18.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:18 smithi136 bash[24812]: audit 2024-09-17T09:00:17.997470+0000 mon.a (mon.0) 2492 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]': finished 2024-09-17T09:00:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:18 smithi136 bash[24812]: cluster 2024-09-17T09:00:17.998130+0000 mon.a (mon.0) 2493 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-09-17T09:00:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:18 smithi136 bash[24812]: audit 2024-09-17T09:00:18.003871+0000 mon.a (mon.0) 2494 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:18 smithi136 bash[24812]: audit 2024-09-17T09:00:18.065204+0000 mon.a (mon.0) 2495 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:18 smithi136 bash[24812]: audit 2024-09-17T09:00:18.066087+0000 mon.a (mon.0) 2496 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:18.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[22670]: cluster 2024-09-17T09:00:17.447896+0000 mon.a (mon.0) 2491 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[22670]: audit 2024-09-17T09:00:17.997470+0000 mon.a (mon.0) 2492 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]': finished 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[22670]: cluster 2024-09-17T09:00:17.998130+0000 mon.a (mon.0) 2493 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[22670]: audit 2024-09-17T09:00:18.003871+0000 mon.a (mon.0) 2494 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[22670]: audit 2024-09-17T09:00:18.065204+0000 mon.a (mon.0) 2495 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[22670]: audit 2024-09-17T09:00:18.066087+0000 mon.a (mon.0) 2496 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[32124]: cluster 2024-09-17T09:00:17.447896+0000 mon.a (mon.0) 2491 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[32124]: audit 2024-09-17T09:00:17.997470+0000 mon.a (mon.0) 2492 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]': finished 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[32124]: cluster 2024-09-17T09:00:17.998130+0000 mon.a (mon.0) 2493 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[32124]: audit 2024-09-17T09:00:18.003871+0000 mon.a (mon.0) 2494 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:18.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[32124]: audit 2024-09-17T09:00:18.065204+0000 mon.a (mon.0) 2495 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:18.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:18 smithi078 bash[32124]: audit 2024-09-17T09:00:18.066087+0000 mon.a (mon.0) 2496 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-47"}]: dispatch 2024-09-17T09:00:20.020 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:00:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:00:20.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:20 smithi136 bash[24812]: cluster 2024-09-17T09:00:18.920844+0000 mgr.y (mgr.14532) 347 : cluster [DBG] pgmap v502: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-17T09:00:20.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:20 smithi136 bash[24812]: audit 2024-09-17T09:00:19.008259+0000 mon.a (mon.0) 2497 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:20 smithi136 bash[24812]: cluster 2024-09-17T09:00:19.008458+0000 mon.a (mon.0) 2498 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-09-17T09:00:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:20 smithi136 bash[24812]: audit 2024-09-17T09:00:19.010316+0000 mon.a (mon.0) 2499 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[32124]: cluster 2024-09-17T09:00:18.920844+0000 mgr.y (mgr.14532) 347 : cluster [DBG] pgmap v502: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[32124]: audit 2024-09-17T09:00:19.008259+0000 mon.a (mon.0) 2497 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[32124]: cluster 2024-09-17T09:00:19.008458+0000 mon.a (mon.0) 2498 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[32124]: audit 2024-09-17T09:00:19.010316+0000 mon.a (mon.0) 2499 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[22670]: cluster 2024-09-17T09:00:18.920844+0000 mgr.y (mgr.14532) 347 : cluster [DBG] pgmap v502: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[22670]: audit 2024-09-17T09:00:19.008259+0000 mon.a (mon.0) 2497 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[22670]: cluster 2024-09-17T09:00:19.008458+0000 mon.a (mon.0) 2498 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-09-17T09:00:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:20 smithi078 bash[22670]: audit 2024-09-17T09:00:19.010316+0000 mon.a (mon.0) 2499 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]: dispatch 2024-09-17T09:00:21.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:19.549241+0000 mgr.y (mgr.14532) 348 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:20.006301+0000 mon.a (mon.0) 2500 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: cluster 2024-09-17T09:00:20.006815+0000 mon.a (mon.0) 2501 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:20.011708+0000 mon.a (mon.0) 2502 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:20.045818+0000 mon.a (mon.0) 2503 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:20.046796+0000 mon.a (mon.0) 2504 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:20.047252+0000 mon.a (mon.0) 2505 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi078-64688-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:21.007674+0000 mon.a (mon.0) 2506 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:21.009258+0000 mon.a (mon.0) 2507 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi078-64688-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: cluster 2024-09-17T09:00:21.009736+0000 mon.a (mon.0) 2508 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-09-17T09:00:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:21 smithi136 bash[24812]: audit 2024-09-17T09:00:21.015380+0000 mon.a (mon.0) 2509 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi078-64688-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:19.549241+0000 mgr.y (mgr.14532) 348 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:20.006301+0000 mon.a (mon.0) 2500 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: cluster 2024-09-17T09:00:20.006815+0000 mon.a (mon.0) 2501 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:20.011708+0000 mon.a (mon.0) 2502 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:20.045818+0000 mon.a (mon.0) 2503 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:20.046796+0000 mon.a (mon.0) 2504 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:20.047252+0000 mon.a (mon.0) 2505 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi078-64688-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:21.007674+0000 mon.a (mon.0) 2506 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:21.009258+0000 mon.a (mon.0) 2507 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi078-64688-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: cluster 2024-09-17T09:00:21.009736+0000 mon.a (mon.0) 2508 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[22670]: audit 2024-09-17T09:00:21.015380+0000 mon.a (mon.0) 2509 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi078-64688-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:19.549241+0000 mgr.y (mgr.14532) 348 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:20.006301+0000 mon.a (mon.0) 2500 : audit [INF] from='client.? 172.21.15.78:0/1660374267' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi078-64688-63"}]': finished 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: cluster 2024-09-17T09:00:20.006815+0000 mon.a (mon.0) 2501 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:20.011708+0000 mon.a (mon.0) 2502 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:20.045818+0000 mon.a (mon.0) 2503 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:20.046796+0000 mon.a (mon.0) 2504 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:20.047252+0000 mon.a (mon.0) 2505 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi078-64688-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:21.007674+0000 mon.a (mon.0) 2506 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:21.009258+0000 mon.a (mon.0) 2507 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi078-64688-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:21.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: cluster 2024-09-17T09:00:21.009736+0000 mon.a (mon.0) 2508 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-09-17T09:00:21.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:21 smithi078 bash[32124]: audit 2024-09-17T09:00:21.015380+0000 mon.a (mon.0) 2509 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi078-64688-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:22.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:22 smithi136 bash[24812]: cluster 2024-09-17T09:00:20.921619+0000 mgr.y (mgr.14532) 349 : cluster [DBG] pgmap v505: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:00:22.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:22 smithi136 bash[24812]: audit 2024-09-17T09:00:21.055409+0000 mon.a (mon.0) 2510 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:22.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:22 smithi078 bash[22670]: cluster 2024-09-17T09:00:20.921619+0000 mgr.y (mgr.14532) 349 : cluster [DBG] pgmap v505: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:00:22.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:22 smithi078 bash[22670]: audit 2024-09-17T09:00:21.055409+0000 mon.a (mon.0) 2510 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:22.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:22 smithi078 bash[32124]: cluster 2024-09-17T09:00:20.921619+0000 mgr.y (mgr.14532) 349 : cluster [DBG] pgmap v505: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:00:22.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:22 smithi078 bash[32124]: audit 2024-09-17T09:00:21.055409+0000 mon.a (mon.0) 2510 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:22.453435+0000 mon.a (mon.0) 2511 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: cluster 2024-09-17T09:00:22.453559+0000 mon.a (mon.0) 2512 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:22.454559+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:22.455077+0000 mon.a (mon.0) 2514 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: cluster 2024-09-17T09:00:22.922693+0000 mgr.y (mgr.14532) 350 : cluster [DBG] pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:22.996489+0000 mon.a (mon.0) 2515 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:22.998082+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:23.005792+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:23.018385+0000 mon.a (mon.0) 2518 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi078-64688-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:23.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:23.018665+0000 mon.a (mon.0) 2519 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-49"}]': finished 2024-09-17T09:00:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: cluster 2024-09-17T09:00:23.018813+0000 mon.a (mon.0) 2520 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-09-17T09:00:23.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:23 smithi136 bash[24812]: audit 2024-09-17T09:00:23.021928+0000 mon.a (mon.0) 2521 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-49", "mode": "readproxy"}]: dispatch 2024-09-17T09:00:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:22.453435+0000 mon.a (mon.0) 2511 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: cluster 2024-09-17T09:00:22.453559+0000 mon.a (mon.0) 2512 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-09-17T09:00:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:22.454559+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:00:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:22.455077+0000 mon.a (mon.0) 2514 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: cluster 2024-09-17T09:00:22.922693+0000 mgr.y (mgr.14532) 350 : cluster [DBG] pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:00:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:22.996489+0000 mon.a (mon.0) 2515 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:00:23.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:22.998082+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:23.005792+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:23.018385+0000 mon.a (mon.0) 2518 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi078-64688-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:23.018665+0000 mon.a (mon.0) 2519 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-49"}]': finished 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: cluster 2024-09-17T09:00:23.018813+0000 mon.a (mon.0) 2520 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[22670]: audit 2024-09-17T09:00:23.021928+0000 mon.a (mon.0) 2521 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-49", "mode": "readproxy"}]: dispatch 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:22.453435+0000 mon.a (mon.0) 2511 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: cluster 2024-09-17T09:00:22.453559+0000 mon.a (mon.0) 2512 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:22.454559+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:00:23.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:22.455077+0000 mon.a (mon.0) 2514 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: cluster 2024-09-17T09:00:22.922693+0000 mgr.y (mgr.14532) 350 : cluster [DBG] pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:22.996489+0000 mon.a (mon.0) 2515 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:22.998082+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:23.005792+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:23.018385+0000 mon.a (mon.0) 2518 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi078-64688-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:23.018665+0000 mon.a (mon.0) 2519 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-49"}]': finished 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: cluster 2024-09-17T09:00:23.018813+0000 mon.a (mon.0) 2520 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-09-17T09:00:23.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:23 smithi078 bash[32124]: audit 2024-09-17T09:00:23.021928+0000 mon.a (mon.0) 2521 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-49", "mode": "readproxy"}]: dispatch 2024-09-17T09:00:24.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:24 smithi136 bash[24812]: cluster 2024-09-17T09:00:23.457513+0000 mon.a (mon.0) 2522 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:24.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:24 smithi136 bash[24812]: cluster 2024-09-17T09:00:24.010882+0000 mon.a (mon.0) 2523 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:24.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:24 smithi136 bash[24812]: audit 2024-09-17T09:00:24.021043+0000 mon.a (mon.0) 2524 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-49", "mode": "readproxy"}]': finished 2024-09-17T09:00:24.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:24 smithi136 bash[24812]: cluster 2024-09-17T09:00:24.021535+0000 mon.a (mon.0) 2525 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-09-17T09:00:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[22670]: cluster 2024-09-17T09:00:23.457513+0000 mon.a (mon.0) 2522 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[22670]: cluster 2024-09-17T09:00:24.010882+0000 mon.a (mon.0) 2523 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[22670]: audit 2024-09-17T09:00:24.021043+0000 mon.a (mon.0) 2524 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-49", "mode": "readproxy"}]': finished 2024-09-17T09:00:24.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[22670]: cluster 2024-09-17T09:00:24.021535+0000 mon.a (mon.0) 2525 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-09-17T09:00:24.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[32124]: cluster 2024-09-17T09:00:23.457513+0000 mon.a (mon.0) 2522 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:24.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[32124]: cluster 2024-09-17T09:00:24.010882+0000 mon.a (mon.0) 2523 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:24.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[32124]: audit 2024-09-17T09:00:24.021043+0000 mon.a (mon.0) 2524 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-49", "mode": "readproxy"}]': finished 2024-09-17T09:00:24.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:24 smithi078 bash[32124]: cluster 2024-09-17T09:00:24.021535+0000 mon.a (mon.0) 2525 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-09-17T09:00:26.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:26 smithi136 bash[24812]: cluster 2024-09-17T09:00:24.923453+0000 mgr.y (mgr.14532) 351 : cluster [DBG] pgmap v511: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:00:26.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:26 smithi136 bash[24812]: cluster 2024-09-17T09:00:25.025974+0000 mon.a (mon.0) 2526 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-09-17T09:00:26.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:26 smithi136 bash[24812]: audit 2024-09-17T09:00:25.028688+0000 mon.a (mon.0) 2527 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:26.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:26 smithi136 bash[24812]: audit 2024-09-17T09:00:25.415749+0000 mon.a (mon.0) 2528 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:26.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[32124]: cluster 2024-09-17T09:00:24.923453+0000 mgr.y (mgr.14532) 351 : cluster [DBG] pgmap v511: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:00:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[32124]: cluster 2024-09-17T09:00:25.025974+0000 mon.a (mon.0) 2526 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-09-17T09:00:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[32124]: audit 2024-09-17T09:00:25.028688+0000 mon.a (mon.0) 2527 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[32124]: audit 2024-09-17T09:00:25.415749+0000 mon.a (mon.0) 2528 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[22670]: cluster 2024-09-17T09:00:24.923453+0000 mgr.y (mgr.14532) 351 : cluster [DBG] pgmap v511: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:00:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[22670]: cluster 2024-09-17T09:00:25.025974+0000 mon.a (mon.0) 2526 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-09-17T09:00:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[22670]: audit 2024-09-17T09:00:25.028688+0000 mon.a (mon.0) 2527 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:26 smithi078 bash[22670]: audit 2024-09-17T09:00:25.415749+0000 mon.a (mon.0) 2528 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:27.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:27 smithi078 bash[22670]: audit 2024-09-17T09:00:26.027637+0000 mon.a (mon.0) 2529 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:27.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:27 smithi078 bash[22670]: cluster 2024-09-17T09:00:26.027824+0000 mon.a (mon.0) 2530 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-09-17T09:00:27.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:27 smithi078 bash[22670]: audit 2024-09-17T09:00:26.030195+0000 mon.a (mon.0) 2531 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:27 smithi078 bash[32124]: audit 2024-09-17T09:00:26.027637+0000 mon.a (mon.0) 2529 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:27 smithi078 bash[32124]: cluster 2024-09-17T09:00:26.027824+0000 mon.a (mon.0) 2530 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-09-17T09:00:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:27 smithi078 bash[32124]: audit 2024-09-17T09:00:26.030195+0000 mon.a (mon.0) 2531 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:27.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:27 smithi136 bash[24812]: audit 2024-09-17T09:00:26.027637+0000 mon.a (mon.0) 2529 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:27.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:27 smithi136 bash[24812]: cluster 2024-09-17T09:00:26.027824+0000 mon.a (mon.0) 2530 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-09-17T09:00:27.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:27 smithi136 bash[24812]: audit 2024-09-17T09:00:26.030195+0000 mon.a (mon.0) 2531 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]: dispatch 2024-09-17T09:00:28.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:00:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:00:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[22670]: cluster 2024-09-17T09:00:26.924212+0000 mgr.y (mgr.14532) 352 : cluster [DBG] pgmap v514: 228 pgs: 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[22670]: audit 2024-09-17T09:00:27.032265+0000 mon.a (mon.0) 2532 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[22670]: cluster 2024-09-17T09:00:27.032636+0000 mon.a (mon.0) 2533 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[22670]: audit 2024-09-17T09:00:27.077581+0000 mon.a (mon.0) 2534 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[22670]: audit 2024-09-17T09:00:27.078577+0000 mon.a (mon.0) 2535 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[22670]: audit 2024-09-17T09:00:27.078977+0000 mon.a (mon.0) 2536 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi078-64688-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[32124]: cluster 2024-09-17T09:00:26.924212+0000 mgr.y (mgr.14532) 352 : cluster [DBG] pgmap v514: 228 pgs: 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:28.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[32124]: audit 2024-09-17T09:00:27.032265+0000 mon.a (mon.0) 2532 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:28.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[32124]: cluster 2024-09-17T09:00:27.032636+0000 mon.a (mon.0) 2533 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-09-17T09:00:28.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[32124]: audit 2024-09-17T09:00:27.077581+0000 mon.a (mon.0) 2534 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:28.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[32124]: audit 2024-09-17T09:00:27.078577+0000 mon.a (mon.0) 2535 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:28.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:28 smithi078 bash[32124]: audit 2024-09-17T09:00:27.078977+0000 mon.a (mon.0) 2536 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi078-64688-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:28.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:28 smithi136 bash[24812]: cluster 2024-09-17T09:00:26.924212+0000 mgr.y (mgr.14532) 352 : cluster [DBG] pgmap v514: 228 pgs: 228 active+clean; 8.4 MiB data, 598 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:28.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:28 smithi136 bash[24812]: audit 2024-09-17T09:00:27.032265+0000 mon.a (mon.0) 2532 : audit [INF] from='client.? 172.21.15.78:0/3945263116' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi078-64688-64"}]': finished 2024-09-17T09:00:28.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:28 smithi136 bash[24812]: cluster 2024-09-17T09:00:27.032636+0000 mon.a (mon.0) 2533 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-09-17T09:00:28.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:28 smithi136 bash[24812]: audit 2024-09-17T09:00:27.077581+0000 mon.a (mon.0) 2534 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:28.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:28 smithi136 bash[24812]: audit 2024-09-17T09:00:27.078577+0000 mon.a (mon.0) 2535 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:28.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:28 smithi136 bash[24812]: audit 2024-09-17T09:00:27.078977+0000 mon.a (mon.0) 2536 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi078-64688-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:29.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:00:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:00:29.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:29 smithi136 bash[24812]: audit 2024-09-17T09:00:28.058658+0000 mon.a (mon.0) 2537 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi078-64688-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:29.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:29 smithi136 bash[24812]: cluster 2024-09-17T09:00:28.058851+0000 mon.a (mon.0) 2538 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-09-17T09:00:29.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:29 smithi136 bash[24812]: audit 2024-09-17T09:00:28.060130+0000 mon.a (mon.0) 2539 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi078-64688-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:29.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:29 smithi078 bash[22670]: audit 2024-09-17T09:00:28.058658+0000 mon.a (mon.0) 2537 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi078-64688-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:29.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:29 smithi078 bash[22670]: cluster 2024-09-17T09:00:28.058851+0000 mon.a (mon.0) 2538 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-09-17T09:00:29.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:29 smithi078 bash[22670]: audit 2024-09-17T09:00:28.060130+0000 mon.a (mon.0) 2539 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi078-64688-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:29.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:29 smithi078 bash[32124]: audit 2024-09-17T09:00:28.058658+0000 mon.a (mon.0) 2537 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi078-64688-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:29.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:29 smithi078 bash[32124]: cluster 2024-09-17T09:00:28.058851+0000 mon.a (mon.0) 2538 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-09-17T09:00:29.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:29 smithi078 bash[32124]: audit 2024-09-17T09:00:28.060130+0000 mon.a (mon.0) 2539 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi078-64688-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:30.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:30 smithi136 bash[24812]: cluster 2024-09-17T09:00:28.924984+0000 mgr.y (mgr.14532) 353 : cluster [DBG] pgmap v517: 228 pgs: 228 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T09:00:30.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:30 smithi136 bash[24812]: cluster 2024-09-17T09:00:29.508818+0000 mon.a (mon.0) 2540 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-09-17T09:00:30.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:30 smithi136 bash[24812]: audit 2024-09-17T09:00:29.560613+0000 mgr.y (mgr.14532) 354 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:30.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:30 smithi136 bash[24812]: audit 2024-09-17T09:00:30.062731+0000 mon.a (mon.0) 2541 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi078-64688-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:30.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:30 smithi136 bash[24812]: cluster 2024-09-17T09:00:30.062878+0000 mon.a (mon.0) 2542 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-09-17T09:00:30.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[22670]: cluster 2024-09-17T09:00:28.924984+0000 mgr.y (mgr.14532) 353 : cluster [DBG] pgmap v517: 228 pgs: 228 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[22670]: cluster 2024-09-17T09:00:29.508818+0000 mon.a (mon.0) 2540 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[22670]: audit 2024-09-17T09:00:29.560613+0000 mgr.y (mgr.14532) 354 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[22670]: audit 2024-09-17T09:00:30.062731+0000 mon.a (mon.0) 2541 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi078-64688-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[22670]: cluster 2024-09-17T09:00:30.062878+0000 mon.a (mon.0) 2542 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[32124]: cluster 2024-09-17T09:00:28.924984+0000 mgr.y (mgr.14532) 353 : cluster [DBG] pgmap v517: 228 pgs: 228 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[32124]: cluster 2024-09-17T09:00:29.508818+0000 mon.a (mon.0) 2540 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[32124]: audit 2024-09-17T09:00:29.560613+0000 mgr.y (mgr.14532) 354 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[32124]: audit 2024-09-17T09:00:30.062731+0000 mon.a (mon.0) 2541 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi078-64688-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:30.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:30 smithi078 bash[32124]: cluster 2024-09-17T09:00:30.062878+0000 mon.a (mon.0) 2542 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-09-17T09:00:32.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:32 smithi078 bash[22670]: cluster 2024-09-17T09:00:30.925733+0000 mgr.y (mgr.14532) 355 : cluster [DBG] pgmap v520: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T09:00:32.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:32 smithi078 bash[22670]: cluster 2024-09-17T09:00:31.067597+0000 mon.a (mon.0) 2543 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-09-17T09:00:32.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:32 smithi078 bash[22670]: cluster 2024-09-17T09:00:31.523961+0000 mon.a (mon.0) 2544 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:32.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:32 smithi078 bash[32124]: cluster 2024-09-17T09:00:30.925733+0000 mgr.y (mgr.14532) 355 : cluster [DBG] pgmap v520: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T09:00:32.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:32 smithi078 bash[32124]: cluster 2024-09-17T09:00:31.067597+0000 mon.a (mon.0) 2543 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-09-17T09:00:32.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:32 smithi078 bash[32124]: cluster 2024-09-17T09:00:31.523961+0000 mon.a (mon.0) 2544 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:32.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:32 smithi136 bash[24812]: cluster 2024-09-17T09:00:30.925733+0000 mgr.y (mgr.14532) 355 : cluster [DBG] pgmap v520: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T09:00:32.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:32 smithi136 bash[24812]: cluster 2024-09-17T09:00:31.067597+0000 mon.a (mon.0) 2543 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-09-17T09:00:32.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:32 smithi136 bash[24812]: cluster 2024-09-17T09:00:31.523961+0000 mon.a (mon.0) 2544 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:33.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:33 smithi078 bash[32124]: cluster 2024-09-17T09:00:32.077136+0000 mon.a (mon.0) 2545 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-09-17T09:00:33.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:33 smithi078 bash[32124]: audit 2024-09-17T09:00:32.078970+0000 mon.a (mon.0) 2546 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:33.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:33 smithi078 bash[22670]: cluster 2024-09-17T09:00:32.077136+0000 mon.a (mon.0) 2545 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-09-17T09:00:33.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:33 smithi078 bash[22670]: audit 2024-09-17T09:00:32.078970+0000 mon.a (mon.0) 2546 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:33.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:33 smithi136 bash[24812]: cluster 2024-09-17T09:00:32.077136+0000 mon.a (mon.0) 2545 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-09-17T09:00:33.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:33 smithi136 bash[24812]: audit 2024-09-17T09:00:32.078970+0000 mon.a (mon.0) 2546 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:34.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[22670]: cluster 2024-09-17T09:00:32.927814+0000 mgr.y (mgr.14532) 356 : cluster [DBG] pgmap v523: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[22670]: audit 2024-09-17T09:00:33.087974+0000 mon.a (mon.0) 2547 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[22670]: cluster 2024-09-17T09:00:33.088132+0000 mon.a (mon.0) 2548 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-09-17T09:00:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[22670]: audit 2024-09-17T09:00:33.089386+0000 mon.a (mon.0) 2549 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:34.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[32124]: cluster 2024-09-17T09:00:32.927814+0000 mgr.y (mgr.14532) 356 : cluster [DBG] pgmap v523: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:34.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[32124]: audit 2024-09-17T09:00:33.087974+0000 mon.a (mon.0) 2547 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:34.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[32124]: cluster 2024-09-17T09:00:33.088132+0000 mon.a (mon.0) 2548 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-09-17T09:00:34.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:34 smithi078 bash[32124]: audit 2024-09-17T09:00:33.089386+0000 mon.a (mon.0) 2549 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:34.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:34 smithi136 bash[24812]: cluster 2024-09-17T09:00:32.927814+0000 mgr.y (mgr.14532) 356 : cluster [DBG] pgmap v523: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:34.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:34 smithi136 bash[24812]: audit 2024-09-17T09:00:33.087974+0000 mon.a (mon.0) 2547 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:34.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:34 smithi136 bash[24812]: cluster 2024-09-17T09:00:33.088132+0000 mon.a (mon.0) 2548 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-09-17T09:00:34.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:34 smithi136 bash[24812]: audit 2024-09-17T09:00:33.089386+0000 mon.a (mon.0) 2549 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]: dispatch 2024-09-17T09:00:35.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.098148+0000 mon.a (mon.0) 2550 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: cluster 2024-09-17T09:00:34.098830+0000 mon.a (mon.0) 2551 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.146218+0000 mon.c (mon.2) 283 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.146578+0000 mon.a (mon.0) 2552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.147541+0000 mon.c (mon.2) 284 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.147887+0000 mon.a (mon.0) 2553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.148416+0000 mon.c (mon.2) 285 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.148708+0000 mon.a (mon.0) 2554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:35.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[32124]: audit 2024-09-17T09:00:34.605522+0000 mon.a (mon.0) 2555 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.098148+0000 mon.a (mon.0) 2550 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: cluster 2024-09-17T09:00:34.098830+0000 mon.a (mon.0) 2551 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.146218+0000 mon.c (mon.2) 283 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.146578+0000 mon.a (mon.0) 2552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.147541+0000 mon.c (mon.2) 284 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.147887+0000 mon.a (mon.0) 2553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.148416+0000 mon.c (mon.2) 285 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.148708+0000 mon.a (mon.0) 2554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:35 smithi078 bash[22670]: audit 2024-09-17T09:00:34.605522+0000 mon.a (mon.0) 2555 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:35.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.098148+0000 mon.a (mon.0) 2550 : audit [INF] from='client.? 172.21.15.78:0/2633328945' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi078-64688-65"}]': finished 2024-09-17T09:00:35.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: cluster 2024-09-17T09:00:34.098830+0000 mon.a (mon.0) 2551 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-09-17T09:00:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.146218+0000 mon.c (mon.2) 283 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.146578+0000 mon.a (mon.0) 2552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.147541+0000 mon.c (mon.2) 284 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.147887+0000 mon.a (mon.0) 2553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.148416+0000 mon.c (mon.2) 285 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.148708+0000 mon.a (mon.0) 2554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:00:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:35 smithi136 bash[24812]: audit 2024-09-17T09:00:34.605522+0000 mon.a (mon.0) 2555 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[22670]: cluster 2024-09-17T09:00:34.928580+0000 mgr.y (mgr.14532) 357 : cluster [DBG] pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[22670]: audit 2024-09-17T09:00:35.107898+0000 mon.a (mon.0) 2556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[22670]: audit 2024-09-17T09:00:35.108124+0000 mon.a (mon.0) 2557 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[22670]: cluster 2024-09-17T09:00:35.108249+0000 mon.a (mon.0) 2558 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-09-17T09:00:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[22670]: audit 2024-09-17T09:00:35.111098+0000 mon.c (mon.2) 286 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[22670]: audit 2024-09-17T09:00:35.111251+0000 mon.a (mon.0) 2559 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:36.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[22670]: audit 2024-09-17T09:00:35.111713+0000 mon.a (mon.0) 2560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[32124]: cluster 2024-09-17T09:00:34.928580+0000 mgr.y (mgr.14532) 357 : cluster [DBG] pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[32124]: audit 2024-09-17T09:00:35.107898+0000 mon.a (mon.0) 2556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[32124]: audit 2024-09-17T09:00:35.108124+0000 mon.a (mon.0) 2557 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[32124]: cluster 2024-09-17T09:00:35.108249+0000 mon.a (mon.0) 2558 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-09-17T09:00:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[32124]: audit 2024-09-17T09:00:35.111098+0000 mon.c (mon.2) 286 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[32124]: audit 2024-09-17T09:00:35.111251+0000 mon.a (mon.0) 2559 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:36 smithi078 bash[32124]: audit 2024-09-17T09:00:35.111713+0000 mon.a (mon.0) 2560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:37.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:36 smithi136 bash[24812]: cluster 2024-09-17T09:00:34.928580+0000 mgr.y (mgr.14532) 357 : cluster [DBG] pgmap v526: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:37.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:36 smithi136 bash[24812]: audit 2024-09-17T09:00:35.107898+0000 mon.a (mon.0) 2556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi078-64688-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:00:37.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:36 smithi136 bash[24812]: audit 2024-09-17T09:00:35.108124+0000 mon.a (mon.0) 2557 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:37.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:36 smithi136 bash[24812]: cluster 2024-09-17T09:00:35.108249+0000 mon.a (mon.0) 2558 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-09-17T09:00:37.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:36 smithi136 bash[24812]: audit 2024-09-17T09:00:35.111098+0000 mon.c (mon.2) 286 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:37.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:36 smithi136 bash[24812]: audit 2024-09-17T09:00:35.111251+0000 mon.a (mon.0) 2559 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:37.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:36 smithi136 bash[24812]: audit 2024-09-17T09:00:35.111713+0000 mon.a (mon.0) 2560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:37.114 INFO:tasks.workunit.client.0.smithi078.stdout::163:head 2024-09-17T09:00:37.115 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:5d165639:::164:head 2024-09-17T09:00:37.115 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f43765fc:::165:head 2024-09-17T09:00:37.115 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b4c720e9:::166:head 2024-09-17T09:00:37.115 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:e694b040:::167:head 2024-09-17T09:00:37.115 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:afa38db2:::168:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:77ba9f53:::169:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:87495034:::170:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:7c96bf0e:::171:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:dbe346cc:::172:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:e943ec24:::173:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f97a9c0c:::174:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:6f26e74d:::175:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:4f95e106:::176:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:0e6f2f8f:::177:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:05db05f1:::178:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:38a78d66:::179:head 2024-09-17T09:00:37.116 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:d095610b:::180:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:a1a9d709:::181:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:1e5d39db:::182:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:f7df4fb9:::183:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:03a7f161:::184:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:ba70721e:::185:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:28e5662d:::186:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:973d52de:::187:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:4303eb1c:::188:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:b990b48e:::189:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:29b8165b:::190:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:3547f197:::191:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:7e260936:::192:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:1abec7b1:::193:head 2024-09-17T09:00:37.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:10fdda93:::194:head 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:15817eea:::195:head 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:770bab57:::196:head 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:ed9e13e7:::197:head 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:71471a8f:::198:head 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: checking for 196:10fb1d02:::199:head 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8080 ms) 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,0 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: first is 1726563590 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,0 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,0 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,0 2024-09-17T09:00:37.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,1726563595,1726563596,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,1726563595,1726563596,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,1726563595,1726563596,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,1726563595,1726563596,1726563598,1726563599,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,1726563595,1726563596,1726563598,1726563599,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563590,1726563592,1726563593,1726563595,1726563596,1726563598,1726563599,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726563593,1726563595,1726563596,1726563598,1726563599,1726563601,1726563602,0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: first now 1726563593, trimmed 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21149 ms) 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: foo0 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-17T09:00:37.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (15080 ms) 2024-09-17T09:00:37.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-17T09:00:37.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: cluster 2024-09-17T09:00:36.100752+0000 mon.a (mon.0) 2561 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: audit 2024-09-17T09:00:36.110277+0000 mon.a (mon.0) 2562 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]': finished 2024-09-17T09:00:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: cluster 2024-09-17T09:00:36.552767+0000 mon.a (mon.0) 2563 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-09-17T09:00:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: audit 2024-09-17T09:00:36.577448+0000 mon.a (mon.0) 2564 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: audit 2024-09-17T09:00:36.578198+0000 mon.a (mon.0) 2565 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: cluster 2024-09-17T09:00:36.929354+0000 mgr.y (mgr.14532) 358 : cluster [DBG] pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: audit 2024-09-17T09:00:37.115317+0000 mon.a (mon.0) 2566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22670]: cluster 2024-09-17T09:00:37.115633+0000 mon.a (mon.0) 2567 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: cluster 2024-09-17T09:00:36.100752+0000 mon.a (mon.0) 2561 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: audit 2024-09-17T09:00:36.110277+0000 mon.a (mon.0) 2562 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]': finished 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: cluster 2024-09-17T09:00:36.552767+0000 mon.a (mon.0) 2563 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: audit 2024-09-17T09:00:36.577448+0000 mon.a (mon.0) 2564 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: audit 2024-09-17T09:00:36.578198+0000 mon.a (mon.0) 2565 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: cluster 2024-09-17T09:00:36.929354+0000 mgr.y (mgr.14532) 358 : cluster [DBG] pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: audit 2024-09-17T09:00:37.115317+0000 mon.a (mon.0) 2566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[32124]: cluster 2024-09-17T09:00:37.115633+0000 mon.a (mon.0) 2567 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-09-17T09:00:38.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: cluster 2024-09-17T09:00:36.100752+0000 mon.a (mon.0) 2561 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:38.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: audit 2024-09-17T09:00:36.110277+0000 mon.a (mon.0) 2562 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]': finished 2024-09-17T09:00:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: cluster 2024-09-17T09:00:36.552767+0000 mon.a (mon.0) 2563 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-09-17T09:00:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: audit 2024-09-17T09:00:36.577448+0000 mon.a (mon.0) 2564 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: audit 2024-09-17T09:00:36.578198+0000 mon.a (mon.0) 2565 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-49"}]: dispatch 2024-09-17T09:00:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: cluster 2024-09-17T09:00:36.929354+0000 mgr.y (mgr.14532) 358 : cluster [DBG] pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: audit 2024-09-17T09:00:37.115317+0000 mon.a (mon.0) 2566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi078-64688-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:38.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:37 smithi136 bash[24812]: cluster 2024-09-17T09:00:37.115633+0000 mon.a (mon.0) 2567 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-09-17T09:00:38.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:00:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:00:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:00:38.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:38 smithi078 bash[32124]: cluster 2024-09-17T09:00:37.595128+0000 mon.a (mon.0) 2568 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:38.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:38 smithi078 bash[32124]: cluster 2024-09-17T09:00:38.125021+0000 mon.a (mon.0) 2569 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-09-17T09:00:38.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:38 smithi078 bash[32124]: audit 2024-09-17T09:00:38.145641+0000 mon.a (mon.0) 2570 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:38 smithi078 bash[22670]: cluster 2024-09-17T09:00:37.595128+0000 mon.a (mon.0) 2568 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:38 smithi078 bash[22670]: cluster 2024-09-17T09:00:38.125021+0000 mon.a (mon.0) 2569 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-09-17T09:00:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:38 smithi078 bash[22670]: audit 2024-09-17T09:00:38.145641+0000 mon.a (mon.0) 2570 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:39.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:38 smithi136 bash[24812]: cluster 2024-09-17T09:00:37.595128+0000 mon.a (mon.0) 2568 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:00:39.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:38 smithi136 bash[24812]: cluster 2024-09-17T09:00:38.125021+0000 mon.a (mon.0) 2569 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-09-17T09:00:39.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:38 smithi136 bash[24812]: audit 2024-09-17T09:00:38.145641+0000 mon.a (mon.0) 2570 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:00:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[22670]: cluster 2024-09-17T09:00:38.930164+0000 mgr.y (mgr.14532) 359 : cluster [DBG] pgmap v532: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[22670]: audit 2024-09-17T09:00:39.120431+0000 mon.a (mon.0) 2571 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[22670]: cluster 2024-09-17T09:00:39.120796+0000 mon.a (mon.0) 2572 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-09-17T09:00:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[22670]: audit 2024-09-17T09:00:39.127733+0000 mon.c (mon.2) 287 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[22670]: audit 2024-09-17T09:00:39.130207+0000 mon.a (mon.0) 2573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[22670]: audit 2024-09-17T09:00:39.175342+0000 mon.a (mon.0) 2574 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:39.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[32124]: cluster 2024-09-17T09:00:38.930164+0000 mgr.y (mgr.14532) 359 : cluster [DBG] pgmap v532: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:39.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[32124]: audit 2024-09-17T09:00:39.120431+0000 mon.a (mon.0) 2571 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:39.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[32124]: cluster 2024-09-17T09:00:39.120796+0000 mon.a (mon.0) 2572 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-09-17T09:00:39.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[32124]: audit 2024-09-17T09:00:39.127733+0000 mon.c (mon.2) 287 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:39.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[32124]: audit 2024-09-17T09:00:39.130207+0000 mon.a (mon.0) 2573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:39.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:39 smithi078 bash[32124]: audit 2024-09-17T09:00:39.175342+0000 mon.a (mon.0) 2574 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:40.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:00:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:00:40.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:39 smithi136 bash[24812]: cluster 2024-09-17T09:00:38.930164+0000 mgr.y (mgr.14532) 359 : cluster [DBG] pgmap v532: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:40.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:39 smithi136 bash[24812]: audit 2024-09-17T09:00:39.120431+0000 mon.a (mon.0) 2571 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:00:40.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:39 smithi136 bash[24812]: cluster 2024-09-17T09:00:39.120796+0000 mon.a (mon.0) 2572 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-09-17T09:00:40.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:39 smithi136 bash[24812]: audit 2024-09-17T09:00:39.127733+0000 mon.c (mon.2) 287 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:40.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:39 smithi136 bash[24812]: audit 2024-09-17T09:00:39.130207+0000 mon.a (mon.0) 2573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:40.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:39 smithi136 bash[24812]: audit 2024-09-17T09:00:39.175342+0000 mon.a (mon.0) 2574 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:39.569896+0000 mgr.y (mgr.14532) 360 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:40.123232+0000 mon.a (mon.0) 2575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:40.123478+0000 mon.a (mon.0) 2576 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: cluster 2024-09-17T09:00:40.123653+0000 mon.a (mon.0) 2577 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:40.127634+0000 mon.c (mon.2) 288 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:40.129983+0000 mon.a (mon.0) 2578 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:40.130380+0000 mon.a (mon.0) 2579 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:40.451295+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:40.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[32124]: audit 2024-09-17T09:00:40.453379+0000 mon.a (mon.0) 2581 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:39.569896+0000 mgr.y (mgr.14532) 360 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:40.123232+0000 mon.a (mon.0) 2575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:40.123478+0000 mon.a (mon.0) 2576 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: cluster 2024-09-17T09:00:40.123653+0000 mon.a (mon.0) 2577 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:40.127634+0000 mon.c (mon.2) 288 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:40.129983+0000 mon.a (mon.0) 2578 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:40.130380+0000 mon.a (mon.0) 2579 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:40.451295+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:40 smithi078 bash[22670]: audit 2024-09-17T09:00:40.453379+0000 mon.a (mon.0) 2581 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:41.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:39.569896+0000 mgr.y (mgr.14532) 360 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:41.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:40.123232+0000 mon.a (mon.0) 2575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:40.123478+0000 mon.a (mon.0) 2576 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:00:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: cluster 2024-09-17T09:00:40.123653+0000 mon.a (mon.0) 2577 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-09-17T09:00:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:40.127634+0000 mon.c (mon.2) 288 : audit [INF] from='client.? 172.21.15.78:0/3925777940' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:40.129983+0000 mon.a (mon.0) 2578 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:00:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:40.130380+0000 mon.a (mon.0) 2579 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]: dispatch 2024-09-17T09:00:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:40.451295+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:41.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:40 smithi136 bash[24812]: audit 2024-09-17T09:00:40.453379+0000 mon.a (mon.0) 2581 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:41.137 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3053 ms) 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7066 ms) 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7023 ms) 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7024 ms) 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7023 ms) 2024-09-17T09:00:41.138 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7067 ms) 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7030 ms) 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139496 ms total) 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (301478 ms total) 2024-09-17T09:00:41.139 INFO:tasks.workunit.client.0.smithi078.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-09-17T09:00:41.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[22670]: cluster 2024-09-17T09:00:40.930950+0000 mgr.y (mgr.14532) 361 : cluster [DBG] pgmap v535: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[22670]: audit 2024-09-17T09:00:41.126456+0000 mon.a (mon.0) 2582 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-51"}]': finished 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[22670]: audit 2024-09-17T09:00:41.126658+0000 mon.a (mon.0) 2583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[22670]: cluster 2024-09-17T09:00:41.126801+0000 mon.a (mon.0) 2584 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[22670]: audit 2024-09-17T09:00:41.131060+0000 mon.a (mon.0) 2585 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-51", "mode": "writeback"}]: dispatch 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[32124]: cluster 2024-09-17T09:00:40.930950+0000 mgr.y (mgr.14532) 361 : cluster [DBG] pgmap v535: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[32124]: audit 2024-09-17T09:00:41.126456+0000 mon.a (mon.0) 2582 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-51"}]': finished 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[32124]: audit 2024-09-17T09:00:41.126658+0000 mon.a (mon.0) 2583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[32124]: cluster 2024-09-17T09:00:41.126801+0000 mon.a (mon.0) 2584 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-09-17T09:00:41.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:41 smithi078 bash[32124]: audit 2024-09-17T09:00:41.131060+0000 mon.a (mon.0) 2585 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-51", "mode": "writeback"}]: dispatch 2024-09-17T09:00:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:41 smithi136 bash[24812]: cluster 2024-09-17T09:00:40.930950+0000 mgr.y (mgr.14532) 361 : cluster [DBG] pgmap v535: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:00:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:41 smithi136 bash[24812]: audit 2024-09-17T09:00:41.126456+0000 mon.a (mon.0) 2582 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-51"}]': finished 2024-09-17T09:00:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:41 smithi136 bash[24812]: audit 2024-09-17T09:00:41.126658+0000 mon.a (mon.0) 2583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi078-64688-66"}]': finished 2024-09-17T09:00:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:41 smithi136 bash[24812]: cluster 2024-09-17T09:00:41.126801+0000 mon.a (mon.0) 2584 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-09-17T09:00:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:41 smithi136 bash[24812]: audit 2024-09-17T09:00:41.131060+0000 mon.a (mon.0) 2585 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-51", "mode": "writeback"}]: dispatch 2024-09-17T09:00:42.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[22670]: cluster 2024-09-17T09:00:42.119937+0000 mon.a (mon.0) 2586 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[22670]: audit 2024-09-17T09:00:42.129772+0000 mon.a (mon.0) 2587 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-51", "mode": "writeback"}]': finished 2024-09-17T09:00:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[22670]: cluster 2024-09-17T09:00:42.129955+0000 mon.a (mon.0) 2588 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-09-17T09:00:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[22670]: audit 2024-09-17T09:00:42.212527+0000 mon.a (mon.0) 2589 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:00:42.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[32124]: cluster 2024-09-17T09:00:42.119937+0000 mon.a (mon.0) 2586 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:42.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[32124]: audit 2024-09-17T09:00:42.129772+0000 mon.a (mon.0) 2587 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-51", "mode": "writeback"}]': finished 2024-09-17T09:00:42.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[32124]: cluster 2024-09-17T09:00:42.129955+0000 mon.a (mon.0) 2588 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-09-17T09:00:42.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:42 smithi078 bash[32124]: audit 2024-09-17T09:00:42.212527+0000 mon.a (mon.0) 2589 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:00:43.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:42 smithi136 bash[24812]: cluster 2024-09-17T09:00:42.119937+0000 mon.a (mon.0) 2586 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:00:43.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:42 smithi136 bash[24812]: audit 2024-09-17T09:00:42.129772+0000 mon.a (mon.0) 2587 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-51", "mode": "writeback"}]': finished 2024-09-17T09:00:43.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:42 smithi136 bash[24812]: cluster 2024-09-17T09:00:42.129955+0000 mon.a (mon.0) 2588 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-09-17T09:00:43.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:42 smithi136 bash[24812]: audit 2024-09-17T09:00:42.212527+0000 mon.a (mon.0) 2589 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:00:43.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[22670]: cluster 2024-09-17T09:00:42.933042+0000 mgr.y (mgr.14532) 362 : cluster [DBG] pgmap v538: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:00:43.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[22670]: audit 2024-09-17T09:00:43.131824+0000 mon.a (mon.0) 2590 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:00:43.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[22670]: cluster 2024-09-17T09:00:43.131935+0000 mon.a (mon.0) 2591 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-09-17T09:00:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[22670]: audit 2024-09-17T09:00:43.134300+0000 mon.a (mon.0) 2592 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:00:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[32124]: cluster 2024-09-17T09:00:42.933042+0000 mgr.y (mgr.14532) 362 : cluster [DBG] pgmap v538: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:00:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[32124]: audit 2024-09-17T09:00:43.131824+0000 mon.a (mon.0) 2590 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:00:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[32124]: cluster 2024-09-17T09:00:43.131935+0000 mon.a (mon.0) 2591 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-09-17T09:00:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:43 smithi078 bash[32124]: audit 2024-09-17T09:00:43.134300+0000 mon.a (mon.0) 2592 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:00:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:43 smithi136 bash[24812]: cluster 2024-09-17T09:00:42.933042+0000 mgr.y (mgr.14532) 362 : cluster [DBG] pgmap v538: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:00:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:43 smithi136 bash[24812]: audit 2024-09-17T09:00:43.131824+0000 mon.a (mon.0) 2590 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:00:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:43 smithi136 bash[24812]: cluster 2024-09-17T09:00:43.131935+0000 mon.a (mon.0) 2591 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-09-17T09:00:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:43 smithi136 bash[24812]: audit 2024-09-17T09:00:43.134300+0000 mon.a (mon.0) 2592 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:00:45.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:45 smithi136 bash[24812]: audit 2024-09-17T09:00:44.138322+0000 mon.a (mon.0) 2593 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:00:45.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:45 smithi136 bash[24812]: cluster 2024-09-17T09:00:44.138513+0000 mon.a (mon.0) 2594 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-09-17T09:00:45.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:45 smithi136 bash[24812]: audit 2024-09-17T09:00:44.140111+0000 mon.a (mon.0) 2595 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:00:45.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:45 smithi136 bash[24812]: cluster 2024-09-17T09:00:44.933949+0000 mgr.y (mgr.14532) 363 : cluster [DBG] pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:00:45.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[22670]: audit 2024-09-17T09:00:44.138322+0000 mon.a (mon.0) 2593 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:00:45.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[22670]: cluster 2024-09-17T09:00:44.138513+0000 mon.a (mon.0) 2594 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-09-17T09:00:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[22670]: audit 2024-09-17T09:00:44.140111+0000 mon.a (mon.0) 2595 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:00:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[22670]: cluster 2024-09-17T09:00:44.933949+0000 mgr.y (mgr.14532) 363 : cluster [DBG] pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:00:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[32124]: audit 2024-09-17T09:00:44.138322+0000 mon.a (mon.0) 2593 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:00:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[32124]: cluster 2024-09-17T09:00:44.138513+0000 mon.a (mon.0) 2594 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-09-17T09:00:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[32124]: audit 2024-09-17T09:00:44.140111+0000 mon.a (mon.0) 2595 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:00:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:45 smithi078 bash[32124]: cluster 2024-09-17T09:00:44.933949+0000 mgr.y (mgr.14532) 363 : cluster [DBG] pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:00:46.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:46 smithi136 bash[24812]: cluster 2024-09-17T09:00:45.130481+0000 mon.a (mon.0) 2596 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:46.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:46 smithi136 bash[24812]: audit 2024-09-17T09:00:45.149442+0000 mon.a (mon.0) 2597 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:00:46.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:46 smithi136 bash[24812]: cluster 2024-09-17T09:00:45.149643+0000 mon.a (mon.0) 2598 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-09-17T09:00:46.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:46 smithi136 bash[24812]: audit 2024-09-17T09:00:45.150847+0000 mon.a (mon.0) 2599 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:00:46.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[22670]: cluster 2024-09-17T09:00:45.130481+0000 mon.a (mon.0) 2596 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:46.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[22670]: audit 2024-09-17T09:00:45.149442+0000 mon.a (mon.0) 2597 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:00:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[22670]: cluster 2024-09-17T09:00:45.149643+0000 mon.a (mon.0) 2598 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-09-17T09:00:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[22670]: audit 2024-09-17T09:00:45.150847+0000 mon.a (mon.0) 2599 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:00:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[32124]: cluster 2024-09-17T09:00:45.130481+0000 mon.a (mon.0) 2596 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:00:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[32124]: audit 2024-09-17T09:00:45.149442+0000 mon.a (mon.0) 2597 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:00:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[32124]: cluster 2024-09-17T09:00:45.149643+0000 mon.a (mon.0) 2598 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-09-17T09:00:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:46 smithi078 bash[32124]: audit 2024-09-17T09:00:45.150847+0000 mon.a (mon.0) 2599 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:00:47.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:47 smithi136 bash[24812]: audit 2024-09-17T09:00:46.149974+0000 mon.a (mon.0) 2600 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:00:47.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:47 smithi136 bash[24812]: cluster 2024-09-17T09:00:46.150126+0000 mon.a (mon.0) 2601 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-09-17T09:00:47.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:47 smithi136 bash[24812]: audit 2024-09-17T09:00:46.151892+0000 mon.a (mon.0) 2602 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-17T09:00:47.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:47 smithi136 bash[24812]: cluster 2024-09-17T09:00:46.934784+0000 mgr.y (mgr.14532) 364 : cluster [DBG] pgmap v544: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:47.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[32124]: audit 2024-09-17T09:00:46.149974+0000 mon.a (mon.0) 2600 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:00:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[32124]: cluster 2024-09-17T09:00:46.150126+0000 mon.a (mon.0) 2601 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-09-17T09:00:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[32124]: audit 2024-09-17T09:00:46.151892+0000 mon.a (mon.0) 2602 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-17T09:00:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[32124]: cluster 2024-09-17T09:00:46.934784+0000 mgr.y (mgr.14532) 364 : cluster [DBG] pgmap v544: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[22670]: audit 2024-09-17T09:00:46.149974+0000 mon.a (mon.0) 2600 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:00:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[22670]: cluster 2024-09-17T09:00:46.150126+0000 mon.a (mon.0) 2601 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-09-17T09:00:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[22670]: audit 2024-09-17T09:00:46.151892+0000 mon.a (mon.0) 2602 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-17T09:00:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[22670]: cluster 2024-09-17T09:00:46.934784+0000 mgr.y (mgr.14532) 364 : cluster [DBG] pgmap v544: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:00:48.169 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:00:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:00:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:00:48.170 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:48 smithi078 bash[22670]: audit 2024-09-17T09:00:47.155061+0000 mon.a (mon.0) 2603 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "target_max_objects","val": "1"}]': finished 2024-09-17T09:00:48.170 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:48 smithi078 bash[22670]: cluster 2024-09-17T09:00:47.155217+0000 mon.a (mon.0) 2604 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-09-17T09:00:48.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:48 smithi136 bash[24812]: audit 2024-09-17T09:00:47.155061+0000 mon.a (mon.0) 2603 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "target_max_objects","val": "1"}]': finished 2024-09-17T09:00:48.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:48 smithi136 bash[24812]: cluster 2024-09-17T09:00:47.155217+0000 mon.a (mon.0) 2604 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-09-17T09:00:48.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:48 smithi078 bash[32124]: audit 2024-09-17T09:00:47.155061+0000 mon.a (mon.0) 2603 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-51","var": "target_max_objects","val": "1"}]': finished 2024-09-17T09:00:48.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:48 smithi078 bash[32124]: cluster 2024-09-17T09:00:47.155217+0000 mon.a (mon.0) 2604 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-09-17T09:00:49.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:49 smithi136 bash[24812]: cluster 2024-09-17T09:00:48.937014+0000 mgr.y (mgr.14532) 365 : cluster [DBG] pgmap v546: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:49.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:49 smithi078 bash[22670]: cluster 2024-09-17T09:00:48.937014+0000 mgr.y (mgr.14532) 365 : cluster [DBG] pgmap v546: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:49.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:49 smithi078 bash[32124]: cluster 2024-09-17T09:00:48.937014+0000 mgr.y (mgr.14532) 365 : cluster [DBG] pgmap v546: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:50.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:00:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:00:50.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:50 smithi136 bash[24812]: cluster 2024-09-17T09:00:49.171204+0000 mon.a (mon.0) 2605 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-17T09:00:50.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:50 smithi136 bash[24812]: audit 2024-09-17T09:00:49.571950+0000 mgr.y (mgr.14532) 366 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:50.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:50 smithi078 bash[22670]: cluster 2024-09-17T09:00:49.171204+0000 mon.a (mon.0) 2605 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-17T09:00:50.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:50 smithi078 bash[22670]: audit 2024-09-17T09:00:49.571950+0000 mgr.y (mgr.14532) 366 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:50 smithi078 bash[32124]: cluster 2024-09-17T09:00:49.171204+0000 mon.a (mon.0) 2605 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-17T09:00:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:50 smithi078 bash[32124]: audit 2024-09-17T09:00:49.571950+0000 mgr.y (mgr.14532) 366 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:00:51.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:51 smithi136 bash[24812]: cluster 2024-09-17T09:00:50.937861+0000 mgr.y (mgr.14532) 367 : cluster [DBG] pgmap v547: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:51.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:51 smithi078 bash[22670]: cluster 2024-09-17T09:00:50.937861+0000 mgr.y (mgr.14532) 367 : cluster [DBG] pgmap v547: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:51 smithi078 bash[32124]: cluster 2024-09-17T09:00:50.937861+0000 mgr.y (mgr.14532) 367 : cluster [DBG] pgmap v547: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:54.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:54 smithi136 bash[24812]: cluster 2024-09-17T09:00:52.940053+0000 mgr.y (mgr.14532) 368 : cluster [DBG] pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:54.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:53 smithi078 bash[22670]: cluster 2024-09-17T09:00:52.940053+0000 mgr.y (mgr.14532) 368 : cluster [DBG] pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:54.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:53 smithi078 bash[32124]: cluster 2024-09-17T09:00:52.940053+0000 mgr.y (mgr.14532) 368 : cluster [DBG] pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:56 smithi136 bash[24812]: cluster 2024-09-17T09:00:54.940996+0000 mgr.y (mgr.14532) 369 : cluster [DBG] pgmap v549: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:56 smithi136 bash[24812]: audit 2024-09-17T09:00:55.488234+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:56 smithi136 bash[24812]: audit 2024-09-17T09:00:55.490347+0000 mon.a (mon.0) 2607 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:56.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:56 smithi078 bash[22670]: cluster 2024-09-17T09:00:54.940996+0000 mgr.y (mgr.14532) 369 : cluster [DBG] pgmap v549: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:56.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:56 smithi078 bash[22670]: audit 2024-09-17T09:00:55.488234+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:56 smithi078 bash[22670]: audit 2024-09-17T09:00:55.490347+0000 mon.a (mon.0) 2607 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:56 smithi078 bash[32124]: cluster 2024-09-17T09:00:54.940996+0000 mgr.y (mgr.14532) 369 : cluster [DBG] pgmap v549: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:56 smithi078 bash[32124]: audit 2024-09-17T09:00:55.488234+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:00:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:56 smithi078 bash[32124]: audit 2024-09-17T09:00:55.490347+0000 mon.a (mon.0) 2607 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:00:58.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:58 smithi136 bash[24812]: cluster 2024-09-17T09:00:56.941867+0000 mgr.y (mgr.14532) 370 : cluster [DBG] pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:58.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:58 smithi136 bash[24812]: audit 2024-09-17T09:00:57.183101+0000 mon.a (mon.0) 2608 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:58.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:00:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:00:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:00:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:58 smithi078 bash[32124]: cluster 2024-09-17T09:00:56.941867+0000 mgr.y (mgr.14532) 370 : cluster [DBG] pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:58 smithi078 bash[32124]: audit 2024-09-17T09:00:57.183101+0000 mon.a (mon.0) 2608 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:58.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:58 smithi078 bash[22670]: cluster 2024-09-17T09:00:56.941867+0000 mgr.y (mgr.14532) 370 : cluster [DBG] pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:00:58.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:58 smithi078 bash[22670]: audit 2024-09-17T09:00:57.183101+0000 mon.a (mon.0) 2608 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:00:59.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:59 smithi136 bash[24812]: audit 2024-09-17T09:00:58.022900+0000 mon.a (mon.0) 2609 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:59.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:59 smithi136 bash[24812]: cluster 2024-09-17T09:00:58.023066+0000 mon.a (mon.0) 2610 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-09-17T09:00:59.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:59 smithi136 bash[24812]: audit 2024-09-17T09:00:58.026464+0000 mon.a (mon.0) 2611 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:00:59.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:59 smithi136 bash[24812]: audit 2024-09-17T09:00:59.026098+0000 mon.a (mon.0) 2612 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]': finished 2024-09-17T09:00:59.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:00:59 smithi136 bash[24812]: cluster 2024-09-17T09:00:59.026330+0000 mon.a (mon.0) 2613 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-09-17T09:00:59.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[22670]: audit 2024-09-17T09:00:58.022900+0000 mon.a (mon.0) 2609 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[22670]: cluster 2024-09-17T09:00:58.023066+0000 mon.a (mon.0) 2610 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[22670]: audit 2024-09-17T09:00:58.026464+0000 mon.a (mon.0) 2611 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[22670]: audit 2024-09-17T09:00:59.026098+0000 mon.a (mon.0) 2612 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]': finished 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[22670]: cluster 2024-09-17T09:00:59.026330+0000 mon.a (mon.0) 2613 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[32124]: audit 2024-09-17T09:00:58.022900+0000 mon.a (mon.0) 2609 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[32124]: cluster 2024-09-17T09:00:58.023066+0000 mon.a (mon.0) 2610 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[32124]: audit 2024-09-17T09:00:58.026464+0000 mon.a (mon.0) 2611 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[32124]: audit 2024-09-17T09:00:59.026098+0000 mon.a (mon.0) 2612 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]': finished 2024-09-17T09:00:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:00:59 smithi078 bash[32124]: cluster 2024-09-17T09:00:59.026330+0000 mon.a (mon.0) 2613 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-09-17T09:01:00.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:00:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:01:00.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:00 smithi078 bash[22670]: cluster 2024-09-17T09:00:58.942715+0000 mgr.y (mgr.14532) 371 : cluster [DBG] pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:01:00.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:00 smithi078 bash[22670]: audit 2024-09-17T09:00:59.103438+0000 mon.a (mon.0) 2614 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:00.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:00 smithi078 bash[22670]: audit 2024-09-17T09:00:59.104309+0000 mon.a (mon.0) 2615 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:01:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:00 smithi078 bash[32124]: cluster 2024-09-17T09:00:58.942715+0000 mgr.y (mgr.14532) 371 : cluster [DBG] pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:01:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:00 smithi078 bash[32124]: audit 2024-09-17T09:00:59.103438+0000 mon.a (mon.0) 2614 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:00.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:00 smithi078 bash[32124]: audit 2024-09-17T09:00:59.104309+0000 mon.a (mon.0) 2615 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:01:00.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:00 smithi136 bash[24812]: cluster 2024-09-17T09:00:58.942715+0000 mgr.y (mgr.14532) 371 : cluster [DBG] pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:01:00.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:00 smithi136 bash[24812]: audit 2024-09-17T09:00:59.103438+0000 mon.a (mon.0) 2614 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:00.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:00 smithi136 bash[24812]: audit 2024-09-17T09:00:59.104309+0000 mon.a (mon.0) 2615 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-51"}]: dispatch 2024-09-17T09:01:01.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:01 smithi078 bash[22670]: audit 2024-09-17T09:00:59.583407+0000 mgr.y (mgr.14532) 372 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:01.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:01 smithi078 bash[22670]: cluster 2024-09-17T09:01:00.060138+0000 mon.a (mon.0) 2616 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-09-17T09:01:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:01 smithi078 bash[32124]: audit 2024-09-17T09:00:59.583407+0000 mgr.y (mgr.14532) 372 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:01 smithi078 bash[32124]: cluster 2024-09-17T09:01:00.060138+0000 mon.a (mon.0) 2616 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-09-17T09:01:01.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:01 smithi136 bash[24812]: audit 2024-09-17T09:00:59.583407+0000 mgr.y (mgr.14532) 372 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:01.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:01 smithi136 bash[24812]: cluster 2024-09-17T09:01:00.060138+0000 mon.a (mon.0) 2616 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-09-17T09:01:02.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[32124]: cluster 2024-09-17T09:01:00.943603+0000 mgr.y (mgr.14532) 373 : cluster [DBG] pgmap v555: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T09:01:02.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[32124]: cluster 2024-09-17T09:01:01.051500+0000 mon.a (mon.0) 2617 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-17T09:01:02.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[32124]: cluster 2024-09-17T09:01:01.074896+0000 mon.a (mon.0) 2618 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-09-17T09:01:02.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[32124]: audit 2024-09-17T09:01:01.079855+0000 mon.a (mon.0) 2619 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[22670]: cluster 2024-09-17T09:01:00.943603+0000 mgr.y (mgr.14532) 373 : cluster [DBG] pgmap v555: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T09:01:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[22670]: cluster 2024-09-17T09:01:01.051500+0000 mon.a (mon.0) 2617 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-17T09:01:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[22670]: cluster 2024-09-17T09:01:01.074896+0000 mon.a (mon.0) 2618 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-09-17T09:01:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:02 smithi078 bash[22670]: audit 2024-09-17T09:01:01.079855+0000 mon.a (mon.0) 2619 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:02.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:02 smithi136 bash[24812]: cluster 2024-09-17T09:01:00.943603+0000 mgr.y (mgr.14532) 373 : cluster [DBG] pgmap v555: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T09:01:02.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:02 smithi136 bash[24812]: cluster 2024-09-17T09:01:01.051500+0000 mon.a (mon.0) 2617 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-17T09:01:02.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:02 smithi136 bash[24812]: cluster 2024-09-17T09:01:01.074896+0000 mon.a (mon.0) 2618 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-09-17T09:01:02.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:02 smithi136 bash[24812]: audit 2024-09-17T09:01:01.079855+0000 mon.a (mon.0) 2619 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:03.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[22670]: audit 2024-09-17T09:01:02.083002+0000 mon.a (mon.0) 2620 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:03.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[22670]: cluster 2024-09-17T09:01:02.083589+0000 mon.a (mon.0) 2621 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-09-17T09:01:03.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[22670]: audit 2024-09-17T09:01:02.152132+0000 mon.a (mon.0) 2622 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:03.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[22670]: audit 2024-09-17T09:01:02.152928+0000 mon.a (mon.0) 2623 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-53"}]: dispatch 2024-09-17T09:01:03.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[32124]: audit 2024-09-17T09:01:02.083002+0000 mon.a (mon.0) 2620 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:03.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[32124]: cluster 2024-09-17T09:01:02.083589+0000 mon.a (mon.0) 2621 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-09-17T09:01:03.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[32124]: audit 2024-09-17T09:01:02.152132+0000 mon.a (mon.0) 2622 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:03.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:03 smithi078 bash[32124]: audit 2024-09-17T09:01:02.152928+0000 mon.a (mon.0) 2623 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-53"}]: dispatch 2024-09-17T09:01:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:03 smithi136 bash[24812]: audit 2024-09-17T09:01:02.083002+0000 mon.a (mon.0) 2620 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:03 smithi136 bash[24812]: cluster 2024-09-17T09:01:02.083589+0000 mon.a (mon.0) 2621 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-09-17T09:01:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:03 smithi136 bash[24812]: audit 2024-09-17T09:01:02.152132+0000 mon.a (mon.0) 2622 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:03 smithi136 bash[24812]: audit 2024-09-17T09:01:02.152928+0000 mon.a (mon.0) 2623 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-53"}]: dispatch 2024-09-17T09:01:04.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:04 smithi136 bash[24812]: cluster 2024-09-17T09:01:02.945626+0000 mgr.y (mgr.14532) 374 : cluster [DBG] pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T09:01:04.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:04 smithi136 bash[24812]: cluster 2024-09-17T09:01:03.097092+0000 mon.a (mon.0) 2624 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-09-17T09:01:04.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:04 smithi078 bash[32124]: cluster 2024-09-17T09:01:02.945626+0000 mgr.y (mgr.14532) 374 : cluster [DBG] pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T09:01:04.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:04 smithi078 bash[32124]: cluster 2024-09-17T09:01:03.097092+0000 mon.a (mon.0) 2624 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-09-17T09:01:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:04 smithi078 bash[22670]: cluster 2024-09-17T09:01:02.945626+0000 mgr.y (mgr.14532) 374 : cluster [DBG] pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T09:01:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:04 smithi078 bash[22670]: cluster 2024-09-17T09:01:03.097092+0000 mon.a (mon.0) 2624 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-09-17T09:01:05.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:05 smithi136 bash[24812]: cluster 2024-09-17T09:01:04.099013+0000 mon.a (mon.0) 2625 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-09-17T09:01:05.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:05 smithi136 bash[24812]: audit 2024-09-17T09:01:04.106335+0000 mon.a (mon.0) 2626 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:05.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:05 smithi136 bash[24812]: audit 2024-09-17T09:01:05.100828+0000 mon.a (mon.0) 2627 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:05.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:05 smithi136 bash[24812]: cluster 2024-09-17T09:01:05.101392+0000 mon.a (mon.0) 2628 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-09-17T09:01:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[22670]: cluster 2024-09-17T09:01:04.099013+0000 mon.a (mon.0) 2625 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-09-17T09:01:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[22670]: audit 2024-09-17T09:01:04.106335+0000 mon.a (mon.0) 2626 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[22670]: audit 2024-09-17T09:01:05.100828+0000 mon.a (mon.0) 2627 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[22670]: cluster 2024-09-17T09:01:05.101392+0000 mon.a (mon.0) 2628 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-09-17T09:01:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[32124]: cluster 2024-09-17T09:01:04.099013+0000 mon.a (mon.0) 2625 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-09-17T09:01:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[32124]: audit 2024-09-17T09:01:04.106335+0000 mon.a (mon.0) 2626 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[32124]: audit 2024-09-17T09:01:05.100828+0000 mon.a (mon.0) 2627 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:05 smithi078 bash[32124]: cluster 2024-09-17T09:01:05.101392+0000 mon.a (mon.0) 2628 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-09-17T09:01:06.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[32124]: cluster 2024-09-17T09:01:04.946389+0000 mgr.y (mgr.14532) 375 : cluster [DBG] pgmap v561: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:06.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[32124]: audit 2024-09-17T09:01:05.105361+0000 mon.a (mon.0) 2629 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:06.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[32124]: cluster 2024-09-17T09:01:05.125961+0000 mon.a (mon.0) 2630 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:06.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[32124]: audit 2024-09-17T09:01:05.188302+0000 mon.a (mon.0) 2631 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:06.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[32124]: audit 2024-09-17T09:01:05.188895+0000 mon.a (mon.0) 2632 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-55"}]: dispatch 2024-09-17T09:01:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[22670]: cluster 2024-09-17T09:01:04.946389+0000 mgr.y (mgr.14532) 375 : cluster [DBG] pgmap v561: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[22670]: audit 2024-09-17T09:01:05.105361+0000 mon.a (mon.0) 2629 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[22670]: cluster 2024-09-17T09:01:05.125961+0000 mon.a (mon.0) 2630 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[22670]: audit 2024-09-17T09:01:05.188302+0000 mon.a (mon.0) 2631 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:06 smithi078 bash[22670]: audit 2024-09-17T09:01:05.188895+0000 mon.a (mon.0) 2632 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-55"}]: dispatch 2024-09-17T09:01:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:06 smithi136 bash[24812]: cluster 2024-09-17T09:01:04.946389+0000 mgr.y (mgr.14532) 375 : cluster [DBG] pgmap v561: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:06 smithi136 bash[24812]: audit 2024-09-17T09:01:05.105361+0000 mon.a (mon.0) 2629 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:06 smithi136 bash[24812]: cluster 2024-09-17T09:01:05.125961+0000 mon.a (mon.0) 2630 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:06 smithi136 bash[24812]: audit 2024-09-17T09:01:05.188302+0000 mon.a (mon.0) 2631 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:06 smithi136 bash[24812]: audit 2024-09-17T09:01:05.188895+0000 mon.a (mon.0) 2632 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-55"}]: dispatch 2024-09-17T09:01:07.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[22670]: cluster 2024-09-17T09:01:06.102458+0000 mon.a (mon.0) 2633 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-09-17T09:01:07.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[22670]: cluster 2024-09-17T09:01:06.947229+0000 mgr.y (mgr.14532) 376 : cluster [DBG] pgmap v564: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:01:07.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[22670]: cluster 2024-09-17T09:01:07.107898+0000 mon.a (mon.0) 2634 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-09-17T09:01:07.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[22670]: audit 2024-09-17T09:01:07.118926+0000 mon.a (mon.0) 2635 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:07.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[32124]: cluster 2024-09-17T09:01:06.102458+0000 mon.a (mon.0) 2633 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-09-17T09:01:07.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[32124]: cluster 2024-09-17T09:01:06.947229+0000 mgr.y (mgr.14532) 376 : cluster [DBG] pgmap v564: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:01:07.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[32124]: cluster 2024-09-17T09:01:07.107898+0000 mon.a (mon.0) 2634 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-09-17T09:01:07.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[32124]: audit 2024-09-17T09:01:07.118926+0000 mon.a (mon.0) 2635 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:08.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:07 smithi136 bash[24812]: cluster 2024-09-17T09:01:06.102458+0000 mon.a (mon.0) 2633 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-09-17T09:01:08.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:07 smithi136 bash[24812]: cluster 2024-09-17T09:01:06.947229+0000 mgr.y (mgr.14532) 376 : cluster [DBG] pgmap v564: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:01:08.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:07 smithi136 bash[24812]: cluster 2024-09-17T09:01:07.107898+0000 mon.a (mon.0) 2634 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-09-17T09:01:08.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:07 smithi136 bash[24812]: audit 2024-09-17T09:01:07.118926+0000 mon.a (mon.0) 2635 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:08.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:01:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:01:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:01:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:09 smithi136 bash[24812]: audit 2024-09-17T09:01:08.109386+0000 mon.a (mon.0) 2636 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:09 smithi136 bash[24812]: cluster 2024-09-17T09:01:08.109718+0000 mon.a (mon.0) 2637 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-09-17T09:01:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:09 smithi136 bash[24812]: audit 2024-09-17T09:01:08.195751+0000 mon.a (mon.0) 2638 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:09 smithi136 bash[24812]: audit 2024-09-17T09:01:08.196329+0000 mon.a (mon.0) 2639 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-57"}]: dispatch 2024-09-17T09:01:09.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[32124]: audit 2024-09-17T09:01:08.109386+0000 mon.a (mon.0) 2636 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[32124]: cluster 2024-09-17T09:01:08.109718+0000 mon.a (mon.0) 2637 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-09-17T09:01:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[32124]: audit 2024-09-17T09:01:08.195751+0000 mon.a (mon.0) 2638 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[32124]: audit 2024-09-17T09:01:08.196329+0000 mon.a (mon.0) 2639 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-57"}]: dispatch 2024-09-17T09:01:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[22670]: audit 2024-09-17T09:01:08.109386+0000 mon.a (mon.0) 2636 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[22670]: cluster 2024-09-17T09:01:08.109718+0000 mon.a (mon.0) 2637 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-09-17T09:01:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[22670]: audit 2024-09-17T09:01:08.195751+0000 mon.a (mon.0) 2638 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:09 smithi078 bash[22670]: audit 2024-09-17T09:01:08.196329+0000 mon.a (mon.0) 2639 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-57"}]: dispatch 2024-09-17T09:01:10.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:01:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:01:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:10 smithi136 bash[24812]: cluster 2024-09-17T09:01:08.947989+0000 mgr.y (mgr.14532) 377 : cluster [DBG] pgmap v567: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:01:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:10 smithi136 bash[24812]: cluster 2024-09-17T09:01:09.122164+0000 mon.a (mon.0) 2640 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-09-17T09:01:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:10 smithi136 bash[24812]: audit 2024-09-17T09:01:09.594847+0000 mgr.y (mgr.14532) 378 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:10.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:10 smithi078 bash[22670]: cluster 2024-09-17T09:01:08.947989+0000 mgr.y (mgr.14532) 377 : cluster [DBG] pgmap v567: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:01:10.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:10 smithi078 bash[22670]: cluster 2024-09-17T09:01:09.122164+0000 mon.a (mon.0) 2640 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-09-17T09:01:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:10 smithi078 bash[22670]: audit 2024-09-17T09:01:09.594847+0000 mgr.y (mgr.14532) 378 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:10 smithi078 bash[32124]: cluster 2024-09-17T09:01:08.947989+0000 mgr.y (mgr.14532) 377 : cluster [DBG] pgmap v567: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:01:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:10 smithi078 bash[32124]: cluster 2024-09-17T09:01:09.122164+0000 mon.a (mon.0) 2640 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-09-17T09:01:10.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:10 smithi078 bash[32124]: audit 2024-09-17T09:01:09.594847+0000 mgr.y (mgr.14532) 378 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:11 smithi136 bash[24812]: cluster 2024-09-17T09:01:10.128231+0000 mon.a (mon.0) 2641 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-09-17T09:01:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:11 smithi136 bash[24812]: audit 2024-09-17T09:01:10.135063+0000 mon.a (mon.0) 2642 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:11 smithi136 bash[24812]: audit 2024-09-17T09:01:10.529098+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:01:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:11 smithi136 bash[24812]: audit 2024-09-17T09:01:10.531460+0000 mon.a (mon.0) 2644 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:11 smithi136 bash[24812]: cluster 2024-09-17T09:01:10.948811+0000 mgr.y (mgr.14532) 379 : cluster [DBG] pgmap v570: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:01:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:11 smithi136 bash[24812]: audit 2024-09-17T09:01:11.128953+0000 mon.a (mon.0) 2645 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:11.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:11 smithi136 bash[24812]: cluster 2024-09-17T09:01:11.129432+0000 mon.a (mon.0) 2646 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-09-17T09:01:11.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[22670]: cluster 2024-09-17T09:01:10.128231+0000 mon.a (mon.0) 2641 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-09-17T09:01:11.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[22670]: audit 2024-09-17T09:01:10.135063+0000 mon.a (mon.0) 2642 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[22670]: audit 2024-09-17T09:01:10.529098+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[22670]: audit 2024-09-17T09:01:10.531460+0000 mon.a (mon.0) 2644 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[22670]: cluster 2024-09-17T09:01:10.948811+0000 mgr.y (mgr.14532) 379 : cluster [DBG] pgmap v570: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[22670]: audit 2024-09-17T09:01:11.128953+0000 mon.a (mon.0) 2645 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[22670]: cluster 2024-09-17T09:01:11.129432+0000 mon.a (mon.0) 2646 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[32124]: cluster 2024-09-17T09:01:10.128231+0000 mon.a (mon.0) 2641 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[32124]: audit 2024-09-17T09:01:10.135063+0000 mon.a (mon.0) 2642 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[32124]: audit 2024-09-17T09:01:10.529098+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[32124]: audit 2024-09-17T09:01:10.531460+0000 mon.a (mon.0) 2644 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[32124]: cluster 2024-09-17T09:01:10.948811+0000 mgr.y (mgr.14532) 379 : cluster [DBG] pgmap v570: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:01:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[32124]: audit 2024-09-17T09:01:11.128953+0000 mon.a (mon.0) 2645 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:11 smithi078 bash[32124]: cluster 2024-09-17T09:01:11.129432+0000 mon.a (mon.0) 2646 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-09-17T09:01:12.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:12 smithi136 bash[24812]: audit 2024-09-17T09:01:11.138188+0000 mon.a (mon.0) 2647 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:12.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:12 smithi136 bash[24812]: audit 2024-09-17T09:01:11.235633+0000 mon.a (mon.0) 2648 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:12.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:12 smithi136 bash[24812]: audit 2024-09-17T09:01:11.236357+0000 mon.a (mon.0) 2649 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-59"}]: dispatch 2024-09-17T09:01:12.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:12 smithi136 bash[24812]: cluster 2024-09-17T09:01:11.522349+0000 mon.a (mon.0) 2650 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:12.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[22670]: audit 2024-09-17T09:01:11.138188+0000 mon.a (mon.0) 2647 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:12.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[22670]: audit 2024-09-17T09:01:11.235633+0000 mon.a (mon.0) 2648 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:12.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[22670]: audit 2024-09-17T09:01:11.236357+0000 mon.a (mon.0) 2649 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-59"}]: dispatch 2024-09-17T09:01:12.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[22670]: cluster 2024-09-17T09:01:11.522349+0000 mon.a (mon.0) 2650 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:12.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[32124]: audit 2024-09-17T09:01:11.138188+0000 mon.a (mon.0) 2647 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:12.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[32124]: audit 2024-09-17T09:01:11.235633+0000 mon.a (mon.0) 2648 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:12.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[32124]: audit 2024-09-17T09:01:11.236357+0000 mon.a (mon.0) 2649 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-59"}]: dispatch 2024-09-17T09:01:12.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:12 smithi078 bash[32124]: cluster 2024-09-17T09:01:11.522349+0000 mon.a (mon.0) 2650 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:13.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:13 smithi136 bash[24812]: cluster 2024-09-17T09:01:12.166195+0000 mon.a (mon.0) 2651 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-09-17T09:01:13.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:13 smithi136 bash[24812]: cluster 2024-09-17T09:01:12.950707+0000 mgr.y (mgr.14532) 380 : cluster [DBG] pgmap v573: 196 pgs: 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:01:13.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:13 smithi078 bash[32124]: cluster 2024-09-17T09:01:12.166195+0000 mon.a (mon.0) 2651 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-09-17T09:01:13.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:13 smithi078 bash[32124]: cluster 2024-09-17T09:01:12.950707+0000 mgr.y (mgr.14532) 380 : cluster [DBG] pgmap v573: 196 pgs: 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:01:13.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:13 smithi078 bash[22670]: cluster 2024-09-17T09:01:12.166195+0000 mon.a (mon.0) 2651 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-09-17T09:01:13.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:13 smithi078 bash[22670]: cluster 2024-09-17T09:01:12.950707+0000 mgr.y (mgr.14532) 380 : cluster [DBG] pgmap v573: 196 pgs: 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:01:14.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:14 smithi136 bash[24812]: cluster 2024-09-17T09:01:13.180655+0000 mon.a (mon.0) 2652 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-09-17T09:01:14.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:14 smithi136 bash[24812]: audit 2024-09-17T09:01:13.191155+0000 mon.a (mon.0) 2653 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:14.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:14 smithi078 bash[32124]: cluster 2024-09-17T09:01:13.180655+0000 mon.a (mon.0) 2652 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-09-17T09:01:14.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:14 smithi078 bash[32124]: audit 2024-09-17T09:01:13.191155+0000 mon.a (mon.0) 2653 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:14.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:14 smithi078 bash[22670]: cluster 2024-09-17T09:01:13.180655+0000 mon.a (mon.0) 2652 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-09-17T09:01:14.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:14 smithi078 bash[22670]: audit 2024-09-17T09:01:13.191155+0000 mon.a (mon.0) 2653 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:15.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:15 smithi136 bash[24812]: audit 2024-09-17T09:01:14.184387+0000 mon.a (mon.0) 2654 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:15.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:15 smithi136 bash[24812]: cluster 2024-09-17T09:01:14.184812+0000 mon.a (mon.0) 2655 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-09-17T09:01:15.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:15 smithi136 bash[24812]: audit 2024-09-17T09:01:14.199998+0000 mon.a (mon.0) 2656 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:15.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:15 smithi136 bash[24812]: audit 2024-09-17T09:01:14.239533+0000 mon.a (mon.0) 2657 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:15.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:15 smithi136 bash[24812]: cluster 2024-09-17T09:01:14.951455+0000 mgr.y (mgr.14532) 381 : cluster [DBG] pgmap v576: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:01:15.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:15 smithi136 bash[24812]: audit 2024-09-17T09:01:15.186081+0000 mon.a (mon.0) 2658 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:01:15.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:15 smithi136 bash[24812]: cluster 2024-09-17T09:01:15.186261+0000 mon.a (mon.0) 2659 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-09-17T09:01:15.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[22670]: audit 2024-09-17T09:01:14.184387+0000 mon.a (mon.0) 2654 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[22670]: cluster 2024-09-17T09:01:14.184812+0000 mon.a (mon.0) 2655 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[22670]: audit 2024-09-17T09:01:14.199998+0000 mon.a (mon.0) 2656 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[22670]: audit 2024-09-17T09:01:14.239533+0000 mon.a (mon.0) 2657 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[22670]: cluster 2024-09-17T09:01:14.951455+0000 mgr.y (mgr.14532) 381 : cluster [DBG] pgmap v576: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[22670]: audit 2024-09-17T09:01:15.186081+0000 mon.a (mon.0) 2658 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[22670]: cluster 2024-09-17T09:01:15.186261+0000 mon.a (mon.0) 2659 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[32124]: audit 2024-09-17T09:01:14.184387+0000 mon.a (mon.0) 2654 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[32124]: cluster 2024-09-17T09:01:14.184812+0000 mon.a (mon.0) 2655 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[32124]: audit 2024-09-17T09:01:14.199998+0000 mon.a (mon.0) 2656 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:15.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[32124]: audit 2024-09-17T09:01:14.239533+0000 mon.a (mon.0) 2657 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[32124]: cluster 2024-09-17T09:01:14.951455+0000 mgr.y (mgr.14532) 381 : cluster [DBG] pgmap v576: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:01:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[32124]: audit 2024-09-17T09:01:15.186081+0000 mon.a (mon.0) 2658 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:01:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:15 smithi078 bash[32124]: cluster 2024-09-17T09:01:15.186261+0000 mon.a (mon.0) 2659 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-09-17T09:01:17.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:16 smithi136 bash[24812]: audit 2024-09-17T09:01:15.262043+0000 mon.a (mon.0) 2660 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:17.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:16 smithi136 bash[24812]: audit 2024-09-17T09:01:15.262922+0000 mon.a (mon.0) 2661 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-61"}]: dispatch 2024-09-17T09:01:17.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:16 smithi078 bash[22670]: audit 2024-09-17T09:01:15.262043+0000 mon.a (mon.0) 2660 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:17.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:16 smithi078 bash[22670]: audit 2024-09-17T09:01:15.262922+0000 mon.a (mon.0) 2661 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-61"}]: dispatch 2024-09-17T09:01:17.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:16 smithi078 bash[32124]: audit 2024-09-17T09:01:15.262043+0000 mon.a (mon.0) 2660 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:17.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:16 smithi078 bash[32124]: audit 2024-09-17T09:01:15.262922+0000 mon.a (mon.0) 2661 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-61"}]: dispatch 2024-09-17T09:01:18.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:17 smithi136 bash[24812]: cluster 2024-09-17T09:01:16.240926+0000 mon.a (mon.0) 2662 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-09-17T09:01:18.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:17 smithi136 bash[24812]: cluster 2024-09-17T09:01:16.952225+0000 mgr.y (mgr.14532) 382 : cluster [DBG] pgmap v579: 196 pgs: 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:01:18.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:17 smithi136 bash[24812]: cluster 2024-09-17T09:01:17.241005+0000 mon.a (mon.0) 2663 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-09-17T09:01:18.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:17 smithi136 bash[24812]: audit 2024-09-17T09:01:17.244276+0000 mon.a (mon.0) 2664 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:18.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:17 smithi136 bash[24812]: cluster 2024-09-17T09:01:17.617708+0000 mon.a (mon.0) 2665 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:18.101 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:01:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:01:18.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[32124]: cluster 2024-09-17T09:01:16.240926+0000 mon.a (mon.0) 2662 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[32124]: cluster 2024-09-17T09:01:16.952225+0000 mgr.y (mgr.14532) 382 : cluster [DBG] pgmap v579: 196 pgs: 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[32124]: cluster 2024-09-17T09:01:17.241005+0000 mon.a (mon.0) 2663 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[32124]: audit 2024-09-17T09:01:17.244276+0000 mon.a (mon.0) 2664 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[32124]: cluster 2024-09-17T09:01:17.617708+0000 mon.a (mon.0) 2665 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[22670]: cluster 2024-09-17T09:01:16.240926+0000 mon.a (mon.0) 2662 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[22670]: cluster 2024-09-17T09:01:16.952225+0000 mgr.y (mgr.14532) 382 : cluster [DBG] pgmap v579: 196 pgs: 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[22670]: cluster 2024-09-17T09:01:17.241005+0000 mon.a (mon.0) 2663 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[22670]: audit 2024-09-17T09:01:17.244276+0000 mon.a (mon.0) 2664 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:18.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:17 smithi078 bash[22670]: cluster 2024-09-17T09:01:17.617708+0000 mon.a (mon.0) 2665 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:19 smithi136 bash[24812]: audit 2024-09-17T09:01:18.243093+0000 mon.a (mon.0) 2666 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:19 smithi136 bash[24812]: cluster 2024-09-17T09:01:18.243753+0000 mon.a (mon.0) 2667 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-09-17T09:01:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:19 smithi136 bash[24812]: audit 2024-09-17T09:01:18.251250+0000 mon.a (mon.0) 2668 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:19 smithi136 bash[24812]: audit 2024-09-17T09:01:18.267036+0000 mon.a (mon.0) 2669 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:19.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:19 smithi136 bash[24812]: cluster 2024-09-17T09:01:18.953028+0000 mgr.y (mgr.14532) 383 : cluster [DBG] pgmap v582: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:19.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[32124]: audit 2024-09-17T09:01:18.243093+0000 mon.a (mon.0) 2666 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:19.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[32124]: cluster 2024-09-17T09:01:18.243753+0000 mon.a (mon.0) 2667 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-09-17T09:01:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[32124]: audit 2024-09-17T09:01:18.251250+0000 mon.a (mon.0) 2668 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[32124]: audit 2024-09-17T09:01:18.267036+0000 mon.a (mon.0) 2669 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[32124]: cluster 2024-09-17T09:01:18.953028+0000 mgr.y (mgr.14532) 383 : cluster [DBG] pgmap v582: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:19.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[22670]: audit 2024-09-17T09:01:18.243093+0000 mon.a (mon.0) 2666 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[22670]: cluster 2024-09-17T09:01:18.243753+0000 mon.a (mon.0) 2667 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-09-17T09:01:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[22670]: audit 2024-09-17T09:01:18.251250+0000 mon.a (mon.0) 2668 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[22670]: audit 2024-09-17T09:01:18.267036+0000 mon.a (mon.0) 2669 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:19 smithi078 bash[22670]: cluster 2024-09-17T09:01:18.953028+0000 mgr.y (mgr.14532) 383 : cluster [DBG] pgmap v582: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:20.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:01:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:01:20.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:20 smithi136 bash[24812]: audit 2024-09-17T09:01:19.254778+0000 mon.a (mon.0) 2670 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:01:20.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:20 smithi136 bash[24812]: cluster 2024-09-17T09:01:19.254972+0000 mon.a (mon.0) 2671 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-09-17T09:01:20.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:20 smithi136 bash[24812]: audit 2024-09-17T09:01:19.606226+0000 mgr.y (mgr.14532) 384 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:20.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:20 smithi078 bash[22670]: audit 2024-09-17T09:01:19.254778+0000 mon.a (mon.0) 2670 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:01:20.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:20 smithi078 bash[22670]: cluster 2024-09-17T09:01:19.254972+0000 mon.a (mon.0) 2671 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-09-17T09:01:20.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:20 smithi078 bash[22670]: audit 2024-09-17T09:01:19.606226+0000 mgr.y (mgr.14532) 384 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:20.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:20 smithi078 bash[32124]: audit 2024-09-17T09:01:19.254778+0000 mon.a (mon.0) 2670 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:01:20.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:20 smithi078 bash[32124]: cluster 2024-09-17T09:01:19.254972+0000 mon.a (mon.0) 2671 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-09-17T09:01:20.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:20 smithi078 bash[32124]: audit 2024-09-17T09:01:19.606226+0000 mgr.y (mgr.14532) 384 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:21.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:21 smithi136 bash[24812]: cluster 2024-09-17T09:01:20.264111+0000 mon.a (mon.0) 2672 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-09-17T09:01:21.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:21 smithi136 bash[24812]: cluster 2024-09-17T09:01:20.953830+0000 mgr.y (mgr.14532) 385 : cluster [DBG] pgmap v585: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:21.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:21 smithi078 bash[22670]: cluster 2024-09-17T09:01:20.264111+0000 mon.a (mon.0) 2672 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-09-17T09:01:21.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:21 smithi078 bash[22670]: cluster 2024-09-17T09:01:20.953830+0000 mgr.y (mgr.14532) 385 : cluster [DBG] pgmap v585: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:21.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:21 smithi078 bash[32124]: cluster 2024-09-17T09:01:20.264111+0000 mon.a (mon.0) 2672 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-09-17T09:01:21.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:21 smithi078 bash[32124]: cluster 2024-09-17T09:01:20.953830+0000 mgr.y (mgr.14532) 385 : cluster [DBG] pgmap v585: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:01:22.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:22 smithi136 bash[24812]: cluster 2024-09-17T09:01:21.274241+0000 mon.a (mon.0) 2673 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-09-17T09:01:22.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:22 smithi078 bash[22670]: cluster 2024-09-17T09:01:21.274241+0000 mon.a (mon.0) 2673 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-09-17T09:01:22.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:22 smithi078 bash[32124]: cluster 2024-09-17T09:01:21.274241+0000 mon.a (mon.0) 2673 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-09-17T09:01:23.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:23 smithi136 bash[24812]: cluster 2024-09-17T09:01:22.280966+0000 mon.a (mon.0) 2674 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-09-17T09:01:23.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:23 smithi136 bash[24812]: cluster 2024-09-17T09:01:22.955894+0000 mgr.y (mgr.14532) 386 : cluster [DBG] pgmap v588: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-17T09:01:23.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:23 smithi136 bash[24812]: audit 2024-09-17T09:01:23.120105+0000 mon.a (mon.0) 2675 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:01:23.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:23 smithi078 bash[22670]: cluster 2024-09-17T09:01:22.280966+0000 mon.a (mon.0) 2674 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-09-17T09:01:23.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:23 smithi078 bash[22670]: cluster 2024-09-17T09:01:22.955894+0000 mgr.y (mgr.14532) 386 : cluster [DBG] pgmap v588: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-17T09:01:23.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:23 smithi078 bash[22670]: audit 2024-09-17T09:01:23.120105+0000 mon.a (mon.0) 2675 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:01:23.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:23 smithi078 bash[32124]: cluster 2024-09-17T09:01:22.280966+0000 mon.a (mon.0) 2674 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-09-17T09:01:23.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:23 smithi078 bash[32124]: cluster 2024-09-17T09:01:22.955894+0000 mgr.y (mgr.14532) 386 : cluster [DBG] pgmap v588: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-17T09:01:23.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:23 smithi078 bash[32124]: audit 2024-09-17T09:01:23.120105+0000 mon.a (mon.0) 2675 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:01:24.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:24 smithi136 bash[24812]: cluster 2024-09-17T09:01:23.301711+0000 mon.a (mon.0) 2676 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-09-17T09:01:24.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:24 smithi136 bash[24812]: audit 2024-09-17T09:01:23.676235+0000 mon.a (mon.0) 2677 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:01:24.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:24 smithi136 bash[24812]: audit 2024-09-17T09:01:23.677946+0000 mon.a (mon.0) 2678 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:01:24.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:24 smithi136 bash[24812]: audit 2024-09-17T09:01:23.687291+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:01:24.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[22670]: cluster 2024-09-17T09:01:23.301711+0000 mon.a (mon.0) 2676 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-09-17T09:01:24.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[22670]: audit 2024-09-17T09:01:23.676235+0000 mon.a (mon.0) 2677 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:01:24.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[22670]: audit 2024-09-17T09:01:23.677946+0000 mon.a (mon.0) 2678 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:01:24.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[22670]: audit 2024-09-17T09:01:23.687291+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:01:24.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[32124]: cluster 2024-09-17T09:01:23.301711+0000 mon.a (mon.0) 2676 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-09-17T09:01:24.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[32124]: audit 2024-09-17T09:01:23.676235+0000 mon.a (mon.0) 2677 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:01:24.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[32124]: audit 2024-09-17T09:01:23.677946+0000 mon.a (mon.0) 2678 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:01:24.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:24 smithi078 bash[32124]: audit 2024-09-17T09:01:23.687291+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:01:25.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:25 smithi078 bash[22670]: cluster 2024-09-17T09:01:24.956718+0000 mgr.y (mgr.14532) 387 : cluster [DBG] pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-09-17T09:01:25.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:25 smithi078 bash[32124]: cluster 2024-09-17T09:01:24.956718+0000 mgr.y (mgr.14532) 387 : cluster [DBG] pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-09-17T09:01:25.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:25 smithi136 bash[24812]: cluster 2024-09-17T09:01:24.956718+0000 mgr.y (mgr.14532) 387 : cluster [DBG] pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-09-17T09:01:26.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:26 smithi078 bash[22670]: audit 2024-09-17T09:01:25.576533+0000 mon.a (mon.0) 2680 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:26.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:26 smithi078 bash[32124]: audit 2024-09-17T09:01:25.576533+0000 mon.a (mon.0) 2680 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:26.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:26 smithi136 bash[24812]: audit 2024-09-17T09:01:25.576533+0000 mon.a (mon.0) 2680 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:27.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:27 smithi078 bash[22670]: cluster 2024-09-17T09:01:26.957512+0000 mgr.y (mgr.14532) 388 : cluster [DBG] pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-09-17T09:01:27.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:27 smithi078 bash[32124]: cluster 2024-09-17T09:01:26.957512+0000 mgr.y (mgr.14532) 388 : cluster [DBG] pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-09-17T09:01:27.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:27 smithi136 bash[24812]: cluster 2024-09-17T09:01:26.957512+0000 mgr.y (mgr.14532) 388 : cluster [DBG] pgmap v591: 228 pgs: 228 active+clean; 8.4 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-09-17T09:01:28.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:01:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:01:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:01:30.017 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:01:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:01:30.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:30 smithi136 bash[24812]: cluster 2024-09-17T09:01:28.959701+0000 mgr.y (mgr.14532) 389 : cluster [DBG] pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-17T09:01:30.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:30 smithi078 bash[22670]: cluster 2024-09-17T09:01:28.959701+0000 mgr.y (mgr.14532) 389 : cluster [DBG] pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-17T09:01:30.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:30 smithi078 bash[32124]: cluster 2024-09-17T09:01:28.959701+0000 mgr.y (mgr.14532) 389 : cluster [DBG] pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-17T09:01:31.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:31 smithi136 bash[24812]: audit 2024-09-17T09:01:29.617547+0000 mgr.y (mgr.14532) 390 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:31.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:31 smithi078 bash[22670]: audit 2024-09-17T09:01:29.617547+0000 mgr.y (mgr.14532) 390 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:31.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:31 smithi078 bash[32124]: audit 2024-09-17T09:01:29.617547+0000 mgr.y (mgr.14532) 390 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:32.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:32 smithi136 bash[24812]: cluster 2024-09-17T09:01:30.960612+0000 mgr.y (mgr.14532) 391 : cluster [DBG] pgmap v593: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-17T09:01:32.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:32 smithi078 bash[22670]: cluster 2024-09-17T09:01:30.960612+0000 mgr.y (mgr.14532) 391 : cluster [DBG] pgmap v593: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-17T09:01:32.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:32 smithi078 bash[32124]: cluster 2024-09-17T09:01:30.960612+0000 mgr.y (mgr.14532) 391 : cluster [DBG] pgmap v593: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-17T09:01:34.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:33 smithi136 bash[24812]: cluster 2024-09-17T09:01:32.635190+0000 mon.a (mon.0) 2681 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-09-17T09:01:34.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:33 smithi136 bash[24812]: cluster 2024-09-17T09:01:32.962941+0000 mgr.y (mgr.14532) 392 : cluster [DBG] pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:34.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:33 smithi078 bash[22670]: cluster 2024-09-17T09:01:32.635190+0000 mon.a (mon.0) 2681 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-09-17T09:01:34.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:33 smithi078 bash[22670]: cluster 2024-09-17T09:01:32.962941+0000 mgr.y (mgr.14532) 392 : cluster [DBG] pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:34.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:33 smithi078 bash[32124]: cluster 2024-09-17T09:01:32.635190+0000 mon.a (mon.0) 2681 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-09-17T09:01:34.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:33 smithi078 bash[32124]: cluster 2024-09-17T09:01:32.962941+0000 mgr.y (mgr.14532) 392 : cluster [DBG] pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:35.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:34 smithi136 bash[24812]: cluster 2024-09-17T09:01:33.663055+0000 mon.a (mon.0) 2682 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-09-17T09:01:35.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:34 smithi078 bash[32124]: cluster 2024-09-17T09:01:33.663055+0000 mon.a (mon.0) 2682 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-09-17T09:01:35.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:34 smithi078 bash[22670]: cluster 2024-09-17T09:01:33.663055+0000 mon.a (mon.0) 2682 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-09-17T09:01:36.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:35 smithi136 bash[24812]: cluster 2024-09-17T09:01:34.963742+0000 mgr.y (mgr.14532) 393 : cluster [DBG] pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:36.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:35 smithi078 bash[32124]: cluster 2024-09-17T09:01:34.963742+0000 mgr.y (mgr.14532) 393 : cluster [DBG] pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:36.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:35 smithi078 bash[22670]: cluster 2024-09-17T09:01:34.963742+0000 mgr.y (mgr.14532) 393 : cluster [DBG] pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:38.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:38 smithi136 bash[24812]: cluster 2024-09-17T09:01:36.964526+0000 mgr.y (mgr.14532) 394 : cluster [DBG] pgmap v598: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:01:38.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:01:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:01:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:01:38.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:38 smithi078 bash[32124]: cluster 2024-09-17T09:01:36.964526+0000 mgr.y (mgr.14532) 394 : cluster [DBG] pgmap v598: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:01:38.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:38 smithi078 bash[22670]: cluster 2024-09-17T09:01:36.964526+0000 mgr.y (mgr.14532) 394 : cluster [DBG] pgmap v598: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:01:40.022 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:01:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:01:40.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:40 smithi136 bash[24812]: cluster 2024-09-17T09:01:38.966737+0000 mgr.y (mgr.14532) 395 : cluster [DBG] pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:40.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:40 smithi078 bash[22670]: cluster 2024-09-17T09:01:38.966737+0000 mgr.y (mgr.14532) 395 : cluster [DBG] pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:40 smithi078 bash[32124]: cluster 2024-09-17T09:01:38.966737+0000 mgr.y (mgr.14532) 395 : cluster [DBG] pgmap v599: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:41.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:41 smithi136 bash[24812]: audit 2024-09-17T09:01:39.628914+0000 mgr.y (mgr.14532) 396 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:41.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:41 smithi136 bash[24812]: audit 2024-09-17T09:01:40.605129+0000 mon.a (mon.0) 2683 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:41.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:41 smithi078 bash[22670]: audit 2024-09-17T09:01:39.628914+0000 mgr.y (mgr.14532) 396 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:41 smithi078 bash[22670]: audit 2024-09-17T09:01:40.605129+0000 mon.a (mon.0) 2683 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:41.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:41 smithi078 bash[32124]: audit 2024-09-17T09:01:39.628914+0000 mgr.y (mgr.14532) 396 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:41.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:41 smithi078 bash[32124]: audit 2024-09-17T09:01:40.605129+0000 mon.a (mon.0) 2683 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:42.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:42 smithi136 bash[24812]: cluster 2024-09-17T09:01:40.967627+0000 mgr.y (mgr.14532) 397 : cluster [DBG] pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:42.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:42 smithi078 bash[22670]: cluster 2024-09-17T09:01:40.967627+0000 mgr.y (mgr.14532) 397 : cluster [DBG] pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:42.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:42 smithi078 bash[32124]: cluster 2024-09-17T09:01:40.967627+0000 mgr.y (mgr.14532) 397 : cluster [DBG] pgmap v600: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:44.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:43 smithi136 bash[24812]: cluster 2024-09-17T09:01:42.635965+0000 mon.a (mon.0) 2684 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-09-17T09:01:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:43 smithi136 bash[24812]: cluster 2024-09-17T09:01:42.969730+0000 mgr.y (mgr.14532) 398 : cluster [DBG] pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:44.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:43 smithi078 bash[22670]: cluster 2024-09-17T09:01:42.635965+0000 mon.a (mon.0) 2684 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-09-17T09:01:44.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:43 smithi078 bash[22670]: cluster 2024-09-17T09:01:42.969730+0000 mgr.y (mgr.14532) 398 : cluster [DBG] pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:44.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:43 smithi078 bash[32124]: cluster 2024-09-17T09:01:42.635965+0000 mon.a (mon.0) 2684 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-09-17T09:01:44.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:43 smithi078 bash[32124]: cluster 2024-09-17T09:01:42.969730+0000 mgr.y (mgr.14532) 398 : cluster [DBG] pgmap v602: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:46.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:45 smithi136 bash[24812]: cluster 2024-09-17T09:01:44.651122+0000 mon.a (mon.0) 2685 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-09-17T09:01:46.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:45 smithi136 bash[24812]: cluster 2024-09-17T09:01:44.970577+0000 mgr.y (mgr.14532) 399 : cluster [DBG] pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:46.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:45 smithi078 bash[22670]: cluster 2024-09-17T09:01:44.651122+0000 mon.a (mon.0) 2685 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-09-17T09:01:46.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:45 smithi078 bash[22670]: cluster 2024-09-17T09:01:44.970577+0000 mgr.y (mgr.14532) 399 : cluster [DBG] pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:46.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:45 smithi078 bash[32124]: cluster 2024-09-17T09:01:44.651122+0000 mon.a (mon.0) 2685 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-09-17T09:01:46.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:45 smithi078 bash[32124]: cluster 2024-09-17T09:01:44.970577+0000 mgr.y (mgr.14532) 399 : cluster [DBG] pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:01:48.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:48 smithi136 bash[24812]: cluster 2024-09-17T09:01:46.971441+0000 mgr.y (mgr.14532) 400 : cluster [DBG] pgmap v605: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:01:48.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:01:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:01:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:01:48.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:48 smithi078 bash[32124]: cluster 2024-09-17T09:01:46.971441+0000 mgr.y (mgr.14532) 400 : cluster [DBG] pgmap v605: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:01:48.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:48 smithi078 bash[22670]: cluster 2024-09-17T09:01:46.971441+0000 mgr.y (mgr.14532) 400 : cluster [DBG] pgmap v605: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:01:50.029 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:01:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:01:50.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:50 smithi136 bash[24812]: cluster 2024-09-17T09:01:48.973699+0000 mgr.y (mgr.14532) 401 : cluster [DBG] pgmap v606: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T09:01:50.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:50 smithi078 bash[32124]: cluster 2024-09-17T09:01:48.973699+0000 mgr.y (mgr.14532) 401 : cluster [DBG] pgmap v606: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T09:01:50.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:50 smithi078 bash[22670]: cluster 2024-09-17T09:01:48.973699+0000 mgr.y (mgr.14532) 401 : cluster [DBG] pgmap v606: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T09:01:51.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:51 smithi078 bash[32124]: audit 2024-09-17T09:01:49.637262+0000 mgr.y (mgr.14532) 402 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:51.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:51 smithi078 bash[22670]: audit 2024-09-17T09:01:49.637262+0000 mgr.y (mgr.14532) 402 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:51.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:51 smithi136 bash[24812]: audit 2024-09-17T09:01:49.637262+0000 mgr.y (mgr.14532) 402 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:01:52.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:52 smithi078 bash[22670]: cluster 2024-09-17T09:01:50.974461+0000 mgr.y (mgr.14532) 403 : cluster [DBG] pgmap v607: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:01:52.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:52 smithi078 bash[32124]: cluster 2024-09-17T09:01:50.974461+0000 mgr.y (mgr.14532) 403 : cluster [DBG] pgmap v607: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:01:52.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:52 smithi136 bash[24812]: cluster 2024-09-17T09:01:50.974461+0000 mgr.y (mgr.14532) 403 : cluster [DBG] pgmap v607: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:01:54.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:53 smithi136 bash[24812]: cluster 2024-09-17T09:01:52.640997+0000 mon.a (mon.0) 2686 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-09-17T09:01:54.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:53 smithi136 bash[24812]: cluster 2024-09-17T09:01:52.976482+0000 mgr.y (mgr.14532) 404 : cluster [DBG] pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 0 B/s wr, 87 op/s 2024-09-17T09:01:54.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:53 smithi078 bash[22670]: cluster 2024-09-17T09:01:52.640997+0000 mon.a (mon.0) 2686 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-09-17T09:01:54.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:53 smithi078 bash[22670]: cluster 2024-09-17T09:01:52.976482+0000 mgr.y (mgr.14532) 404 : cluster [DBG] pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 0 B/s wr, 87 op/s 2024-09-17T09:01:54.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:53 smithi078 bash[32124]: cluster 2024-09-17T09:01:52.640997+0000 mon.a (mon.0) 2686 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-09-17T09:01:54.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:53 smithi078 bash[32124]: cluster 2024-09-17T09:01:52.976482+0000 mgr.y (mgr.14532) 404 : cluster [DBG] pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 0 B/s wr, 87 op/s 2024-09-17T09:01:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:54 smithi136 bash[24812]: audit 2024-09-17T09:01:54.689452+0000 mon.a (mon.0) 2687 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:54 smithi136 bash[24812]: audit 2024-09-17T09:01:54.690311+0000 mon.a (mon.0) 2688 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-63"}]: dispatch 2024-09-17T09:01:55.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:54 smithi078 bash[32124]: audit 2024-09-17T09:01:54.689452+0000 mon.a (mon.0) 2687 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:55.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:54 smithi078 bash[32124]: audit 2024-09-17T09:01:54.690311+0000 mon.a (mon.0) 2688 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-63"}]: dispatch 2024-09-17T09:01:55.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:54 smithi078 bash[22670]: audit 2024-09-17T09:01:54.689452+0000 mon.a (mon.0) 2687 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:01:55.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:54 smithi078 bash[22670]: audit 2024-09-17T09:01:54.690311+0000 mon.a (mon.0) 2688 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-63"}]: dispatch 2024-09-17T09:01:56.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:55 smithi136 bash[24812]: cluster 2024-09-17T09:01:54.977283+0000 mgr.y (mgr.14532) 405 : cluster [DBG] pgmap v610: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-09-17T09:01:56.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:55 smithi136 bash[24812]: audit 2024-09-17T09:01:55.634705+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:56.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:55 smithi078 bash[22670]: cluster 2024-09-17T09:01:54.977283+0000 mgr.y (mgr.14532) 405 : cluster [DBG] pgmap v610: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-09-17T09:01:56.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:55 smithi078 bash[22670]: audit 2024-09-17T09:01:55.634705+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:56.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:55 smithi078 bash[32124]: cluster 2024-09-17T09:01:54.977283+0000 mgr.y (mgr.14532) 405 : cluster [DBG] pgmap v610: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-09-17T09:01:56.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:55 smithi078 bash[32124]: audit 2024-09-17T09:01:55.634705+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:01:57.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:56 smithi136 bash[24812]: cluster 2024-09-17T09:01:55.764569+0000 mon.a (mon.0) 2690 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-09-17T09:01:57.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:56 smithi078 bash[32124]: cluster 2024-09-17T09:01:55.764569+0000 mon.a (mon.0) 2690 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-09-17T09:01:57.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:56 smithi078 bash[22670]: cluster 2024-09-17T09:01:55.764569+0000 mon.a (mon.0) 2690 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-09-17T09:01:58.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:57 smithi136 bash[24812]: cluster 2024-09-17T09:01:56.775598+0000 mon.a (mon.0) 2691 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-09-17T09:01:58.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:57 smithi136 bash[24812]: audit 2024-09-17T09:01:56.780605+0000 mon.a (mon.0) 2692 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:58.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:57 smithi136 bash[24812]: cluster 2024-09-17T09:01:56.978093+0000 mgr.y (mgr.14532) 406 : cluster [DBG] pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-17T09:01:58.101 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:01:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:01:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:01:58.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:57 smithi078 bash[32124]: cluster 2024-09-17T09:01:56.775598+0000 mon.a (mon.0) 2691 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-09-17T09:01:58.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:57 smithi078 bash[32124]: audit 2024-09-17T09:01:56.780605+0000 mon.a (mon.0) 2692 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:58.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:57 smithi078 bash[32124]: cluster 2024-09-17T09:01:56.978093+0000 mgr.y (mgr.14532) 406 : cluster [DBG] pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-17T09:01:58.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:57 smithi078 bash[22670]: cluster 2024-09-17T09:01:56.775598+0000 mon.a (mon.0) 2691 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-09-17T09:01:58.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:57 smithi078 bash[22670]: audit 2024-09-17T09:01:56.780605+0000 mon.a (mon.0) 2692 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:01:58.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:57 smithi078 bash[22670]: cluster 2024-09-17T09:01:56.978093+0000 mgr.y (mgr.14532) 406 : cluster [DBG] pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-17T09:01:59.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:58 smithi136 bash[24812]: cluster 2024-09-17T09:01:57.768151+0000 mon.a (mon.0) 2693 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:59.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:58 smithi136 bash[24812]: audit 2024-09-17T09:01:57.787020+0000 mon.a (mon.0) 2694 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:59.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:58 smithi136 bash[24812]: cluster 2024-09-17T09:01:57.787477+0000 mon.a (mon.0) 2695 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-09-17T09:01:59.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:58 smithi136 bash[24812]: audit 2024-09-17T09:01:57.793115+0000 mon.a (mon.0) 2696 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:59.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:58 smithi136 bash[24812]: audit 2024-09-17T09:01:57.810824+0000 mon.a (mon.0) 2697 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:59.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[32124]: cluster 2024-09-17T09:01:57.768151+0000 mon.a (mon.0) 2693 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:59.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[32124]: audit 2024-09-17T09:01:57.787020+0000 mon.a (mon.0) 2694 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[32124]: cluster 2024-09-17T09:01:57.787477+0000 mon.a (mon.0) 2695 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[32124]: audit 2024-09-17T09:01:57.793115+0000 mon.a (mon.0) 2696 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[32124]: audit 2024-09-17T09:01:57.810824+0000 mon.a (mon.0) 2697 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[22670]: cluster 2024-09-17T09:01:57.768151+0000 mon.a (mon.0) 2693 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[22670]: audit 2024-09-17T09:01:57.787020+0000 mon.a (mon.0) 2694 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[22670]: cluster 2024-09-17T09:01:57.787477+0000 mon.a (mon.0) 2695 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[22670]: audit 2024-09-17T09:01:57.793115+0000 mon.a (mon.0) 2696 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:01:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:58 smithi078 bash[22670]: audit 2024-09-17T09:01:57.810824+0000 mon.a (mon.0) 2697 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:02:00.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:01:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:02:00.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:59 smithi136 bash[24812]: audit 2024-09-17T09:01:58.794800+0000 mon.a (mon.0) 2698 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:02:00.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:59 smithi136 bash[24812]: cluster 2024-09-17T09:01:58.794963+0000 mon.a (mon.0) 2699 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-09-17T09:02:00.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:01:59 smithi136 bash[24812]: cluster 2024-09-17T09:01:58.978908+0000 mgr.y (mgr.14532) 407 : cluster [DBG] pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:00.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:59 smithi078 bash[32124]: audit 2024-09-17T09:01:58.794800+0000 mon.a (mon.0) 2698 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:02:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:59 smithi078 bash[32124]: cluster 2024-09-17T09:01:58.794963+0000 mon.a (mon.0) 2699 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-09-17T09:02:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:01:59 smithi078 bash[32124]: cluster 2024-09-17T09:01:58.978908+0000 mgr.y (mgr.14532) 407 : cluster [DBG] pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:59 smithi078 bash[22670]: audit 2024-09-17T09:01:58.794800+0000 mon.a (mon.0) 2698 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:02:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:59 smithi078 bash[22670]: cluster 2024-09-17T09:01:58.794963+0000 mon.a (mon.0) 2699 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-09-17T09:02:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:01:59 smithi078 bash[22670]: cluster 2024-09-17T09:01:58.978908+0000 mgr.y (mgr.14532) 407 : cluster [DBG] pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:01.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:00 smithi078 bash[32124]: audit 2024-09-17T09:01:59.648560+0000 mgr.y (mgr.14532) 408 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:01.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:00 smithi078 bash[32124]: cluster 2024-09-17T09:01:59.807494+0000 mon.a (mon.0) 2700 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-09-17T09:02:01.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:00 smithi078 bash[22670]: audit 2024-09-17T09:01:59.648560+0000 mgr.y (mgr.14532) 408 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:01.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:00 smithi078 bash[22670]: cluster 2024-09-17T09:01:59.807494+0000 mon.a (mon.0) 2700 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-09-17T09:02:01.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:00 smithi136 bash[24812]: audit 2024-09-17T09:01:59.648560+0000 mgr.y (mgr.14532) 408 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:01.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:00 smithi136 bash[24812]: cluster 2024-09-17T09:01:59.807494+0000 mon.a (mon.0) 2700 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-09-17T09:02:02.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:01 smithi078 bash[22670]: cluster 2024-09-17T09:02:00.808482+0000 mon.a (mon.0) 2701 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-09-17T09:02:02.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:01 smithi078 bash[22670]: cluster 2024-09-17T09:02:00.979708+0000 mgr.y (mgr.14532) 409 : cluster [DBG] pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:02:02.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:01 smithi078 bash[32124]: cluster 2024-09-17T09:02:00.808482+0000 mon.a (mon.0) 2701 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-09-17T09:02:02.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:01 smithi078 bash[32124]: cluster 2024-09-17T09:02:00.979708+0000 mgr.y (mgr.14532) 409 : cluster [DBG] pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:02:02.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:01 smithi136 bash[24812]: cluster 2024-09-17T09:02:00.808482+0000 mon.a (mon.0) 2701 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-09-17T09:02:02.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:01 smithi136 bash[24812]: cluster 2024-09-17T09:02:00.979708+0000 mgr.y (mgr.14532) 409 : cluster [DBG] pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:02:03.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:02 smithi078 bash[22670]: cluster 2024-09-17T09:02:01.828781+0000 mon.a (mon.0) 2702 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-09-17T09:02:03.101 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:02 smithi078 bash[32124]: cluster 2024-09-17T09:02:01.828781+0000 mon.a (mon.0) 2702 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-09-17T09:02:03.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:02 smithi136 bash[24812]: cluster 2024-09-17T09:02:01.828781+0000 mon.a (mon.0) 2702 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-09-17T09:02:04.101 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:03 smithi078 bash[22670]: cluster 2024-09-17T09:02:02.982153+0000 mgr.y (mgr.14532) 410 : cluster [DBG] pgmap v621: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-17T09:02:04.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:03 smithi078 bash[32124]: cluster 2024-09-17T09:02:02.982153+0000 mgr.y (mgr.14532) 410 : cluster [DBG] pgmap v621: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-17T09:02:04.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:03 smithi136 bash[24812]: cluster 2024-09-17T09:02:02.982153+0000 mgr.y (mgr.14532) 410 : cluster [DBG] pgmap v621: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-17T09:02:06.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:06 smithi136 bash[24812]: cluster 2024-09-17T09:02:04.982991+0000 mgr.y (mgr.14532) 411 : cluster [DBG] pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-17T09:02:06.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:06 smithi078 bash[22670]: cluster 2024-09-17T09:02:04.982991+0000 mgr.y (mgr.14532) 411 : cluster [DBG] pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-17T09:02:06.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:06 smithi078 bash[32124]: cluster 2024-09-17T09:02:04.982991+0000 mgr.y (mgr.14532) 411 : cluster [DBG] pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-17T09:02:08.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:02:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:02:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:02:08.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:08 smithi078 bash[22670]: cluster 2024-09-17T09:02:06.983833+0000 mgr.y (mgr.14532) 412 : cluster [DBG] pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T09:02:08.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:08 smithi078 bash[22670]: cluster 2024-09-17T09:02:07.634067+0000 mon.a (mon.0) 2703 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:08.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:08 smithi078 bash[22670]: cluster 2024-09-17T09:02:07.645197+0000 mon.a (mon.0) 2704 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-09-17T09:02:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:08 smithi078 bash[32124]: cluster 2024-09-17T09:02:06.983833+0000 mgr.y (mgr.14532) 412 : cluster [DBG] pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T09:02:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:08 smithi078 bash[32124]: cluster 2024-09-17T09:02:07.634067+0000 mon.a (mon.0) 2703 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:08 smithi078 bash[32124]: cluster 2024-09-17T09:02:07.645197+0000 mon.a (mon.0) 2704 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-09-17T09:02:08.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:08 smithi136 bash[24812]: cluster 2024-09-17T09:02:06.983833+0000 mgr.y (mgr.14532) 412 : cluster [DBG] pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T09:02:08.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:08 smithi136 bash[24812]: cluster 2024-09-17T09:02:07.634067+0000 mon.a (mon.0) 2703 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:08.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:08 smithi136 bash[24812]: cluster 2024-09-17T09:02:07.645197+0000 mon.a (mon.0) 2704 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-09-17T09:02:10.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:02:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:02:10.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:10 smithi078 bash[22670]: cluster 2024-09-17T09:02:08.986073+0000 mgr.y (mgr.14532) 413 : cluster [DBG] pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T09:02:10.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:10 smithi078 bash[32124]: cluster 2024-09-17T09:02:08.986073+0000 mgr.y (mgr.14532) 413 : cluster [DBG] pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T09:02:10.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:10 smithi136 bash[24812]: cluster 2024-09-17T09:02:08.986073+0000 mgr.y (mgr.14532) 413 : cluster [DBG] pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T09:02:11.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:11 smithi078 bash[22670]: audit 2024-09-17T09:02:09.659875+0000 mgr.y (mgr.14532) 414 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:11 smithi078 bash[22670]: audit 2024-09-17T09:02:10.663435+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:11 smithi078 bash[32124]: audit 2024-09-17T09:02:09.659875+0000 mgr.y (mgr.14532) 414 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:11 smithi078 bash[32124]: audit 2024-09-17T09:02:10.663435+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:11.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:11 smithi136 bash[24812]: audit 2024-09-17T09:02:09.659875+0000 mgr.y (mgr.14532) 414 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:11.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:11 smithi136 bash[24812]: audit 2024-09-17T09:02:10.663435+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:12.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:12 smithi136 bash[24812]: cluster 2024-09-17T09:02:10.987238+0000 mgr.y (mgr.14532) 415 : cluster [DBG] pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-17T09:02:12.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:12 smithi136 bash[24812]: audit 2024-09-17T09:02:11.862975+0000 mon.a (mon.0) 2706 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:12.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:12 smithi136 bash[24812]: audit 2024-09-17T09:02:11.863735+0000 mon.a (mon.0) 2707 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-65"}]: dispatch 2024-09-17T09:02:12.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:12 smithi078 bash[22670]: cluster 2024-09-17T09:02:10.987238+0000 mgr.y (mgr.14532) 415 : cluster [DBG] pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-17T09:02:12.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:12 smithi078 bash[22670]: audit 2024-09-17T09:02:11.862975+0000 mon.a (mon.0) 2706 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:12.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:12 smithi078 bash[22670]: audit 2024-09-17T09:02:11.863735+0000 mon.a (mon.0) 2707 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-65"}]: dispatch 2024-09-17T09:02:12.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:12 smithi078 bash[32124]: cluster 2024-09-17T09:02:10.987238+0000 mgr.y (mgr.14532) 415 : cluster [DBG] pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-17T09:02:12.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:12 smithi078 bash[32124]: audit 2024-09-17T09:02:11.862975+0000 mon.a (mon.0) 2706 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:12.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:12 smithi078 bash[32124]: audit 2024-09-17T09:02:11.863735+0000 mon.a (mon.0) 2707 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-65"}]: dispatch 2024-09-17T09:02:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:13 smithi136 bash[24812]: cluster 2024-09-17T09:02:12.066354+0000 mon.a (mon.0) 2708 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-09-17T09:02:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:13 smithi136 bash[24812]: cluster 2024-09-17T09:02:12.989130+0000 mgr.y (mgr.14532) 416 : cluster [DBG] pgmap v628: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:13.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:13 smithi136 bash[24812]: cluster 2024-09-17T09:02:13.075051+0000 mon.a (mon.0) 2709 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-09-17T09:02:13.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:13 smithi136 bash[24812]: audit 2024-09-17T09:02:13.081439+0000 mon.a (mon.0) 2710 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:13.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[22670]: cluster 2024-09-17T09:02:12.066354+0000 mon.a (mon.0) 2708 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-09-17T09:02:13.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[22670]: cluster 2024-09-17T09:02:12.989130+0000 mgr.y (mgr.14532) 416 : cluster [DBG] pgmap v628: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:13.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[22670]: cluster 2024-09-17T09:02:13.075051+0000 mon.a (mon.0) 2709 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-09-17T09:02:13.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[22670]: audit 2024-09-17T09:02:13.081439+0000 mon.a (mon.0) 2710 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[32124]: cluster 2024-09-17T09:02:12.066354+0000 mon.a (mon.0) 2708 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-09-17T09:02:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[32124]: cluster 2024-09-17T09:02:12.989130+0000 mgr.y (mgr.14532) 416 : cluster [DBG] pgmap v628: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[32124]: cluster 2024-09-17T09:02:13.075051+0000 mon.a (mon.0) 2709 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-09-17T09:02:13.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:13 smithi078 bash[32124]: audit 2024-09-17T09:02:13.081439+0000 mon.a (mon.0) 2710 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:15.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:15 smithi078 bash[32124]: audit 2024-09-17T09:02:14.075400+0000 mon.a (mon.0) 2711 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:15.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:15 smithi078 bash[32124]: cluster 2024-09-17T09:02:14.075914+0000 mon.a (mon.0) 2712 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-09-17T09:02:15.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:15 smithi078 bash[32124]: audit 2024-09-17T09:02:14.082460+0000 mon.a (mon.0) 2713 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:15.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:15 smithi078 bash[22670]: audit 2024-09-17T09:02:14.075400+0000 mon.a (mon.0) 2711 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:15.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:15 smithi078 bash[22670]: cluster 2024-09-17T09:02:14.075914+0000 mon.a (mon.0) 2712 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-09-17T09:02:15.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:15 smithi078 bash[22670]: audit 2024-09-17T09:02:14.082460+0000 mon.a (mon.0) 2713 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:15.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:15 smithi136 bash[24812]: audit 2024-09-17T09:02:14.075400+0000 mon.a (mon.0) 2711 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:15.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:15 smithi136 bash[24812]: cluster 2024-09-17T09:02:14.075914+0000 mon.a (mon.0) 2712 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-09-17T09:02:15.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:15 smithi136 bash[24812]: audit 2024-09-17T09:02:14.082460+0000 mon.a (mon.0) 2713 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:16.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:16 smithi136 bash[24812]: cluster 2024-09-17T09:02:14.989930+0000 mgr.y (mgr.14532) 417 : cluster [DBG] pgmap v631: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:16.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:16 smithi136 bash[24812]: cluster 2024-09-17T09:02:15.085538+0000 mon.a (mon.0) 2714 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-09-17T09:02:16.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:16 smithi136 bash[24812]: audit 2024-09-17T09:02:15.161468+0000 mon.a (mon.0) 2715 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:16.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:16 smithi136 bash[24812]: audit 2024-09-17T09:02:15.162358+0000 mon.a (mon.0) 2716 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-67"}]: dispatch 2024-09-17T09:02:16.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[32124]: cluster 2024-09-17T09:02:14.989930+0000 mgr.y (mgr.14532) 417 : cluster [DBG] pgmap v631: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:16.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[32124]: cluster 2024-09-17T09:02:15.085538+0000 mon.a (mon.0) 2714 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-09-17T09:02:16.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[32124]: audit 2024-09-17T09:02:15.161468+0000 mon.a (mon.0) 2715 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:16.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[32124]: audit 2024-09-17T09:02:15.162358+0000 mon.a (mon.0) 2716 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-67"}]: dispatch 2024-09-17T09:02:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[22670]: cluster 2024-09-17T09:02:14.989930+0000 mgr.y (mgr.14532) 417 : cluster [DBG] pgmap v631: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[22670]: cluster 2024-09-17T09:02:15.085538+0000 mon.a (mon.0) 2714 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-09-17T09:02:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[22670]: audit 2024-09-17T09:02:15.161468+0000 mon.a (mon.0) 2715 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:16.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:16 smithi078 bash[22670]: audit 2024-09-17T09:02:15.162358+0000 mon.a (mon.0) 2716 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-67"}]: dispatch 2024-09-17T09:02:17.851 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[32124]: cluster 2024-09-17T09:02:16.086326+0000 mon.a (mon.0) 2717 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-09-17T09:02:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[32124]: cluster 2024-09-17T09:02:16.990736+0000 mgr.y (mgr.14532) 418 : cluster [DBG] pgmap v634: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[32124]: cluster 2024-09-17T09:02:17.090511+0000 mon.a (mon.0) 2718 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-09-17T09:02:17.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[32124]: audit 2024-09-17T09:02:17.097631+0000 mon.a (mon.0) 2719 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[22670]: cluster 2024-09-17T09:02:16.086326+0000 mon.a (mon.0) 2717 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-09-17T09:02:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[22670]: cluster 2024-09-17T09:02:16.990736+0000 mgr.y (mgr.14532) 418 : cluster [DBG] pgmap v634: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[22670]: cluster 2024-09-17T09:02:17.090511+0000 mon.a (mon.0) 2718 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-09-17T09:02:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[22670]: audit 2024-09-17T09:02:17.097631+0000 mon.a (mon.0) 2719 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:18.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:17 smithi136 bash[24812]: cluster 2024-09-17T09:02:16.086326+0000 mon.a (mon.0) 2717 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-09-17T09:02:18.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:17 smithi136 bash[24812]: cluster 2024-09-17T09:02:16.990736+0000 mgr.y (mgr.14532) 418 : cluster [DBG] pgmap v634: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:18.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:17 smithi136 bash[24812]: cluster 2024-09-17T09:02:17.090511+0000 mon.a (mon.0) 2718 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-09-17T09:02:18.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:17 smithi136 bash[24812]: audit 2024-09-17T09:02:17.097631+0000 mon.a (mon.0) 2719 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:18.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:02:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:02:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:02:19.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[22670]: audit 2024-09-17T09:02:18.093327+0000 mon.a (mon.0) 2720 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:19.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[22670]: cluster 2024-09-17T09:02:18.093821+0000 mon.a (mon.0) 2721 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-09-17T09:02:19.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[22670]: audit 2024-09-17T09:02:18.105452+0000 mon.a (mon.0) 2722 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:19.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[22670]: audit 2024-09-17T09:02:18.273363+0000 mon.a (mon.0) 2723 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:19.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[22670]: audit 2024-09-17T09:02:18.274264+0000 mon.a (mon.0) 2724 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-69"}]: dispatch 2024-09-17T09:02:19.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[32124]: audit 2024-09-17T09:02:18.093327+0000 mon.a (mon.0) 2720 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:19.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[32124]: cluster 2024-09-17T09:02:18.093821+0000 mon.a (mon.0) 2721 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-09-17T09:02:19.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[32124]: audit 2024-09-17T09:02:18.105452+0000 mon.a (mon.0) 2722 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:19.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[32124]: audit 2024-09-17T09:02:18.273363+0000 mon.a (mon.0) 2723 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:19.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:19 smithi078 bash[32124]: audit 2024-09-17T09:02:18.274264+0000 mon.a (mon.0) 2724 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-69"}]: dispatch 2024-09-17T09:02:19.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:19 smithi136 bash[24812]: audit 2024-09-17T09:02:18.093327+0000 mon.a (mon.0) 2720 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:19 smithi136 bash[24812]: cluster 2024-09-17T09:02:18.093821+0000 mon.a (mon.0) 2721 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-09-17T09:02:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:19 smithi136 bash[24812]: audit 2024-09-17T09:02:18.105452+0000 mon.a (mon.0) 2722 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:19 smithi136 bash[24812]: audit 2024-09-17T09:02:18.273363+0000 mon.a (mon.0) 2723 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:19.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:19 smithi136 bash[24812]: audit 2024-09-17T09:02:18.274264+0000 mon.a (mon.0) 2724 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-69"}]: dispatch 2024-09-17T09:02:20.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:02:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:02:20.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:20 smithi136 bash[24812]: cluster 2024-09-17T09:02:18.991538+0000 mgr.y (mgr.14532) 419 : cluster [DBG] pgmap v637: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:02:20.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:20 smithi136 bash[24812]: cluster 2024-09-17T09:02:19.109923+0000 mon.a (mon.0) 2725 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-09-17T09:02:20.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:20 smithi078 bash[22670]: cluster 2024-09-17T09:02:18.991538+0000 mgr.y (mgr.14532) 419 : cluster [DBG] pgmap v637: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:02:20.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:20 smithi078 bash[22670]: cluster 2024-09-17T09:02:19.109923+0000 mon.a (mon.0) 2725 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-09-17T09:02:20.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:20 smithi078 bash[32124]: cluster 2024-09-17T09:02:18.991538+0000 mgr.y (mgr.14532) 419 : cluster [DBG] pgmap v637: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:02:20.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:20 smithi078 bash[32124]: cluster 2024-09-17T09:02:19.109923+0000 mon.a (mon.0) 2725 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-09-17T09:02:21.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:21 smithi136 bash[24812]: audit 2024-09-17T09:02:19.671143+0000 mgr.y (mgr.14532) 420 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:21.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:21 smithi136 bash[24812]: cluster 2024-09-17T09:02:20.112292+0000 mon.a (mon.0) 2726 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-09-17T09:02:21.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:21 smithi136 bash[24812]: audit 2024-09-17T09:02:20.122149+0000 mon.a (mon.0) 2727 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:21.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:21 smithi136 bash[24812]: audit 2024-09-17T09:02:21.112933+0000 mon.a (mon.0) 2728 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:21.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:21 smithi136 bash[24812]: cluster 2024-09-17T09:02:21.113232+0000 mon.a (mon.0) 2729 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[22670]: audit 2024-09-17T09:02:19.671143+0000 mgr.y (mgr.14532) 420 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[22670]: cluster 2024-09-17T09:02:20.112292+0000 mon.a (mon.0) 2726 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[22670]: audit 2024-09-17T09:02:20.122149+0000 mon.a (mon.0) 2727 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[22670]: audit 2024-09-17T09:02:21.112933+0000 mon.a (mon.0) 2728 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[22670]: cluster 2024-09-17T09:02:21.113232+0000 mon.a (mon.0) 2729 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[32124]: audit 2024-09-17T09:02:19.671143+0000 mgr.y (mgr.14532) 420 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[32124]: cluster 2024-09-17T09:02:20.112292+0000 mon.a (mon.0) 2726 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-09-17T09:02:21.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[32124]: audit 2024-09-17T09:02:20.122149+0000 mon.a (mon.0) 2727 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[32124]: audit 2024-09-17T09:02:21.112933+0000 mon.a (mon.0) 2728 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:21 smithi078 bash[32124]: cluster 2024-09-17T09:02:21.113232+0000 mon.a (mon.0) 2729 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-09-17T09:02:22.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:22 smithi136 bash[24812]: cluster 2024-09-17T09:02:20.992349+0000 mgr.y (mgr.14532) 421 : cluster [DBG] pgmap v640: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:02:22.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:22 smithi136 bash[24812]: audit 2024-09-17T09:02:21.119017+0000 mon.a (mon.0) 2730 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:22.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:22 smithi136 bash[24812]: cluster 2024-09-17T09:02:21.127596+0000 mon.a (mon.0) 2731 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:22.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:22 smithi136 bash[24812]: audit 2024-09-17T09:02:21.132209+0000 mon.a (mon.0) 2732 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:02:22.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:22 smithi136 bash[24812]: audit 2024-09-17T09:02:22.115998+0000 mon.a (mon.0) 2733 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:02:22.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:22 smithi136 bash[24812]: cluster 2024-09-17T09:02:22.116170+0000 mon.a (mon.0) 2734 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-09-17T09:02:22.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[22670]: cluster 2024-09-17T09:02:20.992349+0000 mgr.y (mgr.14532) 421 : cluster [DBG] pgmap v640: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[22670]: audit 2024-09-17T09:02:21.119017+0000 mon.a (mon.0) 2730 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[22670]: cluster 2024-09-17T09:02:21.127596+0000 mon.a (mon.0) 2731 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[22670]: audit 2024-09-17T09:02:21.132209+0000 mon.a (mon.0) 2732 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[22670]: audit 2024-09-17T09:02:22.115998+0000 mon.a (mon.0) 2733 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[22670]: cluster 2024-09-17T09:02:22.116170+0000 mon.a (mon.0) 2734 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[32124]: cluster 2024-09-17T09:02:20.992349+0000 mgr.y (mgr.14532) 421 : cluster [DBG] pgmap v640: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[32124]: audit 2024-09-17T09:02:21.119017+0000 mon.a (mon.0) 2730 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[32124]: cluster 2024-09-17T09:02:21.127596+0000 mon.a (mon.0) 2731 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[32124]: audit 2024-09-17T09:02:21.132209+0000 mon.a (mon.0) 2732 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:02:22.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[32124]: audit 2024-09-17T09:02:22.115998+0000 mon.a (mon.0) 2733 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:02:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:22 smithi078 bash[32124]: cluster 2024-09-17T09:02:22.116170+0000 mon.a (mon.0) 2734 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-09-17T09:02:23.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:23 smithi136 bash[24812]: cluster 2024-09-17T09:02:22.994456+0000 mgr.y (mgr.14532) 422 : cluster [DBG] pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-09-17T09:02:23.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:23 smithi078 bash[22670]: cluster 2024-09-17T09:02:22.994456+0000 mgr.y (mgr.14532) 422 : cluster [DBG] pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-09-17T09:02:23.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:23 smithi078 bash[32124]: cluster 2024-09-17T09:02:22.994456+0000 mgr.y (mgr.14532) 422 : cluster [DBG] pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-09-17T09:02:24.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:24 smithi136 bash[24812]: cluster 2024-09-17T09:02:23.153321+0000 mon.a (mon.0) 2735 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-09-17T09:02:24.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:24 smithi136 bash[24812]: audit 2024-09-17T09:02:23.817279+0000 mon.a (mon.0) 2736 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:02:24.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:24 smithi078 bash[32124]: cluster 2024-09-17T09:02:23.153321+0000 mon.a (mon.0) 2735 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-09-17T09:02:24.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:24 smithi078 bash[32124]: audit 2024-09-17T09:02:23.817279+0000 mon.a (mon.0) 2736 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:02:24.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:24 smithi078 bash[22670]: cluster 2024-09-17T09:02:23.153321+0000 mon.a (mon.0) 2735 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-09-17T09:02:24.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:24 smithi078 bash[22670]: audit 2024-09-17T09:02:23.817279+0000 mon.a (mon.0) 2736 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:02:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:25 smithi136 bash[24812]: audit 2024-09-17T09:02:24.378128+0000 mon.a (mon.0) 2737 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:02:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:25 smithi136 bash[24812]: audit 2024-09-17T09:02:24.379838+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:02:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:25 smithi136 bash[24812]: audit 2024-09-17T09:02:24.388030+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:02:25.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:25 smithi136 bash[24812]: cluster 2024-09-17T09:02:24.995272+0000 mgr.y (mgr.14532) 423 : cluster [DBG] pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-09-17T09:02:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[22670]: audit 2024-09-17T09:02:24.378128+0000 mon.a (mon.0) 2737 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:02:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[22670]: audit 2024-09-17T09:02:24.379838+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:02:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[22670]: audit 2024-09-17T09:02:24.388030+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:02:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[22670]: cluster 2024-09-17T09:02:24.995272+0000 mgr.y (mgr.14532) 423 : cluster [DBG] pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-09-17T09:02:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[32124]: audit 2024-09-17T09:02:24.378128+0000 mon.a (mon.0) 2737 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:02:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[32124]: audit 2024-09-17T09:02:24.379838+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:02:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[32124]: audit 2024-09-17T09:02:24.388030+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:02:25.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:25 smithi078 bash[32124]: cluster 2024-09-17T09:02:24.995272+0000 mgr.y (mgr.14532) 423 : cluster [DBG] pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-09-17T09:02:26.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:26 smithi136 bash[24812]: audit 2024-09-17T09:02:25.692721+0000 mon.a (mon.0) 2740 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:26.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:26 smithi078 bash[22670]: audit 2024-09-17T09:02:25.692721+0000 mon.a (mon.0) 2740 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:26.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:26 smithi078 bash[32124]: audit 2024-09-17T09:02:25.692721+0000 mon.a (mon.0) 2740 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:27.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:27 smithi136 bash[24812]: cluster 2024-09-17T09:02:26.996027+0000 mgr.y (mgr.14532) 424 : cluster [DBG] pgmap v646: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-17T09:02:27.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:27 smithi078 bash[22670]: cluster 2024-09-17T09:02:26.996027+0000 mgr.y (mgr.14532) 424 : cluster [DBG] pgmap v646: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-17T09:02:27.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:27 smithi078 bash[32124]: cluster 2024-09-17T09:02:26.996027+0000 mgr.y (mgr.14532) 424 : cluster [DBG] pgmap v646: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-17T09:02:28.351 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:02:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:02:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:02:28.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:28 smithi136 bash[24812]: cluster 2024-09-17T09:02:27.640516+0000 mon.a (mon.0) 2741 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:28.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:28 smithi078 bash[22670]: cluster 2024-09-17T09:02:27.640516+0000 mon.a (mon.0) 2741 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:28.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:28 smithi078 bash[32124]: cluster 2024-09-17T09:02:27.640516+0000 mon.a (mon.0) 2741 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:02:29.680 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:29 smithi136 bash[24812]: cluster 2024-09-17T09:02:28.998221+0000 mgr.y (mgr.14532) 425 : cluster [DBG] pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-17T09:02:29.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:29 smithi078 bash[22670]: cluster 2024-09-17T09:02:28.998221+0000 mgr.y (mgr.14532) 425 : cluster [DBG] pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-17T09:02:29.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:29 smithi078 bash[32124]: cluster 2024-09-17T09:02:28.998221+0000 mgr.y (mgr.14532) 425 : cluster [DBG] pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-17T09:02:30.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:02:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:02:30.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:30 smithi136 bash[24812]: audit 2024-09-17T09:02:29.682419+0000 mgr.y (mgr.14532) 426 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:30 smithi078 bash[22670]: audit 2024-09-17T09:02:29.682419+0000 mgr.y (mgr.14532) 426 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:30.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:30 smithi078 bash[32124]: audit 2024-09-17T09:02:29.682419+0000 mgr.y (mgr.14532) 426 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:31.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:31 smithi136 bash[24812]: cluster 2024-09-17T09:02:30.999073+0000 mgr.y (mgr.14532) 427 : cluster [DBG] pgmap v648: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-09-17T09:02:31.851 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:31 smithi078 bash[22670]: cluster 2024-09-17T09:02:30.999073+0000 mgr.y (mgr.14532) 427 : cluster [DBG] pgmap v648: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-09-17T09:02:31.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:31 smithi078 bash[32124]: cluster 2024-09-17T09:02:30.999073+0000 mgr.y (mgr.14532) 427 : cluster [DBG] pgmap v648: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-09-17T09:02:34.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:34 smithi078 bash[22670]: cluster 2024-09-17T09:02:33.001122+0000 mgr.y (mgr.14532) 428 : cluster [DBG] pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 409 B/s wr, 1 op/s 2024-09-17T09:02:34.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:34 smithi078 bash[32124]: cluster 2024-09-17T09:02:33.001122+0000 mgr.y (mgr.14532) 428 : cluster [DBG] pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 409 B/s wr, 1 op/s 2024-09-17T09:02:34.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:34 smithi136 bash[24812]: cluster 2024-09-17T09:02:33.001122+0000 mgr.y (mgr.14532) 428 : cluster [DBG] pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 409 B/s wr, 1 op/s 2024-09-17T09:02:36.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:36 smithi078 bash[32124]: cluster 2024-09-17T09:02:35.001917+0000 mgr.y (mgr.14532) 429 : cluster [DBG] pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 345 B/s wr, 1 op/s 2024-09-17T09:02:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:36 smithi078 bash[22670]: cluster 2024-09-17T09:02:35.001917+0000 mgr.y (mgr.14532) 429 : cluster [DBG] pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 345 B/s wr, 1 op/s 2024-09-17T09:02:36.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:36 smithi136 bash[24812]: cluster 2024-09-17T09:02:35.001917+0000 mgr.y (mgr.14532) 429 : cluster [DBG] pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 345 B/s wr, 1 op/s 2024-09-17T09:02:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:02:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:02:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:02:38.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:38 smithi078 bash[32124]: cluster 2024-09-17T09:02:37.002708+0000 mgr.y (mgr.14532) 430 : cluster [DBG] pgmap v651: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 341 B/s wr, 1 op/s 2024-09-17T09:02:38.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:38 smithi078 bash[22670]: cluster 2024-09-17T09:02:37.002708+0000 mgr.y (mgr.14532) 430 : cluster [DBG] pgmap v651: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 341 B/s wr, 1 op/s 2024-09-17T09:02:38.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:38 smithi136 bash[24812]: cluster 2024-09-17T09:02:37.002708+0000 mgr.y (mgr.14532) 430 : cluster [DBG] pgmap v651: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 341 B/s wr, 1 op/s 2024-09-17T09:02:40.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:02:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:02:40.351 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:40 smithi078 bash[32124]: cluster 2024-09-17T09:02:39.004896+0000 mgr.y (mgr.14532) 431 : cluster [DBG] pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 596 B/s wr, 3 op/s 2024-09-17T09:02:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:40 smithi078 bash[22670]: cluster 2024-09-17T09:02:39.004896+0000 mgr.y (mgr.14532) 431 : cluster [DBG] pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 596 B/s wr, 3 op/s 2024-09-17T09:02:40.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:40 smithi136 bash[24812]: cluster 2024-09-17T09:02:39.004896+0000 mgr.y (mgr.14532) 431 : cluster [DBG] pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 596 B/s wr, 3 op/s 2024-09-17T09:02:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:41 smithi078 bash[22670]: audit 2024-09-17T09:02:39.692705+0000 mgr.y (mgr.14532) 432 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:41.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:41 smithi078 bash[22670]: audit 2024-09-17T09:02:40.722606+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:41.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:41 smithi078 bash[32124]: audit 2024-09-17T09:02:39.692705+0000 mgr.y (mgr.14532) 432 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:41.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:41 smithi078 bash[32124]: audit 2024-09-17T09:02:40.722606+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:41 smithi136 bash[24812]: audit 2024-09-17T09:02:39.692705+0000 mgr.y (mgr.14532) 432 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:41 smithi136 bash[24812]: audit 2024-09-17T09:02:40.722606+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:42.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:42 smithi078 bash[22670]: cluster 2024-09-17T09:02:41.005670+0000 mgr.y (mgr.14532) 433 : cluster [DBG] pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:02:42.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:42 smithi078 bash[32124]: cluster 2024-09-17T09:02:41.005670+0000 mgr.y (mgr.14532) 433 : cluster [DBG] pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:02:42.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:42 smithi136 bash[24812]: cluster 2024-09-17T09:02:41.005670+0000 mgr.y (mgr.14532) 433 : cluster [DBG] pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:02:44.351 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:44 smithi078 bash[22670]: cluster 2024-09-17T09:02:43.007841+0000 mgr.y (mgr.14532) 434 : cluster [DBG] pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:02:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:44 smithi078 bash[22670]: audit 2024-09-17T09:02:43.255548+0000 mon.a (mon.0) 2743 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:44.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:44 smithi078 bash[22670]: audit 2024-09-17T09:02:43.256475+0000 mon.a (mon.0) 2744 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-71"}]: dispatch 2024-09-17T09:02:44.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:44 smithi078 bash[32124]: cluster 2024-09-17T09:02:43.007841+0000 mgr.y (mgr.14532) 434 : cluster [DBG] pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:02:44.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:44 smithi078 bash[32124]: audit 2024-09-17T09:02:43.255548+0000 mon.a (mon.0) 2743 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:44.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:44 smithi078 bash[32124]: audit 2024-09-17T09:02:43.256475+0000 mon.a (mon.0) 2744 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-71"}]: dispatch 2024-09-17T09:02:44.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:44 smithi136 bash[24812]: cluster 2024-09-17T09:02:43.007841+0000 mgr.y (mgr.14532) 434 : cluster [DBG] pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:02:44.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:44 smithi136 bash[24812]: audit 2024-09-17T09:02:43.255548+0000 mon.a (mon.0) 2743 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:44.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:44 smithi136 bash[24812]: audit 2024-09-17T09:02:43.256475+0000 mon.a (mon.0) 2744 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-71"}]: dispatch 2024-09-17T09:02:45.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:45 smithi136 bash[24812]: cluster 2024-09-17T09:02:44.109299+0000 mon.a (mon.0) 2745 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-09-17T09:02:45.601 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:45 smithi078 bash[22670]: cluster 2024-09-17T09:02:44.109299+0000 mon.a (mon.0) 2745 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-09-17T09:02:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:45 smithi078 bash[32124]: cluster 2024-09-17T09:02:44.109299+0000 mon.a (mon.0) 2745 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-09-17T09:02:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:46 smithi136 bash[24812]: cluster 2024-09-17T09:02:45.008755+0000 mgr.y (mgr.14532) 435 : cluster [DBG] pgmap v656: 196 pgs: 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-09-17T09:02:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:46 smithi136 bash[24812]: cluster 2024-09-17T09:02:45.116927+0000 mon.a (mon.0) 2746 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-09-17T09:02:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:46 smithi136 bash[24812]: audit 2024-09-17T09:02:45.124774+0000 mon.a (mon.0) 2747 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:46.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:46 smithi136 bash[24812]: audit 2024-09-17T09:02:46.119256+0000 mon.a (mon.0) 2748 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:46.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:46 smithi136 bash[24812]: cluster 2024-09-17T09:02:46.119606+0000 mon.a (mon.0) 2749 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-09-17T09:02:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[32124]: cluster 2024-09-17T09:02:45.008755+0000 mgr.y (mgr.14532) 435 : cluster [DBG] pgmap v656: 196 pgs: 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-09-17T09:02:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[32124]: cluster 2024-09-17T09:02:45.116927+0000 mon.a (mon.0) 2746 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-09-17T09:02:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[32124]: audit 2024-09-17T09:02:45.124774+0000 mon.a (mon.0) 2747 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[32124]: audit 2024-09-17T09:02:46.119256+0000 mon.a (mon.0) 2748 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[32124]: cluster 2024-09-17T09:02:46.119606+0000 mon.a (mon.0) 2749 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-09-17T09:02:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[22670]: cluster 2024-09-17T09:02:45.008755+0000 mgr.y (mgr.14532) 435 : cluster [DBG] pgmap v656: 196 pgs: 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-09-17T09:02:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[22670]: cluster 2024-09-17T09:02:45.116927+0000 mon.a (mon.0) 2746 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-09-17T09:02:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[22670]: audit 2024-09-17T09:02:45.124774+0000 mon.a (mon.0) 2747 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:02:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[22670]: audit 2024-09-17T09:02:46.119256+0000 mon.a (mon.0) 2748 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:02:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:46 smithi078 bash[22670]: cluster 2024-09-17T09:02:46.119606+0000 mon.a (mon.0) 2749 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-09-17T09:02:47.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:47 smithi136 bash[24812]: audit 2024-09-17T09:02:46.128536+0000 mon.a (mon.0) 2750 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:47.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:47 smithi136 bash[24812]: cluster 2024-09-17T09:02:47.009587+0000 mgr.y (mgr.14532) 436 : cluster [DBG] pgmap v659: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:47.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:47 smithi078 bash[32124]: audit 2024-09-17T09:02:46.128536+0000 mon.a (mon.0) 2750 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:47 smithi078 bash[32124]: cluster 2024-09-17T09:02:47.009587+0000 mgr.y (mgr.14532) 436 : cluster [DBG] pgmap v659: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:47 smithi078 bash[22670]: audit 2024-09-17T09:02:46.128536+0000 mon.a (mon.0) 2750 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:02:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:47 smithi078 bash[22670]: cluster 2024-09-17T09:02:47.009587+0000 mgr.y (mgr.14532) 436 : cluster [DBG] pgmap v659: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:02:48.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:02:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:02:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:02:48.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:48 smithi078 bash[32124]: cluster 2024-09-17T09:02:47.172700+0000 mon.a (mon.0) 2751 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-09-17T09:02:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:48 smithi078 bash[22670]: cluster 2024-09-17T09:02:47.172700+0000 mon.a (mon.0) 2751 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-09-17T09:02:48.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:48 smithi136 bash[24812]: cluster 2024-09-17T09:02:47.172700+0000 mon.a (mon.0) 2751 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-09-17T09:02:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:49 smithi136 bash[24812]: cluster 2024-09-17T09:02:48.180089+0000 mon.a (mon.0) 2752 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2024-09-17T09:02:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:49 smithi136 bash[24812]: cluster 2024-09-17T09:02:49.010391+0000 mgr.y (mgr.14532) 437 : cluster [DBG] pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:02:49.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:49 smithi078 bash[32124]: cluster 2024-09-17T09:02:48.180089+0000 mon.a (mon.0) 2752 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2024-09-17T09:02:49.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:49 smithi078 bash[32124]: cluster 2024-09-17T09:02:49.010391+0000 mgr.y (mgr.14532) 437 : cluster [DBG] pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:02:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:49 smithi078 bash[22670]: cluster 2024-09-17T09:02:48.180089+0000 mon.a (mon.0) 2752 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2024-09-17T09:02:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:49 smithi078 bash[22670]: cluster 2024-09-17T09:02:49.010391+0000 mgr.y (mgr.14532) 437 : cluster [DBG] pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:02:50.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:02:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:02:50.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:50 smithi136 bash[24812]: audit 2024-09-17T09:02:49.700321+0000 mgr.y (mgr.14532) 438 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:50 smithi078 bash[32124]: audit 2024-09-17T09:02:49.700321+0000 mgr.y (mgr.14532) 438 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:50 smithi078 bash[22670]: audit 2024-09-17T09:02:49.700321+0000 mgr.y (mgr.14532) 438 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:02:51.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:51 smithi136 bash[24812]: cluster 2024-09-17T09:02:51.011219+0000 mgr.y (mgr.14532) 439 : cluster [DBG] pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 1.0 KiB/s wr, 1 op/s 2024-09-17T09:02:51.601 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:51 smithi078 bash[32124]: cluster 2024-09-17T09:02:51.011219+0000 mgr.y (mgr.14532) 439 : cluster [DBG] pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 1.0 KiB/s wr, 1 op/s 2024-09-17T09:02:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:51 smithi078 bash[22670]: cluster 2024-09-17T09:02:51.011219+0000 mgr.y (mgr.14532) 439 : cluster [DBG] pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 1.0 KiB/s wr, 1 op/s 2024-09-17T09:02:54.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:54 smithi078 bash[32124]: cluster 2024-09-17T09:02:53.013305+0000 mgr.y (mgr.14532) 440 : cluster [DBG] pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-09-17T09:02:54.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:54 smithi078 bash[22670]: cluster 2024-09-17T09:02:53.013305+0000 mgr.y (mgr.14532) 440 : cluster [DBG] pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-09-17T09:02:54.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:54 smithi136 bash[24812]: cluster 2024-09-17T09:02:53.013305+0000 mgr.y (mgr.14532) 440 : cluster [DBG] pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-09-17T09:02:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:56 smithi078 bash[32124]: cluster 2024-09-17T09:02:55.014105+0000 mgr.y (mgr.14532) 441 : cluster [DBG] pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-17T09:02:56.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:56 smithi078 bash[32124]: audit 2024-09-17T09:02:55.751696+0000 mon.a (mon.0) 2753 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:56 smithi078 bash[22670]: cluster 2024-09-17T09:02:55.014105+0000 mgr.y (mgr.14532) 441 : cluster [DBG] pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-17T09:02:56.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:56 smithi078 bash[22670]: audit 2024-09-17T09:02:55.751696+0000 mon.a (mon.0) 2753 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:56.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:56 smithi136 bash[24812]: cluster 2024-09-17T09:02:55.014105+0000 mgr.y (mgr.14532) 441 : cluster [DBG] pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-17T09:02:56.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:56 smithi136 bash[24812]: audit 2024-09-17T09:02:55.751696+0000 mon.a (mon.0) 2753 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:02:58.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:02:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:02:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:02:58.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:58 smithi078 bash[32124]: cluster 2024-09-17T09:02:57.014917+0000 mgr.y (mgr.14532) 442 : cluster [DBG] pgmap v666: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 727 B/s wr, 3 op/s 2024-09-17T09:02:58.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:58 smithi078 bash[22670]: cluster 2024-09-17T09:02:57.014917+0000 mgr.y (mgr.14532) 442 : cluster [DBG] pgmap v666: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 727 B/s wr, 3 op/s 2024-09-17T09:02:58.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:58 smithi136 bash[24812]: cluster 2024-09-17T09:02:57.014917+0000 mgr.y (mgr.14532) 442 : cluster [DBG] pgmap v666: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 727 B/s wr, 3 op/s 2024-09-17T09:02:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:59 smithi078 bash[32124]: audit 2024-09-17T09:02:58.269982+0000 mon.a (mon.0) 2754 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:59.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:02:59 smithi078 bash[32124]: audit 2024-09-17T09:02:58.270879+0000 mon.a (mon.0) 2755 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-73"}]: dispatch 2024-09-17T09:02:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:59 smithi078 bash[22670]: audit 2024-09-17T09:02:58.269982+0000 mon.a (mon.0) 2754 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:59.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:02:59 smithi078 bash[22670]: audit 2024-09-17T09:02:58.270879+0000 mon.a (mon.0) 2755 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-73"}]: dispatch 2024-09-17T09:02:59.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:59 smithi136 bash[24812]: audit 2024-09-17T09:02:58.269982+0000 mon.a (mon.0) 2754 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:02:59.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:02:59 smithi136 bash[24812]: audit 2024-09-17T09:02:58.270879+0000 mon.a (mon.0) 2755 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-73"}]: dispatch 2024-09-17T09:03:00.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:02:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:03:00.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:00 smithi136 bash[24812]: cluster 2024-09-17T09:02:59.017055+0000 mgr.y (mgr.14532) 443 : cluster [DBG] pgmap v667: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 94 B/s wr, 2 op/s 2024-09-17T09:03:00.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:00 smithi136 bash[24812]: cluster 2024-09-17T09:02:59.096714+0000 mon.a (mon.0) 2756 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2024-09-17T09:03:00.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:00 smithi078 bash[22670]: cluster 2024-09-17T09:02:59.017055+0000 mgr.y (mgr.14532) 443 : cluster [DBG] pgmap v667: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 94 B/s wr, 2 op/s 2024-09-17T09:03:00.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:00 smithi078 bash[22670]: cluster 2024-09-17T09:02:59.096714+0000 mon.a (mon.0) 2756 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2024-09-17T09:03:00.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:00 smithi078 bash[32124]: cluster 2024-09-17T09:02:59.017055+0000 mgr.y (mgr.14532) 443 : cluster [DBG] pgmap v667: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 94 B/s wr, 2 op/s 2024-09-17T09:03:00.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:00 smithi078 bash[32124]: cluster 2024-09-17T09:02:59.096714+0000 mon.a (mon.0) 2756 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2024-09-17T09:03:01.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:01 smithi136 bash[24812]: audit 2024-09-17T09:02:59.711712+0000 mgr.y (mgr.14532) 444 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:01.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:01 smithi136 bash[24812]: cluster 2024-09-17T09:03:00.102670+0000 mon.a (mon.0) 2757 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2024-09-17T09:03:01.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:01 smithi136 bash[24812]: audit 2024-09-17T09:03:00.113592+0000 mon.a (mon.0) 2758 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:01.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:01 smithi136 bash[24812]: audit 2024-09-17T09:03:01.102604+0000 mon.a (mon.0) 2759 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:01.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:01 smithi136 bash[24812]: cluster 2024-09-17T09:03:01.103142+0000 mon.a (mon.0) 2760 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2024-09-17T09:03:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[22670]: audit 2024-09-17T09:02:59.711712+0000 mgr.y (mgr.14532) 444 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[22670]: cluster 2024-09-17T09:03:00.102670+0000 mon.a (mon.0) 2757 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2024-09-17T09:03:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[22670]: audit 2024-09-17T09:03:00.113592+0000 mon.a (mon.0) 2758 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[22670]: audit 2024-09-17T09:03:01.102604+0000 mon.a (mon.0) 2759 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[22670]: cluster 2024-09-17T09:03:01.103142+0000 mon.a (mon.0) 2760 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2024-09-17T09:03:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[32124]: audit 2024-09-17T09:02:59.711712+0000 mgr.y (mgr.14532) 444 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[32124]: cluster 2024-09-17T09:03:00.102670+0000 mon.a (mon.0) 2757 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2024-09-17T09:03:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[32124]: audit 2024-09-17T09:03:00.113592+0000 mon.a (mon.0) 2758 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[32124]: audit 2024-09-17T09:03:01.102604+0000 mon.a (mon.0) 2759 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:01 smithi078 bash[32124]: cluster 2024-09-17T09:03:01.103142+0000 mon.a (mon.0) 2760 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2024-09-17T09:03:02.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:02 smithi136 bash[24812]: cluster 2024-09-17T09:03:01.017851+0000 mgr.y (mgr.14532) 445 : cluster [DBG] pgmap v670: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:02.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:02 smithi136 bash[24812]: cluster 2024-09-17T09:03:01.105347+0000 mon.a (mon.0) 2761 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:02.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:02 smithi136 bash[24812]: audit 2024-09-17T09:03:01.106961+0000 mon.a (mon.0) 2762 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:02.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:02 smithi078 bash[32124]: cluster 2024-09-17T09:03:01.017851+0000 mgr.y (mgr.14532) 445 : cluster [DBG] pgmap v670: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:02.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:02 smithi078 bash[32124]: cluster 2024-09-17T09:03:01.105347+0000 mon.a (mon.0) 2761 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:02.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:02 smithi078 bash[32124]: audit 2024-09-17T09:03:01.106961+0000 mon.a (mon.0) 2762 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:02 smithi078 bash[22670]: cluster 2024-09-17T09:03:01.017851+0000 mgr.y (mgr.14532) 445 : cluster [DBG] pgmap v670: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:02 smithi078 bash[22670]: cluster 2024-09-17T09:03:01.105347+0000 mon.a (mon.0) 2761 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:02 smithi078 bash[22670]: audit 2024-09-17T09:03:01.106961+0000 mon.a (mon.0) 2762 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:03.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:03 smithi136 bash[24812]: cluster 2024-09-17T09:03:02.149301+0000 mon.a (mon.0) 2763 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2024-09-17T09:03:03.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:03 smithi136 bash[24812]: cluster 2024-09-17T09:03:03.019875+0000 mgr.y (mgr.14532) 446 : cluster [DBG] pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:03.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:03 smithi078 bash[22670]: cluster 2024-09-17T09:03:02.149301+0000 mon.a (mon.0) 2763 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2024-09-17T09:03:03.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:03 smithi078 bash[22670]: cluster 2024-09-17T09:03:03.019875+0000 mgr.y (mgr.14532) 446 : cluster [DBG] pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:03 smithi078 bash[32124]: cluster 2024-09-17T09:03:02.149301+0000 mon.a (mon.0) 2763 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2024-09-17T09:03:03.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:03 smithi078 bash[32124]: cluster 2024-09-17T09:03:03.019875+0000 mgr.y (mgr.14532) 446 : cluster [DBG] pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:03.603 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:03:03 smithi078 bash[35112]: debug 2024-09-17T09:03:03.222+0000 7fce8039e640 -1 snap_mapper.add_oid found existing snaps mapped on 65:fa78aab2:test-rados-api-smithi078-64852-76::foo:28, removing 2024-09-17T09:03:03.603 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:03:03 smithi078 bash[40803]: debug 2024-09-17T09:03:03.222+0000 7f39db0a0640 -1 snap_mapper.add_oid found existing snaps mapped on 65:fa78aab2:test-rados-api-smithi078-64852-76::foo:28, removing 2024-09-17T09:03:03.603 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:03:03 smithi078 bash[51921]: debug 2024-09-17T09:03:03.222+0000 7f8d38aa4640 -1 snap_mapper.add_oid found existing snaps mapped on 65:fa78aab2:test-rados-api-smithi078-64852-76::foo:28, removing 2024-09-17T09:03:04.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:04 smithi136 bash[24812]: cluster 2024-09-17T09:03:03.162513+0000 mon.a (mon.0) 2764 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2024-09-17T09:03:04.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:04 smithi136 bash[24812]: audit 2024-09-17T09:03:03.278580+0000 mon.a (mon.0) 2765 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:04.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:04 smithi136 bash[24812]: audit 2024-09-17T09:03:03.279637+0000 mon.a (mon.0) 2766 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-75"}]: dispatch 2024-09-17T09:03:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:04 smithi078 bash[22670]: cluster 2024-09-17T09:03:03.162513+0000 mon.a (mon.0) 2764 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2024-09-17T09:03:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:04 smithi078 bash[22670]: audit 2024-09-17T09:03:03.278580+0000 mon.a (mon.0) 2765 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:04 smithi078 bash[22670]: audit 2024-09-17T09:03:03.279637+0000 mon.a (mon.0) 2766 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-75"}]: dispatch 2024-09-17T09:03:04.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:04 smithi078 bash[32124]: cluster 2024-09-17T09:03:03.162513+0000 mon.a (mon.0) 2764 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2024-09-17T09:03:04.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:04 smithi078 bash[32124]: audit 2024-09-17T09:03:03.278580+0000 mon.a (mon.0) 2765 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:04.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:04 smithi078 bash[32124]: audit 2024-09-17T09:03:03.279637+0000 mon.a (mon.0) 2766 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-75"}]: dispatch 2024-09-17T09:03:05.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:05 smithi136 bash[24812]: cluster 2024-09-17T09:03:04.168665+0000 mon.a (mon.0) 2767 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2024-09-17T09:03:05.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:05 smithi136 bash[24812]: cluster 2024-09-17T09:03:05.020679+0000 mgr.y (mgr.14532) 447 : cluster [DBG] pgmap v676: 196 pgs: 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:03:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:05 smithi078 bash[22670]: cluster 2024-09-17T09:03:04.168665+0000 mon.a (mon.0) 2767 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2024-09-17T09:03:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:05 smithi078 bash[22670]: cluster 2024-09-17T09:03:05.020679+0000 mgr.y (mgr.14532) 447 : cluster [DBG] pgmap v676: 196 pgs: 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:03:05.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:05 smithi078 bash[32124]: cluster 2024-09-17T09:03:04.168665+0000 mon.a (mon.0) 2767 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2024-09-17T09:03:05.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:05 smithi078 bash[32124]: cluster 2024-09-17T09:03:05.020679+0000 mgr.y (mgr.14532) 447 : cluster [DBG] pgmap v676: 196 pgs: 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:03:06.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:06 smithi136 bash[24812]: cluster 2024-09-17T09:03:05.185456+0000 mon.a (mon.0) 2768 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2024-09-17T09:03:06.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:06 smithi136 bash[24812]: audit 2024-09-17T09:03:05.200970+0000 mon.a (mon.0) 2769 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:06 smithi078 bash[22670]: cluster 2024-09-17T09:03:05.185456+0000 mon.a (mon.0) 2768 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2024-09-17T09:03:06.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:06 smithi078 bash[22670]: audit 2024-09-17T09:03:05.200970+0000 mon.a (mon.0) 2769 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:06.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:06 smithi078 bash[32124]: cluster 2024-09-17T09:03:05.185456+0000 mon.a (mon.0) 2768 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2024-09-17T09:03:06.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:06 smithi078 bash[32124]: audit 2024-09-17T09:03:05.200970+0000 mon.a (mon.0) 2769 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:07.538 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:03:07 smithi136 bash[45001]: debug 2024-09-17T09:03:07.234+0000 7fc044b15640 -1 snap_mapper.add_oid found existing snaps mapped on 65:d70d7237:test-rados-api-smithi078-64852-78::foo:29, removing 2024-09-17T09:03:07.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:07 smithi136 bash[24812]: audit 2024-09-17T09:03:06.184255+0000 mon.a (mon.0) 2770 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:07.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:07 smithi136 bash[24812]: cluster 2024-09-17T09:03:06.186382+0000 mon.a (mon.0) 2771 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2024-09-17T09:03:07.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:07 smithi136 bash[24812]: audit 2024-09-17T09:03:06.191566+0000 mon.a (mon.0) 2772 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:07.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:07 smithi136 bash[24812]: cluster 2024-09-17T09:03:07.021483+0000 mgr.y (mgr.14532) 448 : cluster [DBG] pgmap v679: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:07.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:07 smithi136 bash[24812]: cluster 2024-09-17T09:03:07.185730+0000 mon.a (mon.0) 2773 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2024-09-17T09:03:07.602 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[35112]: debug 2024-09-17T09:03:07.226+0000 7fce8039e640 -1 snap_mapper.add_oid found existing snaps mapped on 65:d70d7237:test-rados-api-smithi078-64852-78::foo:29, removing 2024-09-17T09:03:07.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[32124]: audit 2024-09-17T09:03:06.184255+0000 mon.a (mon.0) 2770 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:07.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[32124]: cluster 2024-09-17T09:03:06.186382+0000 mon.a (mon.0) 2771 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2024-09-17T09:03:07.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[32124]: audit 2024-09-17T09:03:06.191566+0000 mon.a (mon.0) 2772 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:07.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[32124]: cluster 2024-09-17T09:03:07.021483+0000 mgr.y (mgr.14532) 448 : cluster [DBG] pgmap v679: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:07.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[32124]: cluster 2024-09-17T09:03:07.185730+0000 mon.a (mon.0) 2773 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2024-09-17T09:03:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[22670]: audit 2024-09-17T09:03:06.184255+0000 mon.a (mon.0) 2770 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[22670]: cluster 2024-09-17T09:03:06.186382+0000 mon.a (mon.0) 2771 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2024-09-17T09:03:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[22670]: audit 2024-09-17T09:03:06.191566+0000 mon.a (mon.0) 2772 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[22670]: cluster 2024-09-17T09:03:07.021483+0000 mgr.y (mgr.14532) 448 : cluster [DBG] pgmap v679: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[22670]: cluster 2024-09-17T09:03:07.185730+0000 mon.a (mon.0) 2773 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2024-09-17T09:03:07.603 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[46309]: debug 2024-09-17T09:03:07.226+0000 7f3f1c49a640 -1 snap_mapper.add_oid found existing snaps mapped on 65:d70d7237:test-rados-api-smithi078-64852-78::foo:29, removing 2024-09-17T09:03:08.220 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:03:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:03:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:03:08.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:08 smithi136 bash[24812]: audit 2024-09-17T09:03:07.271923+0000 mon.a (mon.0) 2774 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:08.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:08 smithi136 bash[24812]: audit 2024-09-17T09:03:07.272962+0000 mon.a (mon.0) 2775 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-77"}]: dispatch 2024-09-17T09:03:08.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:08 smithi136 bash[24812]: cluster 2024-09-17T09:03:07.649301+0000 mon.a (mon.0) 2776 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:08 smithi078 bash[32124]: audit 2024-09-17T09:03:07.271923+0000 mon.a (mon.0) 2774 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:08 smithi078 bash[32124]: audit 2024-09-17T09:03:07.272962+0000 mon.a (mon.0) 2775 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-77"}]: dispatch 2024-09-17T09:03:08.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:08 smithi078 bash[32124]: cluster 2024-09-17T09:03:07.649301+0000 mon.a (mon.0) 2776 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:08 smithi078 bash[22670]: audit 2024-09-17T09:03:07.271923+0000 mon.a (mon.0) 2774 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:08 smithi078 bash[22670]: audit 2024-09-17T09:03:07.272962+0000 mon.a (mon.0) 2775 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-77"}]: dispatch 2024-09-17T09:03:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:08 smithi078 bash[22670]: cluster 2024-09-17T09:03:07.649301+0000 mon.a (mon.0) 2776 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:09.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:09 smithi136 bash[24812]: cluster 2024-09-17T09:03:08.247709+0000 mon.a (mon.0) 2777 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2024-09-17T09:03:09.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:09 smithi136 bash[24812]: cluster 2024-09-17T09:03:09.022408+0000 mgr.y (mgr.14532) 449 : cluster [DBG] pgmap v682: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-17T09:03:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:09 smithi078 bash[22670]: cluster 2024-09-17T09:03:08.247709+0000 mon.a (mon.0) 2777 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2024-09-17T09:03:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:09 smithi078 bash[22670]: cluster 2024-09-17T09:03:09.022408+0000 mgr.y (mgr.14532) 449 : cluster [DBG] pgmap v682: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-17T09:03:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:09 smithi078 bash[32124]: cluster 2024-09-17T09:03:08.247709+0000 mon.a (mon.0) 2777 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2024-09-17T09:03:09.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:09 smithi078 bash[32124]: cluster 2024-09-17T09:03:09.022408+0000 mgr.y (mgr.14532) 449 : cluster [DBG] pgmap v682: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-17T09:03:10.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:03:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:03:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:10 smithi078 bash[22670]: cluster 2024-09-17T09:03:09.261038+0000 mon.a (mon.0) 2778 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2024-09-17T09:03:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:10 smithi078 bash[22670]: audit 2024-09-17T09:03:09.267582+0000 mon.a (mon.0) 2779 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:10 smithi078 bash[22670]: audit 2024-09-17T09:03:09.716113+0000 mgr.y (mgr.14532) 450 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:10 smithi078 bash[32124]: cluster 2024-09-17T09:03:09.261038+0000 mon.a (mon.0) 2778 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2024-09-17T09:03:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:10 smithi078 bash[32124]: audit 2024-09-17T09:03:09.267582+0000 mon.a (mon.0) 2779 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:10 smithi078 bash[32124]: audit 2024-09-17T09:03:09.716113+0000 mgr.y (mgr.14532) 450 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:10.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:10 smithi136 bash[24812]: cluster 2024-09-17T09:03:09.261038+0000 mon.a (mon.0) 2778 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2024-09-17T09:03:10.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:10 smithi136 bash[24812]: audit 2024-09-17T09:03:09.267582+0000 mon.a (mon.0) 2779 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:10.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:10 smithi136 bash[24812]: audit 2024-09-17T09:03:09.716113+0000 mgr.y (mgr.14532) 450 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[32124]: audit 2024-09-17T09:03:10.265044+0000 mon.a (mon.0) 2780 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[32124]: cluster 2024-09-17T09:03:10.266255+0000 mon.a (mon.0) 2781 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2024-09-17T09:03:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[32124]: audit 2024-09-17T09:03:10.276860+0000 mon.a (mon.0) 2782 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[32124]: audit 2024-09-17T09:03:10.780400+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:11.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[32124]: cluster 2024-09-17T09:03:11.023165+0000 mgr.y (mgr.14532) 451 : cluster [DBG] pgmap v685: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-17T09:03:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[22670]: audit 2024-09-17T09:03:10.265044+0000 mon.a (mon.0) 2780 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[22670]: cluster 2024-09-17T09:03:10.266255+0000 mon.a (mon.0) 2781 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2024-09-17T09:03:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[22670]: audit 2024-09-17T09:03:10.276860+0000 mon.a (mon.0) 2782 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[22670]: audit 2024-09-17T09:03:10.780400+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:11 smithi078 bash[22670]: cluster 2024-09-17T09:03:11.023165+0000 mgr.y (mgr.14532) 451 : cluster [DBG] pgmap v685: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-17T09:03:11.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:11 smithi136 bash[24812]: audit 2024-09-17T09:03:10.265044+0000 mon.a (mon.0) 2780 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:11.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:11 smithi136 bash[24812]: cluster 2024-09-17T09:03:10.266255+0000 mon.a (mon.0) 2781 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2024-09-17T09:03:11.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:11 smithi136 bash[24812]: audit 2024-09-17T09:03:10.276860+0000 mon.a (mon.0) 2782 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:11.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:11 smithi136 bash[24812]: audit 2024-09-17T09:03:10.780400+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:11.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:11 smithi136 bash[24812]: cluster 2024-09-17T09:03:11.023165+0000 mgr.y (mgr.14532) 451 : cluster [DBG] pgmap v685: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-17T09:03:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:12 smithi078 bash[22670]: cluster 2024-09-17T09:03:11.313221+0000 mon.a (mon.0) 2784 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2024-09-17T09:03:12.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:12 smithi078 bash[32124]: cluster 2024-09-17T09:03:11.313221+0000 mon.a (mon.0) 2784 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2024-09-17T09:03:12.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:12 smithi136 bash[24812]: cluster 2024-09-17T09:03:11.313221+0000 mon.a (mon.0) 2784 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2024-09-17T09:03:13.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[22670]: cluster 2024-09-17T09:03:12.316037+0000 mon.a (mon.0) 2785 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2024-09-17T09:03:13.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[22670]: audit 2024-09-17T09:03:12.362704+0000 mon.a (mon.0) 2786 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "224.1d"}]: dispatch 2024-09-17T09:03:13.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[22670]: audit 2024-09-17T09:03:12.363128+0000 mgr.y (mgr.14532) 452 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "224.1d"}]: dispatch 2024-09-17T09:03:13.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[22670]: cluster 2024-09-17T09:03:13.025095+0000 mgr.y (mgr.14532) 453 : cluster [DBG] pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T09:03:13.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[32124]: cluster 2024-09-17T09:03:12.316037+0000 mon.a (mon.0) 2785 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2024-09-17T09:03:13.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[32124]: audit 2024-09-17T09:03:12.362704+0000 mon.a (mon.0) 2786 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "224.1d"}]: dispatch 2024-09-17T09:03:13.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[32124]: audit 2024-09-17T09:03:12.363128+0000 mgr.y (mgr.14532) 452 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "224.1d"}]: dispatch 2024-09-17T09:03:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:13 smithi078 bash[32124]: cluster 2024-09-17T09:03:13.025095+0000 mgr.y (mgr.14532) 453 : cluster [DBG] pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T09:03:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:13 smithi136 bash[24812]: cluster 2024-09-17T09:03:12.316037+0000 mon.a (mon.0) 2785 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2024-09-17T09:03:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:13 smithi136 bash[24812]: audit 2024-09-17T09:03:12.362704+0000 mon.a (mon.0) 2786 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "224.1d"}]: dispatch 2024-09-17T09:03:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:13 smithi136 bash[24812]: audit 2024-09-17T09:03:12.363128+0000 mgr.y (mgr.14532) 452 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "224.1d"}]: dispatch 2024-09-17T09:03:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:13 smithi136 bash[24812]: cluster 2024-09-17T09:03:13.025095+0000 mgr.y (mgr.14532) 453 : cluster [DBG] pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T09:03:14.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:14 smithi078 bash[22670]: cluster 2024-09-17T09:03:14.052264+0000 osd.1 (osd.1) 5 : cluster [DBG] 224.1d deep-scrub starts 2024-09-17T09:03:14.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:14 smithi078 bash[22670]: cluster 2024-09-17T09:03:14.058338+0000 osd.1 (osd.1) 6 : cluster [DBG] 224.1d deep-scrub ok 2024-09-17T09:03:14.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:14 smithi078 bash[32124]: cluster 2024-09-17T09:03:14.052264+0000 osd.1 (osd.1) 5 : cluster [DBG] 224.1d deep-scrub starts 2024-09-17T09:03:14.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:14 smithi078 bash[32124]: cluster 2024-09-17T09:03:14.058338+0000 osd.1 (osd.1) 6 : cluster [DBG] 224.1d deep-scrub ok 2024-09-17T09:03:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:14 smithi136 bash[24812]: cluster 2024-09-17T09:03:14.052264+0000 osd.1 (osd.1) 5 : cluster [DBG] 224.1d deep-scrub starts 2024-09-17T09:03:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:14 smithi136 bash[24812]: cluster 2024-09-17T09:03:14.058338+0000 osd.1 (osd.1) 6 : cluster [DBG] 224.1d deep-scrub ok 2024-09-17T09:03:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:15 smithi078 bash[22670]: cluster 2024-09-17T09:03:15.025865+0000 mgr.y (mgr.14532) 454 : cluster [DBG] pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 887 B/s rd, 887 B/s wr, 2 op/s 2024-09-17T09:03:15.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:15 smithi078 bash[32124]: cluster 2024-09-17T09:03:15.025865+0000 mgr.y (mgr.14532) 454 : cluster [DBG] pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 887 B/s rd, 887 B/s wr, 2 op/s 2024-09-17T09:03:15.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:15 smithi136 bash[24812]: cluster 2024-09-17T09:03:15.025865+0000 mgr.y (mgr.14532) 454 : cluster [DBG] pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 887 B/s rd, 887 B/s wr, 2 op/s 2024-09-17T09:03:18.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:18 smithi078 bash[22670]: cluster 2024-09-17T09:03:17.026726+0000 mgr.y (mgr.14532) 455 : cluster [DBG] pgmap v690: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 756 B/s rd, 756 B/s wr, 2 op/s 2024-09-17T09:03:18.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:03:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:03:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:03:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:18 smithi078 bash[32124]: cluster 2024-09-17T09:03:17.026726+0000 mgr.y (mgr.14532) 455 : cluster [DBG] pgmap v690: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 756 B/s rd, 756 B/s wr, 2 op/s 2024-09-17T09:03:18.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:18 smithi136 bash[24812]: cluster 2024-09-17T09:03:17.026726+0000 mgr.y (mgr.14532) 455 : cluster [DBG] pgmap v690: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 756 B/s rd, 756 B/s wr, 2 op/s 2024-09-17T09:03:20.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:03:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:03:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:20 smithi078 bash[22670]: cluster 2024-09-17T09:03:19.028999+0000 mgr.y (mgr.14532) 456 : cluster [DBG] pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-17T09:03:20.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:20 smithi078 bash[32124]: cluster 2024-09-17T09:03:19.028999+0000 mgr.y (mgr.14532) 456 : cluster [DBG] pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-17T09:03:20.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:20 smithi136 bash[24812]: cluster 2024-09-17T09:03:19.028999+0000 mgr.y (mgr.14532) 456 : cluster [DBG] pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-17T09:03:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:21 smithi078 bash[22670]: audit 2024-09-17T09:03:19.720453+0000 mgr.y (mgr.14532) 457 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:21.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:21 smithi078 bash[32124]: audit 2024-09-17T09:03:19.720453+0000 mgr.y (mgr.14532) 457 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:21.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:21 smithi136 bash[24812]: audit 2024-09-17T09:03:19.720453+0000 mgr.y (mgr.14532) 457 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:22.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:22 smithi078 bash[32124]: cluster 2024-09-17T09:03:21.029856+0000 mgr.y (mgr.14532) 458 : cluster [DBG] pgmap v692: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 526 B/s wr, 2 op/s 2024-09-17T09:03:22.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:22 smithi078 bash[22670]: cluster 2024-09-17T09:03:21.029856+0000 mgr.y (mgr.14532) 458 : cluster [DBG] pgmap v692: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 526 B/s wr, 2 op/s 2024-09-17T09:03:22.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:22 smithi136 bash[24812]: cluster 2024-09-17T09:03:21.029856+0000 mgr.y (mgr.14532) 458 : cluster [DBG] pgmap v692: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 526 B/s wr, 2 op/s 2024-09-17T09:03:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:24 smithi078 bash[32124]: cluster 2024-09-17T09:03:23.032116+0000 mgr.y (mgr.14532) 459 : cluster [DBG] pgmap v693: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 477 B/s wr, 2 op/s 2024-09-17T09:03:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:24 smithi078 bash[22670]: cluster 2024-09-17T09:03:23.032116+0000 mgr.y (mgr.14532) 459 : cluster [DBG] pgmap v693: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 477 B/s wr, 2 op/s 2024-09-17T09:03:24.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:24 smithi136 bash[24812]: cluster 2024-09-17T09:03:23.032116+0000 mgr.y (mgr.14532) 459 : cluster [DBG] pgmap v693: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 477 B/s wr, 2 op/s 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:24.518969+0000 mon.a (mon.0) 2787 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:24.884440+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:24.891658+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:25.046349+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:25.047697+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:25.048712+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:25.049711+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[22670]: audit 2024-09-17T09:03:25.057152+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:24.518969+0000 mon.a (mon.0) 2787 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:24.884440+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:24.891658+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:25.046349+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:25.047697+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:25.048712+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:25.049711+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:25 smithi078 bash[32124]: audit 2024-09-17T09:03:25.057152+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:24.518969+0000 mon.a (mon.0) 2787 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:24.884440+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:24.891658+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:25.046349+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:25.047697+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:25.048712+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:25.049711+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:25.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:25 smithi136 bash[24812]: audit 2024-09-17T09:03:25.057152+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:26.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: cluster 2024-09-17T09:03:25.033023+0000 mgr.y (mgr.14532) 460 : cluster [DBG] pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:26.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: cephadm 2024-09-17T09:03:25.050480+0000 mgr.y (mgr.14532) 461 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 3292M 2024-09-17T09:03:26.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.306832+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.308238+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.309462+0000 mon.a (mon.0) 2797 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.310597+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.317211+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:26.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.318639+0000 mon.a (mon.0) 2800 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:03:26.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.319520+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:03:26.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.327028+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:26.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:26 smithi136 bash[24812]: audit 2024-09-17T09:03:25.809003+0000 mon.a (mon.0) 2803 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: cluster 2024-09-17T09:03:25.033023+0000 mgr.y (mgr.14532) 460 : cluster [DBG] pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: cephadm 2024-09-17T09:03:25.050480+0000 mgr.y (mgr.14532) 461 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 3292M 2024-09-17T09:03:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.306832+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.308238+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.309462+0000 mon.a (mon.0) 2797 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.310597+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.317211+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.318639+0000 mon.a (mon.0) 2800 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.319520+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.327028+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[22670]: audit 2024-09-17T09:03:25.809003+0000 mon.a (mon.0) 2803 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: cluster 2024-09-17T09:03:25.033023+0000 mgr.y (mgr.14532) 460 : cluster [DBG] pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: cephadm 2024-09-17T09:03:25.050480+0000 mgr.y (mgr.14532) 461 : cephadm [INF] Adjusting osd_memory_target on smithi136 to 3292M 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.306832+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.308238+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.309462+0000 mon.a (mon.0) 2797 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.310597+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:03:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.317211+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.318639+0000 mon.a (mon.0) 2800 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:03:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.319520+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:03:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.327028+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:03:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:26 smithi078 bash[32124]: audit 2024-09-17T09:03:25.809003+0000 mon.a (mon.0) 2803 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:27.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:27 smithi136 bash[24812]: cephadm 2024-09-17T09:03:25.311489+0000 mgr.y (mgr.14532) 462 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 3292M 2024-09-17T09:03:27.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:27 smithi078 bash[22670]: cephadm 2024-09-17T09:03:25.311489+0000 mgr.y (mgr.14532) 462 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 3292M 2024-09-17T09:03:27.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:27 smithi078 bash[32124]: cephadm 2024-09-17T09:03:25.311489+0000 mgr.y (mgr.14532) 462 : cephadm [INF] Adjusting osd_memory_target on smithi078 to 3292M 2024-09-17T09:03:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:28 smithi078 bash[22670]: cluster 2024-09-17T09:03:27.033861+0000 mgr.y (mgr.14532) 463 : cluster [DBG] pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:28.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:03:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:03:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:03:28.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:28 smithi078 bash[32124]: cluster 2024-09-17T09:03:27.033861+0000 mgr.y (mgr.14532) 463 : cluster [DBG] pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:28.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:28 smithi136 bash[24812]: cluster 2024-09-17T09:03:27.033861+0000 mgr.y (mgr.14532) 463 : cluster [DBG] pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:30.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:03:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:03:30.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:30 smithi136 bash[24812]: cluster 2024-09-17T09:03:29.036077+0000 mgr.y (mgr.14532) 464 : cluster [DBG] pgmap v696: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:30 smithi078 bash[22670]: cluster 2024-09-17T09:03:29.036077+0000 mgr.y (mgr.14532) 464 : cluster [DBG] pgmap v696: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:30.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:30 smithi078 bash[32124]: cluster 2024-09-17T09:03:29.036077+0000 mgr.y (mgr.14532) 464 : cluster [DBG] pgmap v696: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:31.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:31 smithi136 bash[24812]: audit 2024-09-17T09:03:29.727800+0000 mgr.y (mgr.14532) 465 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:31 smithi078 bash[22670]: audit 2024-09-17T09:03:29.727800+0000 mgr.y (mgr.14532) 465 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:31 smithi078 bash[32124]: audit 2024-09-17T09:03:29.727800+0000 mgr.y (mgr.14532) 465 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:32.390 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:32 smithi078 bash[22670]: cluster 2024-09-17T09:03:31.036862+0000 mgr.y (mgr.14532) 466 : cluster [DBG] pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:32.391 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:32 smithi078 bash[32124]: cluster 2024-09-17T09:03:31.036862+0000 mgr.y (mgr.14532) 466 : cluster [DBG] pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:32.391 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:32 smithi136 bash[24812]: cluster 2024-09-17T09:03:31.036862+0000 mgr.y (mgr.14532) 466 : cluster [DBG] pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:03:32.788 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:03:32 smithi136 bash[28251]: debug 2024-09-17T09:03:32.393+0000 7fade47cd640 -1 snap_mapper.add_oid found existing snaps mapped on 224:b991b622:test-rados-api-smithi078-64852-80::foo:2, removing 2024-09-17T09:03:32.788 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:03:32 smithi136 bash[33798]: debug 2024-09-17T09:03:32.393+0000 7fcd5ad10640 -1 snap_mapper.add_oid found existing snaps mapped on 224:b991b622:test-rados-api-smithi078-64852-80::foo:2, removing 2024-09-17T09:03:32.852 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:03:32 smithi078 bash[40803]: debug 2024-09-17T09:03:32.390+0000 7f39e50b4640 -1 snap_mapper.add_oid found existing snaps mapped on 224:b991b622:test-rados-api-smithi078-64852-80::foo:2, removing 2024-09-17T09:03:33.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:33 smithi078 bash[22670]: audit 2024-09-17T09:03:32.395850+0000 mon.a (mon.0) 2804 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:33.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:33 smithi078 bash[22670]: audit 2024-09-17T09:03:32.396652+0000 mon.a (mon.0) 2805 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-79"}]: dispatch 2024-09-17T09:03:33.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:33 smithi078 bash[22670]: cluster 2024-09-17T09:03:33.038993+0000 mgr.y (mgr.14532) 467 : cluster [DBG] pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-17T09:03:33.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:33 smithi078 bash[32124]: audit 2024-09-17T09:03:32.395850+0000 mon.a (mon.0) 2804 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:33 smithi078 bash[32124]: audit 2024-09-17T09:03:32.396652+0000 mon.a (mon.0) 2805 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-79"}]: dispatch 2024-09-17T09:03:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:33 smithi078 bash[32124]: cluster 2024-09-17T09:03:33.038993+0000 mgr.y (mgr.14532) 467 : cluster [DBG] pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-17T09:03:34.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:33 smithi136 bash[24812]: audit 2024-09-17T09:03:32.395850+0000 mon.a (mon.0) 2804 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:34.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:33 smithi136 bash[24812]: audit 2024-09-17T09:03:32.396652+0000 mon.a (mon.0) 2805 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-79"}]: dispatch 2024-09-17T09:03:34.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:33 smithi136 bash[24812]: cluster 2024-09-17T09:03:33.038993+0000 mgr.y (mgr.14532) 467 : cluster [DBG] pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-17T09:03:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:34 smithi078 bash[32124]: cluster 2024-09-17T09:03:33.149538+0000 mon.a (mon.0) 2806 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2024-09-17T09:03:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:34 smithi078 bash[32124]: cluster 2024-09-17T09:03:34.153327+0000 mon.a (mon.0) 2807 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2024-09-17T09:03:34.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:34 smithi078 bash[32124]: audit 2024-09-17T09:03:34.170355+0000 mon.a (mon.0) 2808 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:34.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:34 smithi078 bash[22670]: cluster 2024-09-17T09:03:33.149538+0000 mon.a (mon.0) 2806 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2024-09-17T09:03:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:34 smithi078 bash[22670]: cluster 2024-09-17T09:03:34.153327+0000 mon.a (mon.0) 2807 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2024-09-17T09:03:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:34 smithi078 bash[22670]: audit 2024-09-17T09:03:34.170355+0000 mon.a (mon.0) 2808 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:35.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:34 smithi136 bash[24812]: cluster 2024-09-17T09:03:33.149538+0000 mon.a (mon.0) 2806 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2024-09-17T09:03:35.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:34 smithi136 bash[24812]: cluster 2024-09-17T09:03:34.153327+0000 mon.a (mon.0) 2807 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2024-09-17T09:03:35.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:34 smithi136 bash[24812]: audit 2024-09-17T09:03:34.170355+0000 mon.a (mon.0) 2808 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:36.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:35 smithi136 bash[24812]: cluster 2024-09-17T09:03:35.039824+0000 mgr.y (mgr.14532) 468 : cluster [DBG] pgmap v701: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-17T09:03:36.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:35 smithi136 bash[24812]: audit 2024-09-17T09:03:35.156884+0000 mon.a (mon.0) 2809 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:36.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:35 smithi136 bash[24812]: cluster 2024-09-17T09:03:35.157106+0000 mon.a (mon.0) 2810 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2024-09-17T09:03:36.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:35 smithi136 bash[24812]: audit 2024-09-17T09:03:35.165323+0000 mon.a (mon.0) 2811 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:36.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:35 smithi136 bash[24812]: audit 2024-09-17T09:03:35.179388+0000 mon.a (mon.0) 2812 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:36.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[32124]: cluster 2024-09-17T09:03:35.039824+0000 mgr.y (mgr.14532) 468 : cluster [DBG] pgmap v701: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-17T09:03:36.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[32124]: audit 2024-09-17T09:03:35.156884+0000 mon.a (mon.0) 2809 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:36.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[32124]: cluster 2024-09-17T09:03:35.157106+0000 mon.a (mon.0) 2810 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2024-09-17T09:03:36.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[32124]: audit 2024-09-17T09:03:35.165323+0000 mon.a (mon.0) 2811 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:36.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[32124]: audit 2024-09-17T09:03:35.179388+0000 mon.a (mon.0) 2812 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:36.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[22670]: cluster 2024-09-17T09:03:35.039824+0000 mgr.y (mgr.14532) 468 : cluster [DBG] pgmap v701: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-17T09:03:36.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[22670]: audit 2024-09-17T09:03:35.156884+0000 mon.a (mon.0) 2809 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:36.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[22670]: cluster 2024-09-17T09:03:35.157106+0000 mon.a (mon.0) 2810 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2024-09-17T09:03:36.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[22670]: audit 2024-09-17T09:03:35.165323+0000 mon.a (mon.0) 2811 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:36.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:35 smithi078 bash[22670]: audit 2024-09-17T09:03:35.179388+0000 mon.a (mon.0) 2812 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:37.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:36 smithi136 bash[24812]: cluster 2024-09-17T09:03:35.599107+0000 mon.a (mon.0) 2813 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:37.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:36 smithi136 bash[24812]: audit 2024-09-17T09:03:36.160860+0000 mon.a (mon.0) 2814 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:37.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:36 smithi136 bash[24812]: cluster 2024-09-17T09:03:36.161125+0000 mon.a (mon.0) 2815 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2024-09-17T09:03:37.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:36 smithi136 bash[24812]: audit 2024-09-17T09:03:36.162337+0000 mon.a (mon.0) 2816 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:37.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[32124]: cluster 2024-09-17T09:03:35.599107+0000 mon.a (mon.0) 2813 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:37.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[32124]: audit 2024-09-17T09:03:36.160860+0000 mon.a (mon.0) 2814 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:37.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[32124]: cluster 2024-09-17T09:03:36.161125+0000 mon.a (mon.0) 2815 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2024-09-17T09:03:37.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[32124]: audit 2024-09-17T09:03:36.162337+0000 mon.a (mon.0) 2816 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:37.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[22670]: cluster 2024-09-17T09:03:35.599107+0000 mon.a (mon.0) 2813 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[22670]: audit 2024-09-17T09:03:36.160860+0000 mon.a (mon.0) 2814 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[22670]: cluster 2024-09-17T09:03:36.161125+0000 mon.a (mon.0) 2815 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2024-09-17T09:03:37.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:36 smithi078 bash[22670]: audit 2024-09-17T09:03:36.162337+0000 mon.a (mon.0) 2816 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:37.918 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[32124]: cluster 2024-09-17T09:03:37.040588+0000 mgr.y (mgr.14532) 469 : cluster [DBG] pgmap v704: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:37.918 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[32124]: audit 2024-09-17T09:03:37.161874+0000 mon.a (mon.0) 2817 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:37.918 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[32124]: cluster 2024-09-17T09:03:37.162039+0000 mon.a (mon.0) 2818 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2024-09-17T09:03:37.918 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[32124]: audit 2024-09-17T09:03:37.165026+0000 mon.a (mon.0) 2819 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:37.918 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[22670]: cluster 2024-09-17T09:03:37.040588+0000 mgr.y (mgr.14532) 469 : cluster [DBG] pgmap v704: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:37.918 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[22670]: audit 2024-09-17T09:03:37.161874+0000 mon.a (mon.0) 2817 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:37.919 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[22670]: cluster 2024-09-17T09:03:37.162039+0000 mon.a (mon.0) 2818 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2024-09-17T09:03:37.919 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[22670]: audit 2024-09-17T09:03:37.165026+0000 mon.a (mon.0) 2819 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:38.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:37 smithi136 bash[24812]: cluster 2024-09-17T09:03:37.040588+0000 mgr.y (mgr.14532) 469 : cluster [DBG] pgmap v704: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:38.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:37 smithi136 bash[24812]: audit 2024-09-17T09:03:37.161874+0000 mon.a (mon.0) 2817 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:38.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:37 smithi136 bash[24812]: cluster 2024-09-17T09:03:37.162039+0000 mon.a (mon.0) 2818 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2024-09-17T09:03:38.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:37 smithi136 bash[24812]: audit 2024-09-17T09:03:37.165026+0000 mon.a (mon.0) 2819 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:03:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:03:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:03:39.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:39 smithi136 bash[24812]: audit 2024-09-17T09:03:38.164166+0000 mon.a (mon.0) 2820 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:39.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:39 smithi136 bash[24812]: cluster 2024-09-17T09:03:38.164372+0000 mon.a (mon.0) 2821 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2024-09-17T09:03:39.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:39 smithi136 bash[24812]: audit 2024-09-17T09:03:38.165675+0000 mon.a (mon.0) 2822 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:39.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:39 smithi136 bash[24812]: cluster 2024-09-17T09:03:39.041378+0000 mgr.y (mgr.14532) 470 : cluster [DBG] pgmap v707: 228 pgs: 228 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[22670]: audit 2024-09-17T09:03:38.164166+0000 mon.a (mon.0) 2820 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[22670]: cluster 2024-09-17T09:03:38.164372+0000 mon.a (mon.0) 2821 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2024-09-17T09:03:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[22670]: audit 2024-09-17T09:03:38.165675+0000 mon.a (mon.0) 2822 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[22670]: cluster 2024-09-17T09:03:39.041378+0000 mgr.y (mgr.14532) 470 : cluster [DBG] pgmap v707: 228 pgs: 228 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:39.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[32124]: audit 2024-09-17T09:03:38.164166+0000 mon.a (mon.0) 2820 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[32124]: cluster 2024-09-17T09:03:38.164372+0000 mon.a (mon.0) 2821 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2024-09-17T09:03:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[32124]: audit 2024-09-17T09:03:38.165675+0000 mon.a (mon.0) 2822 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:39.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:39 smithi078 bash[32124]: cluster 2024-09-17T09:03:39.041378+0000 mgr.y (mgr.14532) 470 : cluster [DBG] pgmap v707: 228 pgs: 228 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:40.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:03:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:03:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[22670]: audit 2024-09-17T09:03:39.174463+0000 mon.a (mon.0) 2823 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[22670]: cluster 2024-09-17T09:03:39.174650+0000 mon.a (mon.0) 2824 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2024-09-17T09:03:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[22670]: audit 2024-09-17T09:03:39.226214+0000 mon.a (mon.0) 2825 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-17T09:03:40.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[22670]: audit 2024-09-17T09:03:39.738942+0000 mgr.y (mgr.14532) 471 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[32124]: audit 2024-09-17T09:03:39.174463+0000 mon.a (mon.0) 2823 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[32124]: cluster 2024-09-17T09:03:39.174650+0000 mon.a (mon.0) 2824 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2024-09-17T09:03:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[32124]: audit 2024-09-17T09:03:39.226214+0000 mon.a (mon.0) 2825 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-17T09:03:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:40 smithi078 bash[32124]: audit 2024-09-17T09:03:39.738942+0000 mgr.y (mgr.14532) 471 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:40.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:40 smithi136 bash[24812]: audit 2024-09-17T09:03:39.174463+0000 mon.a (mon.0) 2823 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:40.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:40 smithi136 bash[24812]: cluster 2024-09-17T09:03:39.174650+0000 mon.a (mon.0) 2824 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2024-09-17T09:03:40.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:40 smithi136 bash[24812]: audit 2024-09-17T09:03:39.226214+0000 mon.a (mon.0) 2825 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-17T09:03:40.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:40 smithi136 bash[24812]: audit 2024-09-17T09:03:39.738942+0000 mgr.y (mgr.14532) 471 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:41.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:41 smithi136 bash[24812]: audit 2024-09-17T09:03:40.175703+0000 mon.a (mon.0) 2826 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-17T09:03:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:41 smithi136 bash[24812]: cluster 2024-09-17T09:03:40.175895+0000 mon.a (mon.0) 2827 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2024-09-17T09:03:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:41 smithi136 bash[24812]: audit 2024-09-17T09:03:40.209857+0000 mon.a (mon.0) 2828 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-17T09:03:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:41 smithi136 bash[24812]: audit 2024-09-17T09:03:40.837590+0000 mon.a (mon.0) 2829 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:41 smithi136 bash[24812]: cluster 2024-09-17T09:03:41.042169+0000 mgr.y (mgr.14532) 472 : cluster [DBG] pgmap v710: 228 pgs: 228 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[22670]: audit 2024-09-17T09:03:40.175703+0000 mon.a (mon.0) 2826 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-17T09:03:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[22670]: cluster 2024-09-17T09:03:40.175895+0000 mon.a (mon.0) 2827 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2024-09-17T09:03:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[22670]: audit 2024-09-17T09:03:40.209857+0000 mon.a (mon.0) 2828 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-17T09:03:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[22670]: audit 2024-09-17T09:03:40.837590+0000 mon.a (mon.0) 2829 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[22670]: cluster 2024-09-17T09:03:41.042169+0000 mgr.y (mgr.14532) 472 : cluster [DBG] pgmap v710: 228 pgs: 228 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[32124]: audit 2024-09-17T09:03:40.175703+0000 mon.a (mon.0) 2826 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-17T09:03:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[32124]: cluster 2024-09-17T09:03:40.175895+0000 mon.a (mon.0) 2827 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2024-09-17T09:03:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[32124]: audit 2024-09-17T09:03:40.209857+0000 mon.a (mon.0) 2828 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-17T09:03:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[32124]: audit 2024-09-17T09:03:40.837590+0000 mon.a (mon.0) 2829 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:41.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:41 smithi078 bash[32124]: cluster 2024-09-17T09:03:41.042169+0000 mgr.y (mgr.14532) 472 : cluster [DBG] pgmap v710: 228 pgs: 228 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:42.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:42 smithi136 bash[24812]: audit 2024-09-17T09:03:41.200667+0000 mon.a (mon.0) 2830 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-17T09:03:42.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:42 smithi136 bash[24812]: cluster 2024-09-17T09:03:41.200828+0000 mon.a (mon.0) 2831 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2024-09-17T09:03:42.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:42 smithi136 bash[24812]: audit 2024-09-17T09:03:41.223690+0000 mon.a (mon.0) 2832 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:42 smithi078 bash[22670]: audit 2024-09-17T09:03:41.200667+0000 mon.a (mon.0) 2830 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-17T09:03:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:42 smithi078 bash[22670]: cluster 2024-09-17T09:03:41.200828+0000 mon.a (mon.0) 2831 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2024-09-17T09:03:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:42 smithi078 bash[22670]: audit 2024-09-17T09:03:41.223690+0000 mon.a (mon.0) 2832 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:42.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:42 smithi078 bash[32124]: audit 2024-09-17T09:03:41.200667+0000 mon.a (mon.0) 2830 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-17T09:03:42.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:42 smithi078 bash[32124]: cluster 2024-09-17T09:03:41.200828+0000 mon.a (mon.0) 2831 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2024-09-17T09:03:42.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:42 smithi078 bash[32124]: audit 2024-09-17T09:03:41.223690+0000 mon.a (mon.0) 2832 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:43.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:43 smithi136 bash[24812]: audit 2024-09-17T09:03:42.198885+0000 mon.a (mon.0) 2833 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:43.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:43 smithi136 bash[24812]: cluster 2024-09-17T09:03:42.199067+0000 mon.a (mon.0) 2834 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2024-09-17T09:03:43.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:43 smithi136 bash[24812]: audit 2024-09-17T09:03:42.265127+0000 mon.a (mon.0) 2835 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:43.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:43 smithi136 bash[24812]: audit 2024-09-17T09:03:42.265978+0000 mon.a (mon.0) 2836 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-81"}]: dispatch 2024-09-17T09:03:43.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:43 smithi136 bash[24812]: cluster 2024-09-17T09:03:42.659227+0000 mon.a (mon.0) 2837 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:43.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:43 smithi136 bash[24812]: cluster 2024-09-17T09:03:43.044368+0000 mgr.y (mgr.14532) 473 : cluster [DBG] pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 15 KiB/s wr, 40 op/s 2024-09-17T09:03:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[22670]: audit 2024-09-17T09:03:42.198885+0000 mon.a (mon.0) 2833 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[22670]: cluster 2024-09-17T09:03:42.199067+0000 mon.a (mon.0) 2834 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2024-09-17T09:03:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[22670]: audit 2024-09-17T09:03:42.265127+0000 mon.a (mon.0) 2835 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[22670]: audit 2024-09-17T09:03:42.265978+0000 mon.a (mon.0) 2836 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-81"}]: dispatch 2024-09-17T09:03:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[22670]: cluster 2024-09-17T09:03:42.659227+0000 mon.a (mon.0) 2837 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:43.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[22670]: cluster 2024-09-17T09:03:43.044368+0000 mgr.y (mgr.14532) 473 : cluster [DBG] pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 15 KiB/s wr, 40 op/s 2024-09-17T09:03:43.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[32124]: audit 2024-09-17T09:03:42.198885+0000 mon.a (mon.0) 2833 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:43.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[32124]: cluster 2024-09-17T09:03:42.199067+0000 mon.a (mon.0) 2834 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2024-09-17T09:03:43.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[32124]: audit 2024-09-17T09:03:42.265127+0000 mon.a (mon.0) 2835 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:43.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[32124]: audit 2024-09-17T09:03:42.265978+0000 mon.a (mon.0) 2836 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-81"}]: dispatch 2024-09-17T09:03:43.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[32124]: cluster 2024-09-17T09:03:42.659227+0000 mon.a (mon.0) 2837 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:03:43.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:43 smithi078 bash[32124]: cluster 2024-09-17T09:03:43.044368+0000 mgr.y (mgr.14532) 473 : cluster [DBG] pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 15 KiB/s wr, 40 op/s 2024-09-17T09:03:44.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:44 smithi136 bash[24812]: cluster 2024-09-17T09:03:43.226129+0000 mon.a (mon.0) 2838 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2024-09-17T09:03:44.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:44 smithi078 bash[22670]: cluster 2024-09-17T09:03:43.226129+0000 mon.a (mon.0) 2838 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2024-09-17T09:03:44.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:44 smithi078 bash[32124]: cluster 2024-09-17T09:03:43.226129+0000 mon.a (mon.0) 2838 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2024-09-17T09:03:45.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:45 smithi136 bash[24812]: cluster 2024-09-17T09:03:44.244221+0000 mon.a (mon.0) 2839 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2024-09-17T09:03:45.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:45 smithi136 bash[24812]: audit 2024-09-17T09:03:44.249732+0000 mon.a (mon.0) 2840 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:45.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:45 smithi136 bash[24812]: cluster 2024-09-17T09:03:45.045366+0000 mgr.y (mgr.14532) 474 : cluster [DBG] pgmap v716: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-17T09:03:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:45 smithi078 bash[22670]: cluster 2024-09-17T09:03:44.244221+0000 mon.a (mon.0) 2839 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2024-09-17T09:03:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:45 smithi078 bash[22670]: audit 2024-09-17T09:03:44.249732+0000 mon.a (mon.0) 2840 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:45 smithi078 bash[22670]: cluster 2024-09-17T09:03:45.045366+0000 mgr.y (mgr.14532) 474 : cluster [DBG] pgmap v716: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-17T09:03:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:45 smithi078 bash[32124]: cluster 2024-09-17T09:03:44.244221+0000 mon.a (mon.0) 2839 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2024-09-17T09:03:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:45 smithi078 bash[32124]: audit 2024-09-17T09:03:44.249732+0000 mon.a (mon.0) 2840 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:45 smithi078 bash[32124]: cluster 2024-09-17T09:03:45.045366+0000 mgr.y (mgr.14532) 474 : cluster [DBG] pgmap v716: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-17T09:03:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:46 smithi136 bash[24812]: audit 2024-09-17T09:03:45.252407+0000 mon.a (mon.0) 2841 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:46 smithi136 bash[24812]: cluster 2024-09-17T09:03:45.253034+0000 mon.a (mon.0) 2842 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2024-09-17T09:03:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:46 smithi136 bash[24812]: audit 2024-09-17T09:03:45.256800+0000 mon.a (mon.0) 2843 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:46 smithi136 bash[24812]: audit 2024-09-17T09:03:45.273749+0000 mon.a (mon.0) 2844 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[32124]: audit 2024-09-17T09:03:45.252407+0000 mon.a (mon.0) 2841 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[32124]: cluster 2024-09-17T09:03:45.253034+0000 mon.a (mon.0) 2842 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2024-09-17T09:03:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[32124]: audit 2024-09-17T09:03:45.256800+0000 mon.a (mon.0) 2843 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[32124]: audit 2024-09-17T09:03:45.273749+0000 mon.a (mon.0) 2844 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[22670]: audit 2024-09-17T09:03:45.252407+0000 mon.a (mon.0) 2841 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[22670]: cluster 2024-09-17T09:03:45.253034+0000 mon.a (mon.0) 2842 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2024-09-17T09:03:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[22670]: audit 2024-09-17T09:03:45.256800+0000 mon.a (mon.0) 2843 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:46 smithi078 bash[22670]: audit 2024-09-17T09:03:45.273749+0000 mon.a (mon.0) 2844 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:47.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:47 smithi136 bash[24812]: audit 2024-09-17T09:03:46.259349+0000 mon.a (mon.0) 2845 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:47.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:47 smithi136 bash[24812]: cluster 2024-09-17T09:03:46.259535+0000 mon.a (mon.0) 2846 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2024-09-17T09:03:47.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:47 smithi136 bash[24812]: audit 2024-09-17T09:03:46.263472+0000 mon.a (mon.0) 2847 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:47.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:47 smithi136 bash[24812]: cluster 2024-09-17T09:03:47.046228+0000 mgr.y (mgr.14532) 475 : cluster [DBG] pgmap v719: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[22670]: audit 2024-09-17T09:03:46.259349+0000 mon.a (mon.0) 2845 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[22670]: cluster 2024-09-17T09:03:46.259535+0000 mon.a (mon.0) 2846 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2024-09-17T09:03:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[22670]: audit 2024-09-17T09:03:46.263472+0000 mon.a (mon.0) 2847 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[22670]: cluster 2024-09-17T09:03:47.046228+0000 mgr.y (mgr.14532) 475 : cluster [DBG] pgmap v719: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[32124]: audit 2024-09-17T09:03:46.259349+0000 mon.a (mon.0) 2845 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[32124]: cluster 2024-09-17T09:03:46.259535+0000 mon.a (mon.0) 2846 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2024-09-17T09:03:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[32124]: audit 2024-09-17T09:03:46.263472+0000 mon.a (mon.0) 2847 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[32124]: cluster 2024-09-17T09:03:47.046228+0000 mgr.y (mgr.14532) 475 : cluster [DBG] pgmap v719: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:48.279 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:03:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:03:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:03:48.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:48 smithi136 bash[24812]: audit 2024-09-17T09:03:47.272790+0000 mon.a (mon.0) 2848 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:48.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:48 smithi136 bash[24812]: cluster 2024-09-17T09:03:47.272977+0000 mon.a (mon.0) 2849 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2024-09-17T09:03:48.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:48 smithi136 bash[24812]: audit 2024-09-17T09:03:47.276369+0000 mon.a (mon.0) 2850 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:48.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:48 smithi078 bash[22670]: audit 2024-09-17T09:03:47.272790+0000 mon.a (mon.0) 2848 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:48.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:48 smithi078 bash[22670]: cluster 2024-09-17T09:03:47.272977+0000 mon.a (mon.0) 2849 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2024-09-17T09:03:48.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:48 smithi078 bash[22670]: audit 2024-09-17T09:03:47.276369+0000 mon.a (mon.0) 2850 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:48.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:48 smithi078 bash[32124]: audit 2024-09-17T09:03:47.272790+0000 mon.a (mon.0) 2848 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:48.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:48 smithi078 bash[32124]: cluster 2024-09-17T09:03:47.272977+0000 mon.a (mon.0) 2849 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2024-09-17T09:03:48.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:48 smithi078 bash[32124]: audit 2024-09-17T09:03:47.276369+0000 mon.a (mon.0) 2850 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:49.292 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[52309]: logger=cleanup t=2024-09-17T09:03:49.02477462Z level=info msg="Completed cleanup jobs" duration=344.016877ms 2024-09-17T09:03:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[22670]: audit 2024-09-17T09:03:48.276663+0000 mon.a (mon.0) 2851 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[22670]: cluster 2024-09-17T09:03:48.277108+0000 mon.a (mon.0) 2852 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2024-09-17T09:03:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[22670]: audit 2024-09-17T09:03:48.278833+0000 mon.a (mon.0) 2853 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[22670]: cluster 2024-09-17T09:03:49.047084+0000 mgr.y (mgr.14532) 476 : cluster [DBG] pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[22670]: audit 2024-09-17T09:03:49.277166+0000 mon.a (mon.0) 2854 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[22670]: cluster 2024-09-17T09:03:49.277398+0000 mon.a (mon.0) 2855 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2024-09-17T09:03:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[32124]: audit 2024-09-17T09:03:48.276663+0000 mon.a (mon.0) 2851 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[32124]: cluster 2024-09-17T09:03:48.277108+0000 mon.a (mon.0) 2852 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2024-09-17T09:03:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[32124]: audit 2024-09-17T09:03:48.278833+0000 mon.a (mon.0) 2853 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[32124]: cluster 2024-09-17T09:03:49.047084+0000 mgr.y (mgr.14532) 476 : cluster [DBG] pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[32124]: audit 2024-09-17T09:03:49.277166+0000 mon.a (mon.0) 2854 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:49 smithi078 bash[32124]: cluster 2024-09-17T09:03:49.277398+0000 mon.a (mon.0) 2855 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2024-09-17T09:03:49.748 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[24812]: audit 2024-09-17T09:03:48.276663+0000 mon.a (mon.0) 2851 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:49.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[24812]: cluster 2024-09-17T09:03:48.277108+0000 mon.a (mon.0) 2852 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2024-09-17T09:03:49.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[24812]: audit 2024-09-17T09:03:48.278833+0000 mon.a (mon.0) 2853 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:49.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[24812]: cluster 2024-09-17T09:03:49.047084+0000 mgr.y (mgr.14532) 476 : cluster [DBG] pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:49.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[24812]: audit 2024-09-17T09:03:49.277166+0000 mon.a (mon.0) 2854 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:49.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[24812]: cluster 2024-09-17T09:03:49.277398+0000 mon.a (mon.0) 2855 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2024-09-17T09:03:50.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:03:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:03:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:50 smithi078 bash[32124]: audit 2024-09-17T09:03:49.750460+0000 mgr.y (mgr.14532) 477 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:50 smithi078 bash[22670]: audit 2024-09-17T09:03:49.750460+0000 mgr.y (mgr.14532) 477 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:50.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:50 smithi136 bash[24812]: audit 2024-09-17T09:03:49.750460+0000 mgr.y (mgr.14532) 477 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:03:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:51 smithi078 bash[22670]: cluster 2024-09-17T09:03:50.315863+0000 mon.a (mon.0) 2856 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2024-09-17T09:03:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:51 smithi078 bash[22670]: cluster 2024-09-17T09:03:51.047843+0000 mgr.y (mgr.14532) 478 : cluster [DBG] pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:51 smithi078 bash[32124]: cluster 2024-09-17T09:03:50.315863+0000 mon.a (mon.0) 2856 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2024-09-17T09:03:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:51 smithi078 bash[32124]: cluster 2024-09-17T09:03:51.047843+0000 mgr.y (mgr.14532) 478 : cluster [DBG] pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:51.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:51 smithi136 bash[24812]: cluster 2024-09-17T09:03:50.315863+0000 mon.a (mon.0) 2856 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2024-09-17T09:03:51.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:51 smithi136 bash[24812]: cluster 2024-09-17T09:03:51.047843+0000 mgr.y (mgr.14532) 478 : cluster [DBG] pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:52 smithi078 bash[22670]: cluster 2024-09-17T09:03:51.329915+0000 mon.a (mon.0) 2857 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2024-09-17T09:03:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:52 smithi078 bash[22670]: audit 2024-09-17T09:03:51.399212+0000 mon.a (mon.0) 2858 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:52 smithi078 bash[22670]: audit 2024-09-17T09:03:51.400165+0000 mon.a (mon.0) 2859 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-83"}]: dispatch 2024-09-17T09:03:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:52 smithi078 bash[32124]: cluster 2024-09-17T09:03:51.329915+0000 mon.a (mon.0) 2857 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2024-09-17T09:03:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:52 smithi078 bash[32124]: audit 2024-09-17T09:03:51.399212+0000 mon.a (mon.0) 2858 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:52 smithi078 bash[32124]: audit 2024-09-17T09:03:51.400165+0000 mon.a (mon.0) 2859 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-83"}]: dispatch 2024-09-17T09:03:52.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:52 smithi136 bash[24812]: cluster 2024-09-17T09:03:51.329915+0000 mon.a (mon.0) 2857 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2024-09-17T09:03:52.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:52 smithi136 bash[24812]: audit 2024-09-17T09:03:51.399212+0000 mon.a (mon.0) 2858 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:52.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:52 smithi136 bash[24812]: audit 2024-09-17T09:03:51.400165+0000 mon.a (mon.0) 2859 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-83"}]: dispatch 2024-09-17T09:03:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:53 smithi078 bash[22670]: cluster 2024-09-17T09:03:52.333258+0000 mon.a (mon.0) 2860 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2024-09-17T09:03:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:53 smithi078 bash[22670]: cluster 2024-09-17T09:03:53.049840+0000 mgr.y (mgr.14532) 479 : cluster [DBG] pgmap v728: 196 pgs: 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T09:03:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:53 smithi078 bash[32124]: cluster 2024-09-17T09:03:52.333258+0000 mon.a (mon.0) 2860 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2024-09-17T09:03:53.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:53 smithi078 bash[32124]: cluster 2024-09-17T09:03:53.049840+0000 mgr.y (mgr.14532) 479 : cluster [DBG] pgmap v728: 196 pgs: 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T09:03:53.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:53 smithi136 bash[24812]: cluster 2024-09-17T09:03:52.333258+0000 mon.a (mon.0) 2860 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2024-09-17T09:03:53.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:53 smithi136 bash[24812]: cluster 2024-09-17T09:03:53.049840+0000 mgr.y (mgr.14532) 479 : cluster [DBG] pgmap v728: 196 pgs: 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T09:03:54.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:54 smithi136 bash[24812]: cluster 2024-09-17T09:03:53.341988+0000 mon.a (mon.0) 2861 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2024-09-17T09:03:54.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:54 smithi136 bash[24812]: audit 2024-09-17T09:03:53.348732+0000 mon.a (mon.0) 2862 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:54.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:54 smithi136 bash[24812]: audit 2024-09-17T09:03:54.339899+0000 mon.a (mon.0) 2863 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:54.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:54 smithi136 bash[24812]: cluster 2024-09-17T09:03:54.340332+0000 mon.a (mon.0) 2864 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2024-09-17T09:03:54.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[22670]: cluster 2024-09-17T09:03:53.341988+0000 mon.a (mon.0) 2861 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2024-09-17T09:03:54.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[22670]: audit 2024-09-17T09:03:53.348732+0000 mon.a (mon.0) 2862 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:54.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[22670]: audit 2024-09-17T09:03:54.339899+0000 mon.a (mon.0) 2863 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:54.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[22670]: cluster 2024-09-17T09:03:54.340332+0000 mon.a (mon.0) 2864 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2024-09-17T09:03:54.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[32124]: cluster 2024-09-17T09:03:53.341988+0000 mon.a (mon.0) 2861 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2024-09-17T09:03:54.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[32124]: audit 2024-09-17T09:03:53.348732+0000 mon.a (mon.0) 2862 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:03:54.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[32124]: audit 2024-09-17T09:03:54.339899+0000 mon.a (mon.0) 2863 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:03:54.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:54 smithi078 bash[32124]: cluster 2024-09-17T09:03:54.340332+0000 mon.a (mon.0) 2864 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2024-09-17T09:03:55.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:55 smithi136 bash[24812]: audit 2024-09-17T09:03:54.344559+0000 mon.a (mon.0) 2865 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:55.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:55 smithi136 bash[24812]: audit 2024-09-17T09:03:54.371861+0000 mon.a (mon.0) 2866 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:55.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:55 smithi136 bash[24812]: cluster 2024-09-17T09:03:55.050702+0000 mgr.y (mgr.14532) 480 : cluster [DBG] pgmap v731: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T09:03:55.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:55 smithi136 bash[24812]: audit 2024-09-17T09:03:55.347614+0000 mon.a (mon.0) 2867 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:55.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:55 smithi136 bash[24812]: cluster 2024-09-17T09:03:55.347807+0000 mon.a (mon.0) 2868 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2024-09-17T09:03:55.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:55 smithi136 bash[24812]: audit 2024-09-17T09:03:55.350278+0000 mon.a (mon.0) 2869 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:55.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[22670]: audit 2024-09-17T09:03:54.344559+0000 mon.a (mon.0) 2865 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:55.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[22670]: audit 2024-09-17T09:03:54.371861+0000 mon.a (mon.0) 2866 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:55.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[22670]: cluster 2024-09-17T09:03:55.050702+0000 mgr.y (mgr.14532) 480 : cluster [DBG] pgmap v731: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T09:03:55.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[22670]: audit 2024-09-17T09:03:55.347614+0000 mon.a (mon.0) 2867 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[22670]: cluster 2024-09-17T09:03:55.347807+0000 mon.a (mon.0) 2868 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[22670]: audit 2024-09-17T09:03:55.350278+0000 mon.a (mon.0) 2869 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[32124]: audit 2024-09-17T09:03:54.344559+0000 mon.a (mon.0) 2865 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[32124]: audit 2024-09-17T09:03:54.371861+0000 mon.a (mon.0) 2866 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[32124]: cluster 2024-09-17T09:03:55.050702+0000 mgr.y (mgr.14532) 480 : cluster [DBG] pgmap v731: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[32124]: audit 2024-09-17T09:03:55.347614+0000 mon.a (mon.0) 2867 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[32124]: cluster 2024-09-17T09:03:55.347807+0000 mon.a (mon.0) 2868 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2024-09-17T09:03:55.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:55 smithi078 bash[32124]: audit 2024-09-17T09:03:55.350278+0000 mon.a (mon.0) 2869 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:03:56.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:56 smithi136 bash[24812]: audit 2024-09-17T09:03:55.866915+0000 mon.a (mon.0) 2870 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:56.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:56 smithi136 bash[24812]: audit 2024-09-17T09:03:56.348091+0000 mon.a (mon.0) 2871 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:56.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:56 smithi136 bash[24812]: cluster 2024-09-17T09:03:56.348278+0000 mon.a (mon.0) 2872 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-09-17T09:03:56.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:56 smithi136 bash[24812]: audit 2024-09-17T09:03:56.349772+0000 mon.a (mon.0) 2873 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:56.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[32124]: audit 2024-09-17T09:03:55.866915+0000 mon.a (mon.0) 2870 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:56.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[32124]: audit 2024-09-17T09:03:56.348091+0000 mon.a (mon.0) 2871 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:56.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[32124]: cluster 2024-09-17T09:03:56.348278+0000 mon.a (mon.0) 2872 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-09-17T09:03:56.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[32124]: audit 2024-09-17T09:03:56.349772+0000 mon.a (mon.0) 2873 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:56.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[22670]: audit 2024-09-17T09:03:55.866915+0000 mon.a (mon.0) 2870 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:03:56.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[22670]: audit 2024-09-17T09:03:56.348091+0000 mon.a (mon.0) 2871 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_tier","val": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:03:56.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[22670]: cluster 2024-09-17T09:03:56.348278+0000 mon.a (mon.0) 2872 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-09-17T09:03:56.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:56 smithi078 bash[22670]: audit 2024-09-17T09:03:56.349772+0000 mon.a (mon.0) 2873 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:03:57.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:57 smithi136 bash[24812]: cluster 2024-09-17T09:03:57.051432+0000 mgr.y (mgr.14532) 481 : cluster [DBG] pgmap v734: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:57.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:57 smithi136 bash[24812]: audit 2024-09-17T09:03:57.351105+0000 mon.a (mon.0) 2874 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:57.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:57 smithi136 bash[24812]: cluster 2024-09-17T09:03:57.351871+0000 mon.a (mon.0) 2875 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-09-17T09:03:57.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:57 smithi136 bash[24812]: audit 2024-09-17T09:03:57.352849+0000 mon.a (mon.0) 2876 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:57.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[22670]: cluster 2024-09-17T09:03:57.051432+0000 mgr.y (mgr.14532) 481 : cluster [DBG] pgmap v734: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[22670]: audit 2024-09-17T09:03:57.351105+0000 mon.a (mon.0) 2874 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[22670]: cluster 2024-09-17T09:03:57.351871+0000 mon.a (mon.0) 2875 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-09-17T09:03:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[22670]: audit 2024-09-17T09:03:57.352849+0000 mon.a (mon.0) 2876 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:57.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[32124]: cluster 2024-09-17T09:03:57.051432+0000 mgr.y (mgr.14532) 481 : cluster [DBG] pgmap v734: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:03:57.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[32124]: audit 2024-09-17T09:03:57.351105+0000 mon.a (mon.0) 2874 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:03:57.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[32124]: cluster 2024-09-17T09:03:57.351871+0000 mon.a (mon.0) 2875 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-09-17T09:03:57.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[32124]: audit 2024-09-17T09:03:57.352849+0000 mon.a (mon.0) 2876 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:03:58.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:03:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:03:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:03:59.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:59 smithi136 bash[24812]: audit 2024-09-17T09:03:58.352862+0000 mon.a (mon.0) 2877 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:59.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:59 smithi136 bash[24812]: cluster 2024-09-17T09:03:58.353033+0000 mon.a (mon.0) 2878 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-09-17T09:03:59.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:03:59 smithi136 bash[24812]: cluster 2024-09-17T09:03:59.052227+0000 mgr.y (mgr.14532) 482 : cluster [DBG] pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:59 smithi078 bash[22670]: audit 2024-09-17T09:03:58.352862+0000 mon.a (mon.0) 2877 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:59.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:59 smithi078 bash[22670]: cluster 2024-09-17T09:03:58.353033+0000 mon.a (mon.0) 2878 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-09-17T09:03:59.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:03:59 smithi078 bash[22670]: cluster 2024-09-17T09:03:59.052227+0000 mgr.y (mgr.14532) 482 : cluster [DBG] pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:03:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:59 smithi078 bash[32124]: audit 2024-09-17T09:03:58.352862+0000 mon.a (mon.0) 2877 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:03:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:59 smithi078 bash[32124]: cluster 2024-09-17T09:03:58.353033+0000 mon.a (mon.0) 2878 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-09-17T09:03:59.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:03:59 smithi078 bash[32124]: cluster 2024-09-17T09:03:59.052227+0000 mgr.y (mgr.14532) 482 : cluster [DBG] pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:00.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:03:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:04:00.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:00 smithi136 bash[24812]: cluster 2024-09-17T09:03:59.363582+0000 mon.a (mon.0) 2879 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-09-17T09:04:00.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:00 smithi136 bash[24812]: audit 2024-09-17T09:03:59.762093+0000 mgr.y (mgr.14532) 483 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:00.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:00 smithi078 bash[22670]: cluster 2024-09-17T09:03:59.363582+0000 mon.a (mon.0) 2879 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-09-17T09:04:00.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:00 smithi078 bash[22670]: audit 2024-09-17T09:03:59.762093+0000 mgr.y (mgr.14532) 483 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:00.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:00 smithi078 bash[32124]: cluster 2024-09-17T09:03:59.363582+0000 mon.a (mon.0) 2879 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-09-17T09:04:00.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:00 smithi078 bash[32124]: audit 2024-09-17T09:03:59.762093+0000 mgr.y (mgr.14532) 483 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:01.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:01 smithi136 bash[24812]: cluster 2024-09-17T09:04:00.364320+0000 mon.a (mon.0) 2880 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-09-17T09:04:01.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:01 smithi136 bash[24812]: audit 2024-09-17T09:04:00.439729+0000 mon.a (mon.0) 2881 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:01.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:01 smithi136 bash[24812]: audit 2024-09-17T09:04:00.440680+0000 mon.a (mon.0) 2882 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-85"}]: dispatch 2024-09-17T09:04:01.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:01 smithi136 bash[24812]: cluster 2024-09-17T09:04:01.053004+0000 mgr.y (mgr.14532) 484 : cluster [DBG] pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:01.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[32124]: cluster 2024-09-17T09:04:00.364320+0000 mon.a (mon.0) 2880 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-09-17T09:04:01.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[32124]: audit 2024-09-17T09:04:00.439729+0000 mon.a (mon.0) 2881 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:01.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[32124]: audit 2024-09-17T09:04:00.440680+0000 mon.a (mon.0) 2882 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-85"}]: dispatch 2024-09-17T09:04:01.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[32124]: cluster 2024-09-17T09:04:01.053004+0000 mgr.y (mgr.14532) 484 : cluster [DBG] pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:01.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[22670]: cluster 2024-09-17T09:04:00.364320+0000 mon.a (mon.0) 2880 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-09-17T09:04:01.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[22670]: audit 2024-09-17T09:04:00.439729+0000 mon.a (mon.0) 2881 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[22670]: audit 2024-09-17T09:04:00.440680+0000 mon.a (mon.0) 2882 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-85"}]: dispatch 2024-09-17T09:04:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:01 smithi078 bash[22670]: cluster 2024-09-17T09:04:01.053004+0000 mgr.y (mgr.14532) 484 : cluster [DBG] pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:02.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:02 smithi136 bash[24812]: cluster 2024-09-17T09:04:01.388763+0000 mon.a (mon.0) 2883 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-09-17T09:04:02.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:02 smithi078 bash[22670]: cluster 2024-09-17T09:04:01.388763+0000 mon.a (mon.0) 2883 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-09-17T09:04:02.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:02 smithi078 bash[32124]: cluster 2024-09-17T09:04:01.388763+0000 mon.a (mon.0) 2883 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-09-17T09:04:03.429 INFO:tasks.workunit.client.0.smithi078.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18107 ms) 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22944 ms) 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3036 ms) 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3005 ms) 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3021 ms) 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.430 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3046 ms) 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4076 ms) 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (39520 ms) 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16301 ms) 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.431 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4022 ms) 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3021 ms) 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25001 ms) 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (14987 ms) 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5079 ms) 2024-09-17T09:04:03.432 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4070 ms) 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: waiting for scrubs... 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: done waiting 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24902 ms) 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10079 ms) 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.433 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9105 ms) 2024-09-17T09:04:03.434 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-17T09:04:03.434 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:04:03.434 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9068 ms) 2024-09-17T09:04:03.434 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-17T09:04:03.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:03 smithi136 bash[24812]: cluster 2024-09-17T09:04:02.400637+0000 mon.a (mon.0) 2884 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-09-17T09:04:03.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:03 smithi136 bash[24812]: audit 2024-09-17T09:04:02.404307+0000 mon.a (mon.0) 2885 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:03.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:03 smithi136 bash[24812]: cluster 2024-09-17T09:04:03.055111+0000 mgr.y (mgr.14532) 485 : cluster [DBG] pgmap v743: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-09-17T09:04:03.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:03 smithi078 bash[22670]: cluster 2024-09-17T09:04:02.400637+0000 mon.a (mon.0) 2884 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-09-17T09:04:03.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:03 smithi078 bash[22670]: audit 2024-09-17T09:04:02.404307+0000 mon.a (mon.0) 2885 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:03.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:03 smithi078 bash[22670]: cluster 2024-09-17T09:04:03.055111+0000 mgr.y (mgr.14532) 485 : cluster [DBG] pgmap v743: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-09-17T09:04:03.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:03 smithi078 bash[32124]: cluster 2024-09-17T09:04:02.400637+0000 mon.a (mon.0) 2884 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-09-17T09:04:03.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:03 smithi078 bash[32124]: audit 2024-09-17T09:04:02.404307+0000 mon.a (mon.0) 2885 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:03.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:03 smithi078 bash[32124]: cluster 2024-09-17T09:04:03.055111+0000 mgr.y (mgr.14532) 485 : cluster [DBG] pgmap v743: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-09-17T09:04:04.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:04 smithi136 bash[24812]: cluster 2024-09-17T09:04:03.392703+0000 mon.a (mon.0) 2886 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:04.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:04 smithi136 bash[24812]: audit 2024-09-17T09:04:03.415827+0000 mon.a (mon.0) 2887 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:04.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:04 smithi136 bash[24812]: cluster 2024-09-17T09:04:03.416373+0000 mon.a (mon.0) 2888 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-09-17T09:04:04.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:04 smithi136 bash[24812]: audit 2024-09-17T09:04:03.419226+0000 mon.a (mon.0) 2889 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:04.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[22670]: cluster 2024-09-17T09:04:03.392703+0000 mon.a (mon.0) 2886 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:04.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[22670]: audit 2024-09-17T09:04:03.415827+0000 mon.a (mon.0) 2887 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:04.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[22670]: cluster 2024-09-17T09:04:03.416373+0000 mon.a (mon.0) 2888 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-09-17T09:04:04.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[22670]: audit 2024-09-17T09:04:03.419226+0000 mon.a (mon.0) 2889 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:04.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[32124]: cluster 2024-09-17T09:04:03.392703+0000 mon.a (mon.0) 2886 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:04.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[32124]: audit 2024-09-17T09:04:03.415827+0000 mon.a (mon.0) 2887 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:04.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[32124]: cluster 2024-09-17T09:04:03.416373+0000 mon.a (mon.0) 2888 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-09-17T09:04:04.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:04 smithi078 bash[32124]: audit 2024-09-17T09:04:03.419226+0000 mon.a (mon.0) 2889 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:05.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:05 smithi136 bash[24812]: cluster 2024-09-17T09:04:04.427142+0000 mon.a (mon.0) 2890 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-09-17T09:04:05.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:05 smithi136 bash[24812]: audit 2024-09-17T09:04:04.429736+0000 mon.a (mon.0) 2891 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:04:05.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:05 smithi136 bash[24812]: cluster 2024-09-17T09:04:05.055960+0000 mgr.y (mgr.14532) 486 : cluster [DBG] pgmap v746: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-09-17T09:04:05.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:05 smithi078 bash[32124]: cluster 2024-09-17T09:04:04.427142+0000 mon.a (mon.0) 2890 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-09-17T09:04:05.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:05 smithi078 bash[32124]: audit 2024-09-17T09:04:04.429736+0000 mon.a (mon.0) 2891 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:04:05.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:05 smithi078 bash[32124]: cluster 2024-09-17T09:04:05.055960+0000 mgr.y (mgr.14532) 486 : cluster [DBG] pgmap v746: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-09-17T09:04:05.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:05 smithi078 bash[22670]: cluster 2024-09-17T09:04:04.427142+0000 mon.a (mon.0) 2890 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-09-17T09:04:05.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:05 smithi078 bash[22670]: audit 2024-09-17T09:04:04.429736+0000 mon.a (mon.0) 2891 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:04:05.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:05 smithi078 bash[22670]: cluster 2024-09-17T09:04:05.055960+0000 mgr.y (mgr.14532) 486 : cluster [DBG] pgmap v746: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-09-17T09:04:06.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:06 smithi136 bash[24812]: audit 2024-09-17T09:04:05.438916+0000 mon.a (mon.0) 2892 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:04:06.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:06 smithi136 bash[24812]: cluster 2024-09-17T09:04:05.439419+0000 mon.a (mon.0) 2893 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-09-17T09:04:06.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:06 smithi136 bash[24812]: audit 2024-09-17T09:04:05.442061+0000 mon.a (mon.0) 2894 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_tier","val": "test-rados-api-smithi078-64852-89-test-flush"}]: dispatch 2024-09-17T09:04:06.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:06 smithi078 bash[32124]: audit 2024-09-17T09:04:05.438916+0000 mon.a (mon.0) 2892 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:04:06.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:06 smithi078 bash[32124]: cluster 2024-09-17T09:04:05.439419+0000 mon.a (mon.0) 2893 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-09-17T09:04:06.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:06 smithi078 bash[32124]: audit 2024-09-17T09:04:05.442061+0000 mon.a (mon.0) 2894 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_tier","val": "test-rados-api-smithi078-64852-89-test-flush"}]: dispatch 2024-09-17T09:04:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:06 smithi078 bash[22670]: audit 2024-09-17T09:04:05.438916+0000 mon.a (mon.0) 2892 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:04:06.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:06 smithi078 bash[22670]: cluster 2024-09-17T09:04:05.439419+0000 mon.a (mon.0) 2893 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-09-17T09:04:06.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:06 smithi078 bash[22670]: audit 2024-09-17T09:04:05.442061+0000 mon.a (mon.0) 2894 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_tier","val": "test-rados-api-smithi078-64852-89-test-flush"}]: dispatch 2024-09-17T09:04:07.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:07 smithi136 bash[24812]: audit 2024-09-17T09:04:06.440493+0000 mon.a (mon.0) 2895 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_tier","val": "test-rados-api-smithi078-64852-89-test-flush"}]': finished 2024-09-17T09:04:07.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:07 smithi136 bash[24812]: cluster 2024-09-17T09:04:06.440774+0000 mon.a (mon.0) 2896 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-09-17T09:04:07.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:07 smithi136 bash[24812]: audit 2024-09-17T09:04:06.442813+0000 mon.a (mon.0) 2897 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:04:07.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:07 smithi136 bash[24812]: cluster 2024-09-17T09:04:07.056842+0000 mgr.y (mgr.14532) 487 : cluster [DBG] pgmap v749: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:07.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[22670]: audit 2024-09-17T09:04:06.440493+0000 mon.a (mon.0) 2895 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_tier","val": "test-rados-api-smithi078-64852-89-test-flush"}]': finished 2024-09-17T09:04:07.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[22670]: cluster 2024-09-17T09:04:06.440774+0000 mon.a (mon.0) 2896 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-09-17T09:04:07.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[22670]: audit 2024-09-17T09:04:06.442813+0000 mon.a (mon.0) 2897 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:04:07.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[22670]: cluster 2024-09-17T09:04:07.056842+0000 mgr.y (mgr.14532) 487 : cluster [DBG] pgmap v749: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[32124]: audit 2024-09-17T09:04:06.440493+0000 mon.a (mon.0) 2895 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_tier","val": "test-rados-api-smithi078-64852-89-test-flush"}]': finished 2024-09-17T09:04:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[32124]: cluster 2024-09-17T09:04:06.440774+0000 mon.a (mon.0) 2896 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-09-17T09:04:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[32124]: audit 2024-09-17T09:04:06.442813+0000 mon.a (mon.0) 2897 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:04:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[32124]: cluster 2024-09-17T09:04:07.056842+0000 mgr.y (mgr.14532) 487 : cluster [DBG] pgmap v749: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:08.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:04:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:04:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:04:08.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:08 smithi136 bash[24812]: audit 2024-09-17T09:04:07.448399+0000 mon.a (mon.0) 2898 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:04:08.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:08 smithi136 bash[24812]: cluster 2024-09-17T09:04:07.448581+0000 mon.a (mon.0) 2899 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-09-17T09:04:08.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:08 smithi136 bash[24812]: audit 2024-09-17T09:04:07.451773+0000 mon.a (mon.0) 2900 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:04:08.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:08 smithi136 bash[24812]: audit 2024-09-17T09:04:08.448297+0000 mon.a (mon.0) 2901 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:04:08.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:08 smithi136 bash[24812]: cluster 2024-09-17T09:04:08.448476+0000 mon.a (mon.0) 2902 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-09-17T09:04:08.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[22670]: audit 2024-09-17T09:04:07.448399+0000 mon.a (mon.0) 2898 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:04:08.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[22670]: cluster 2024-09-17T09:04:07.448581+0000 mon.a (mon.0) 2899 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-09-17T09:04:08.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[22670]: audit 2024-09-17T09:04:07.451773+0000 mon.a (mon.0) 2900 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:04:08.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[22670]: audit 2024-09-17T09:04:08.448297+0000 mon.a (mon.0) 2901 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:04:08.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[22670]: cluster 2024-09-17T09:04:08.448476+0000 mon.a (mon.0) 2902 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-09-17T09:04:08.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[32124]: audit 2024-09-17T09:04:07.448399+0000 mon.a (mon.0) 2898 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:04:08.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[32124]: cluster 2024-09-17T09:04:07.448581+0000 mon.a (mon.0) 2899 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-09-17T09:04:08.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[32124]: audit 2024-09-17T09:04:07.451773+0000 mon.a (mon.0) 2900 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:04:08.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[32124]: audit 2024-09-17T09:04:08.448297+0000 mon.a (mon.0) 2901 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:04:08.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:08 smithi078 bash[32124]: cluster 2024-09-17T09:04:08.448476+0000 mon.a (mon.0) 2902 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-09-17T09:04:09.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:09 smithi136 bash[24812]: cluster 2024-09-17T09:04:09.057705+0000 mgr.y (mgr.14532) 488 : cluster [DBG] pgmap v752: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:09.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:09 smithi136 bash[24812]: cluster 2024-09-17T09:04:09.449580+0000 mon.a (mon.0) 2903 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-09-17T09:04:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:09 smithi078 bash[22670]: cluster 2024-09-17T09:04:09.057705+0000 mgr.y (mgr.14532) 488 : cluster [DBG] pgmap v752: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:09.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:09 smithi078 bash[22670]: cluster 2024-09-17T09:04:09.449580+0000 mon.a (mon.0) 2903 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-09-17T09:04:09.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:09 smithi078 bash[32124]: cluster 2024-09-17T09:04:09.057705+0000 mgr.y (mgr.14532) 488 : cluster [DBG] pgmap v752: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:09.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:09 smithi078 bash[32124]: cluster 2024-09-17T09:04:09.449580+0000 mon.a (mon.0) 2903 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-09-17T09:04:10.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:04:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:04:11.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:10 smithi136 bash[24812]: audit 2024-09-17T09:04:09.528112+0000 mon.a (mon.0) 2904 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:11.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:10 smithi136 bash[24812]: audit 2024-09-17T09:04:09.528929+0000 mon.a (mon.0) 2905 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-87"}]: dispatch 2024-09-17T09:04:11.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:10 smithi136 bash[24812]: audit 2024-09-17T09:04:09.773715+0000 mgr.y (mgr.14532) 489 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:10 smithi078 bash[32124]: audit 2024-09-17T09:04:09.528112+0000 mon.a (mon.0) 2904 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:10 smithi078 bash[32124]: audit 2024-09-17T09:04:09.528929+0000 mon.a (mon.0) 2905 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-87"}]: dispatch 2024-09-17T09:04:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:10 smithi078 bash[32124]: audit 2024-09-17T09:04:09.773715+0000 mgr.y (mgr.14532) 489 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:10 smithi078 bash[22670]: audit 2024-09-17T09:04:09.528112+0000 mon.a (mon.0) 2904 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:10 smithi078 bash[22670]: audit 2024-09-17T09:04:09.528929+0000 mon.a (mon.0) 2905 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-87"}]: dispatch 2024-09-17T09:04:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:10 smithi078 bash[22670]: audit 2024-09-17T09:04:09.773715+0000 mgr.y (mgr.14532) 489 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:12.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:11 smithi136 bash[24812]: cluster 2024-09-17T09:04:10.489823+0000 mon.a (mon.0) 2906 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-09-17T09:04:12.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:11 smithi136 bash[24812]: audit 2024-09-17T09:04:10.943385+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:12.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:11 smithi136 bash[24812]: cluster 2024-09-17T09:04:11.058440+0000 mgr.y (mgr.14532) 490 : cluster [DBG] pgmap v755: 196 pgs: 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:12.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:11 smithi136 bash[24812]: cluster 2024-09-17T09:04:11.494835+0000 mon.a (mon.0) 2908 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-09-17T09:04:12.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:11 smithi136 bash[24812]: audit 2024-09-17T09:04:11.498609+0000 mon.a (mon.0) 2909 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[22670]: cluster 2024-09-17T09:04:10.489823+0000 mon.a (mon.0) 2906 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-09-17T09:04:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[22670]: audit 2024-09-17T09:04:10.943385+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[22670]: cluster 2024-09-17T09:04:11.058440+0000 mgr.y (mgr.14532) 490 : cluster [DBG] pgmap v755: 196 pgs: 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[22670]: cluster 2024-09-17T09:04:11.494835+0000 mon.a (mon.0) 2908 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-09-17T09:04:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[22670]: audit 2024-09-17T09:04:11.498609+0000 mon.a (mon.0) 2909 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[32124]: cluster 2024-09-17T09:04:10.489823+0000 mon.a (mon.0) 2906 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-09-17T09:04:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[32124]: audit 2024-09-17T09:04:10.943385+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[32124]: cluster 2024-09-17T09:04:11.058440+0000 mgr.y (mgr.14532) 490 : cluster [DBG] pgmap v755: 196 pgs: 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:04:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[32124]: cluster 2024-09-17T09:04:11.494835+0000 mon.a (mon.0) 2908 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-09-17T09:04:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:11 smithi078 bash[32124]: audit 2024-09-17T09:04:11.498609+0000 mon.a (mon.0) 2909 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:13.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:12 smithi136 bash[24812]: cluster 2024-09-17T09:04:11.943880+0000 mon.a (mon.0) 2910 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:13.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:12 smithi136 bash[24812]: audit 2024-09-17T09:04:12.497712+0000 mon.a (mon.0) 2911 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:13.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:12 smithi136 bash[24812]: cluster 2024-09-17T09:04:12.498242+0000 mon.a (mon.0) 2912 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-09-17T09:04:13.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:12 smithi136 bash[24812]: audit 2024-09-17T09:04:12.505328+0000 mon.a (mon.0) 2913 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:13.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:12 smithi136 bash[24812]: audit 2024-09-17T09:04:12.522966+0000 mon.a (mon.0) 2914 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:04:13.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[32124]: cluster 2024-09-17T09:04:11.943880+0000 mon.a (mon.0) 2910 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:13.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[32124]: audit 2024-09-17T09:04:12.497712+0000 mon.a (mon.0) 2911 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:13.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[32124]: cluster 2024-09-17T09:04:12.498242+0000 mon.a (mon.0) 2912 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-09-17T09:04:13.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[32124]: audit 2024-09-17T09:04:12.505328+0000 mon.a (mon.0) 2913 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:13.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[32124]: audit 2024-09-17T09:04:12.522966+0000 mon.a (mon.0) 2914 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:04:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[22670]: cluster 2024-09-17T09:04:11.943880+0000 mon.a (mon.0) 2910 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[22670]: audit 2024-09-17T09:04:12.497712+0000 mon.a (mon.0) 2911 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[22670]: cluster 2024-09-17T09:04:12.498242+0000 mon.a (mon.0) 2912 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-09-17T09:04:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[22670]: audit 2024-09-17T09:04:12.505328+0000 mon.a (mon.0) 2913 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:12 smithi078 bash[22670]: audit 2024-09-17T09:04:12.522966+0000 mon.a (mon.0) 2914 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:04:14.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:13 smithi136 bash[24812]: cluster 2024-09-17T09:04:13.060591+0000 mgr.y (mgr.14532) 491 : cluster [DBG] pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:04:14.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:13 smithi136 bash[24812]: audit 2024-09-17T09:04:13.500832+0000 mon.a (mon.0) 2915 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:04:14.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:13 smithi136 bash[24812]: cluster 2024-09-17T09:04:13.500976+0000 mon.a (mon.0) 2916 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-09-17T09:04:14.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:13 smithi078 bash[32124]: cluster 2024-09-17T09:04:13.060591+0000 mgr.y (mgr.14532) 491 : cluster [DBG] pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:04:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:13 smithi078 bash[32124]: audit 2024-09-17T09:04:13.500832+0000 mon.a (mon.0) 2915 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:04:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:13 smithi078 bash[32124]: cluster 2024-09-17T09:04:13.500976+0000 mon.a (mon.0) 2916 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-09-17T09:04:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:13 smithi078 bash[22670]: cluster 2024-09-17T09:04:13.060591+0000 mgr.y (mgr.14532) 491 : cluster [DBG] pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:04:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:13 smithi078 bash[22670]: audit 2024-09-17T09:04:13.500832+0000 mon.a (mon.0) 2915 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:04:14.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:13 smithi078 bash[22670]: cluster 2024-09-17T09:04:13.500976+0000 mon.a (mon.0) 2916 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-09-17T09:04:15.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:15 smithi136 bash[24812]: cluster 2024-09-17T09:04:14.501833+0000 mon.a (mon.0) 2917 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-09-17T09:04:15.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:15 smithi136 bash[24812]: cluster 2024-09-17T09:04:15.061437+0000 mgr.y (mgr.14532) 492 : cluster [DBG] pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:04:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:15 smithi078 bash[32124]: cluster 2024-09-17T09:04:14.501833+0000 mon.a (mon.0) 2917 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-09-17T09:04:15.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:15 smithi078 bash[32124]: cluster 2024-09-17T09:04:15.061437+0000 mgr.y (mgr.14532) 492 : cluster [DBG] pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:04:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:15 smithi078 bash[22670]: cluster 2024-09-17T09:04:14.501833+0000 mon.a (mon.0) 2917 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-09-17T09:04:15.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:15 smithi078 bash[22670]: cluster 2024-09-17T09:04:15.061437+0000 mgr.y (mgr.14532) 492 : cluster [DBG] pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:04:17.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:16 smithi136 bash[24812]: cluster 2024-09-17T09:04:15.515453+0000 mon.a (mon.0) 2918 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-09-17T09:04:17.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:16 smithi136 bash[24812]: audit 2024-09-17T09:04:15.594454+0000 mon.a (mon.0) 2919 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:17.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:16 smithi136 bash[24812]: audit 2024-09-17T09:04:15.595325+0000 mon.a (mon.0) 2920 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-90"}]: dispatch 2024-09-17T09:04:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:16 smithi078 bash[22670]: cluster 2024-09-17T09:04:15.515453+0000 mon.a (mon.0) 2918 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-09-17T09:04:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:16 smithi078 bash[22670]: audit 2024-09-17T09:04:15.594454+0000 mon.a (mon.0) 2919 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:16 smithi078 bash[22670]: audit 2024-09-17T09:04:15.595325+0000 mon.a (mon.0) 2920 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-90"}]: dispatch 2024-09-17T09:04:17.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:16 smithi078 bash[32124]: cluster 2024-09-17T09:04:15.515453+0000 mon.a (mon.0) 2918 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-09-17T09:04:17.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:16 smithi078 bash[32124]: audit 2024-09-17T09:04:15.594454+0000 mon.a (mon.0) 2919 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:17.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:16 smithi078 bash[32124]: audit 2024-09-17T09:04:15.595325+0000 mon.a (mon.0) 2920 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-90"}]: dispatch 2024-09-17T09:04:18.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:17 smithi136 bash[24812]: cluster 2024-09-17T09:04:16.525271+0000 mon.a (mon.0) 2921 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-09-17T09:04:18.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:17 smithi136 bash[24812]: cluster 2024-09-17T09:04:17.062185+0000 mgr.y (mgr.14532) 493 : cluster [DBG] pgmap v764: 196 pgs: 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:18.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:17 smithi136 bash[24812]: cluster 2024-09-17T09:04:17.520799+0000 mon.a (mon.0) 2922 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-09-17T09:04:18.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:17 smithi136 bash[24812]: audit 2024-09-17T09:04:17.541290+0000 mon.a (mon.0) 2923 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:18.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:04:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:04:18.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[22670]: cluster 2024-09-17T09:04:16.525271+0000 mon.a (mon.0) 2921 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-09-17T09:04:18.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[22670]: cluster 2024-09-17T09:04:17.062185+0000 mgr.y (mgr.14532) 493 : cluster [DBG] pgmap v764: 196 pgs: 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:18.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[22670]: cluster 2024-09-17T09:04:17.520799+0000 mon.a (mon.0) 2922 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-09-17T09:04:18.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[22670]: audit 2024-09-17T09:04:17.541290+0000 mon.a (mon.0) 2923 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[32124]: cluster 2024-09-17T09:04:16.525271+0000 mon.a (mon.0) 2921 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-09-17T09:04:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[32124]: cluster 2024-09-17T09:04:17.062185+0000 mgr.y (mgr.14532) 493 : cluster [DBG] pgmap v764: 196 pgs: 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[32124]: cluster 2024-09-17T09:04:17.520799+0000 mon.a (mon.0) 2922 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-09-17T09:04:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:17 smithi078 bash[32124]: audit 2024-09-17T09:04:17.541290+0000 mon.a (mon.0) 2923 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:19.782 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:19 smithi136 bash[24812]: audit 2024-09-17T09:04:18.522673+0000 mon.a (mon.0) 2924 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:19.783 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:19 smithi136 bash[24812]: cluster 2024-09-17T09:04:18.522955+0000 mon.a (mon.0) 2925 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-09-17T09:04:19.783 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:19 smithi136 bash[24812]: audit 2024-09-17T09:04:18.528827+0000 mon.a (mon.0) 2926 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:19.783 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:19 smithi136 bash[24812]: cluster 2024-09-17T09:04:19.063030+0000 mgr.y (mgr.14532) 494 : cluster [DBG] pgmap v767: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:04:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[32124]: audit 2024-09-17T09:04:18.522673+0000 mon.a (mon.0) 2924 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[32124]: cluster 2024-09-17T09:04:18.522955+0000 mon.a (mon.0) 2925 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-09-17T09:04:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[32124]: audit 2024-09-17T09:04:18.528827+0000 mon.a (mon.0) 2926 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[32124]: cluster 2024-09-17T09:04:19.063030+0000 mgr.y (mgr.14532) 494 : cluster [DBG] pgmap v767: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:04:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[22670]: audit 2024-09-17T09:04:18.522673+0000 mon.a (mon.0) 2924 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[22670]: cluster 2024-09-17T09:04:18.522955+0000 mon.a (mon.0) 2925 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-09-17T09:04:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[22670]: audit 2024-09-17T09:04:18.528827+0000 mon.a (mon.0) 2926 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:19 smithi078 bash[22670]: cluster 2024-09-17T09:04:19.063030+0000 mgr.y (mgr.14532) 494 : cluster [DBG] pgmap v767: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:04:20.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:04:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:04:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:20 smithi078 bash[32124]: cluster 2024-09-17T09:04:19.534001+0000 mon.a (mon.0) 2927 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-09-17T09:04:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:20 smithi078 bash[32124]: audit 2024-09-17T09:04:19.784319+0000 mgr.y (mgr.14532) 495 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:20 smithi078 bash[22670]: cluster 2024-09-17T09:04:19.534001+0000 mon.a (mon.0) 2927 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-09-17T09:04:20.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:20 smithi078 bash[22670]: audit 2024-09-17T09:04:19.784319+0000 mgr.y (mgr.14532) 495 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:21.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:20 smithi136 bash[24812]: cluster 2024-09-17T09:04:19.534001+0000 mon.a (mon.0) 2927 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-09-17T09:04:21.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:20 smithi136 bash[24812]: audit 2024-09-17T09:04:19.784319+0000 mgr.y (mgr.14532) 495 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:21.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[22670]: cluster 2024-09-17T09:04:20.534396+0000 mon.a (mon.0) 2928 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-09-17T09:04:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[22670]: audit 2024-09-17T09:04:20.611744+0000 mon.a (mon.0) 2929 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[22670]: audit 2024-09-17T09:04:20.612630+0000 mon.a (mon.0) 2930 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-92"}]: dispatch 2024-09-17T09:04:21.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[22670]: cluster 2024-09-17T09:04:21.063834+0000 mgr.y (mgr.14532) 496 : cluster [DBG] pgmap v770: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:04:21.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[32124]: cluster 2024-09-17T09:04:20.534396+0000 mon.a (mon.0) 2928 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-09-17T09:04:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[32124]: audit 2024-09-17T09:04:20.611744+0000 mon.a (mon.0) 2929 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[32124]: audit 2024-09-17T09:04:20.612630+0000 mon.a (mon.0) 2930 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-92"}]: dispatch 2024-09-17T09:04:21.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:21 smithi078 bash[32124]: cluster 2024-09-17T09:04:21.063834+0000 mgr.y (mgr.14532) 496 : cluster [DBG] pgmap v770: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:04:22.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:21 smithi136 bash[24812]: cluster 2024-09-17T09:04:20.534396+0000 mon.a (mon.0) 2928 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-09-17T09:04:22.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:21 smithi136 bash[24812]: audit 2024-09-17T09:04:20.611744+0000 mon.a (mon.0) 2929 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:22.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:21 smithi136 bash[24812]: audit 2024-09-17T09:04:20.612630+0000 mon.a (mon.0) 2930 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-92"}]: dispatch 2024-09-17T09:04:22.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:21 smithi136 bash[24812]: cluster 2024-09-17T09:04:21.063834+0000 mgr.y (mgr.14532) 496 : cluster [DBG] pgmap v770: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-17T09:04:22.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:22 smithi078 bash[22670]: cluster 2024-09-17T09:04:21.559403+0000 mon.a (mon.0) 2931 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-09-17T09:04:22.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:22 smithi078 bash[32124]: cluster 2024-09-17T09:04:21.559403+0000 mon.a (mon.0) 2931 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-09-17T09:04:23.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:22 smithi136 bash[24812]: cluster 2024-09-17T09:04:21.559403+0000 mon.a (mon.0) 2931 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-09-17T09:04:24.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:23 smithi136 bash[24812]: cluster 2024-09-17T09:04:22.564725+0000 mon.a (mon.0) 2932 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-09-17T09:04:24.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:23 smithi136 bash[24812]: audit 2024-09-17T09:04:22.567925+0000 mon.a (mon.0) 2933 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:24.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:23 smithi136 bash[24812]: cluster 2024-09-17T09:04:23.065867+0000 mgr.y (mgr.14532) 497 : cluster [DBG] pgmap v773: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:04:24.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:23 smithi078 bash[22670]: cluster 2024-09-17T09:04:22.564725+0000 mon.a (mon.0) 2932 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-09-17T09:04:24.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:23 smithi078 bash[22670]: audit 2024-09-17T09:04:22.567925+0000 mon.a (mon.0) 2933 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:24.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:23 smithi078 bash[22670]: cluster 2024-09-17T09:04:23.065867+0000 mgr.y (mgr.14532) 497 : cluster [DBG] pgmap v773: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:04:24.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:23 smithi078 bash[32124]: cluster 2024-09-17T09:04:22.564725+0000 mon.a (mon.0) 2932 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-09-17T09:04:24.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:23 smithi078 bash[32124]: audit 2024-09-17T09:04:22.567925+0000 mon.a (mon.0) 2933 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:24.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:23 smithi078 bash[32124]: cluster 2024-09-17T09:04:23.065867+0000 mgr.y (mgr.14532) 497 : cluster [DBG] pgmap v773: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:04:25.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:24 smithi136 bash[24812]: audit 2024-09-17T09:04:23.563913+0000 mon.a (mon.0) 2934 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:25.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:24 smithi136 bash[24812]: cluster 2024-09-17T09:04:23.564531+0000 mon.a (mon.0) 2935 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-09-17T09:04:25.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:24 smithi136 bash[24812]: cluster 2024-09-17T09:04:23.571038+0000 mon.a (mon.0) 2936 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:25.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:24 smithi136 bash[24812]: audit 2024-09-17T09:04:23.574451+0000 mon.a (mon.0) 2937 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:25.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:24 smithi136 bash[24812]: cluster 2024-09-17T09:04:24.598192+0000 mon.a (mon.0) 2938 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-09-17T09:04:25.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[32124]: audit 2024-09-17T09:04:23.563913+0000 mon.a (mon.0) 2934 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:25.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[32124]: cluster 2024-09-17T09:04:23.564531+0000 mon.a (mon.0) 2935 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-09-17T09:04:25.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[32124]: cluster 2024-09-17T09:04:23.571038+0000 mon.a (mon.0) 2936 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:25.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[32124]: audit 2024-09-17T09:04:23.574451+0000 mon.a (mon.0) 2937 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:25.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[32124]: cluster 2024-09-17T09:04:24.598192+0000 mon.a (mon.0) 2938 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-09-17T09:04:25.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[22670]: audit 2024-09-17T09:04:23.563913+0000 mon.a (mon.0) 2934 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:25.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[22670]: cluster 2024-09-17T09:04:23.564531+0000 mon.a (mon.0) 2935 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-09-17T09:04:25.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[22670]: cluster 2024-09-17T09:04:23.571038+0000 mon.a (mon.0) 2936 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:25.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[22670]: audit 2024-09-17T09:04:23.574451+0000 mon.a (mon.0) 2937 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:25.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:24 smithi078 bash[22670]: cluster 2024-09-17T09:04:24.598192+0000 mon.a (mon.0) 2938 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-09-17T09:04:26.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:25 smithi136 bash[24812]: cluster 2024-09-17T09:04:25.066864+0000 mgr.y (mgr.14532) 498 : cluster [DBG] pgmap v776: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:04:26.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:25 smithi136 bash[24812]: audit 2024-09-17T09:04:25.407257+0000 mon.a (mon.0) 2939 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:04:26.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:25 smithi136 bash[24812]: cluster 2024-09-17T09:04:25.603006+0000 mon.a (mon.0) 2940 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-09-17T09:04:26.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:25 smithi078 bash[22670]: cluster 2024-09-17T09:04:25.066864+0000 mgr.y (mgr.14532) 498 : cluster [DBG] pgmap v776: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:04:26.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:25 smithi078 bash[22670]: audit 2024-09-17T09:04:25.407257+0000 mon.a (mon.0) 2939 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:04:26.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:25 smithi078 bash[22670]: cluster 2024-09-17T09:04:25.603006+0000 mon.a (mon.0) 2940 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-09-17T09:04:26.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:25 smithi078 bash[32124]: cluster 2024-09-17T09:04:25.066864+0000 mgr.y (mgr.14532) 498 : cluster [DBG] pgmap v776: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:04:26.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:25 smithi078 bash[32124]: audit 2024-09-17T09:04:25.407257+0000 mon.a (mon.0) 2939 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:04:26.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:25 smithi078 bash[32124]: cluster 2024-09-17T09:04:25.603006+0000 mon.a (mon.0) 2940 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-09-17T09:04:27.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:26 smithi136 bash[24812]: audit 2024-09-17T09:04:25.781935+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:27.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:26 smithi136 bash[24812]: audit 2024-09-17T09:04:25.792199+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:27.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:26 smithi136 bash[24812]: audit 2024-09-17T09:04:25.981073+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:27.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:26 smithi078 bash[22670]: audit 2024-09-17T09:04:25.781935+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:27.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:26 smithi078 bash[22670]: audit 2024-09-17T09:04:25.792199+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:27.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:26 smithi078 bash[22670]: audit 2024-09-17T09:04:25.981073+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:27.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:26 smithi078 bash[32124]: audit 2024-09-17T09:04:25.781935+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:27.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:26 smithi078 bash[32124]: audit 2024-09-17T09:04:25.792199+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:27.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:26 smithi078 bash[32124]: audit 2024-09-17T09:04:25.981073+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:28.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:27 smithi078 bash[22670]: cluster 2024-09-17T09:04:27.067646+0000 mgr.y (mgr.14532) 499 : cluster [DBG] pgmap v778: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 680 B/s wr, 2 op/s 2024-09-17T09:04:28.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:04:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:04:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:04:28.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:27 smithi078 bash[32124]: cluster 2024-09-17T09:04:27.067646+0000 mgr.y (mgr.14532) 499 : cluster [DBG] pgmap v778: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 680 B/s wr, 2 op/s 2024-09-17T09:04:28.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:27 smithi136 bash[24812]: cluster 2024-09-17T09:04:27.067646+0000 mgr.y (mgr.14532) 499 : cluster [DBG] pgmap v778: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 680 B/s wr, 2 op/s 2024-09-17T09:04:30.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:04:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:04:30.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:30 smithi136 bash[24812]: cluster 2024-09-17T09:04:29.069899+0000 mgr.y (mgr.14532) 500 : cluster [DBG] pgmap v779: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-17T09:04:30.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:30 smithi078 bash[32124]: cluster 2024-09-17T09:04:29.069899+0000 mgr.y (mgr.14532) 500 : cluster [DBG] pgmap v779: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-17T09:04:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:30 smithi078 bash[22670]: cluster 2024-09-17T09:04:29.069899+0000 mgr.y (mgr.14532) 500 : cluster [DBG] pgmap v779: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-17T09:04:31.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:31 smithi136 bash[24812]: audit 2024-09-17T09:04:29.795840+0000 mgr.y (mgr.14532) 501 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:31.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:31 smithi136 bash[24812]: audit 2024-09-17T09:04:30.837735+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:31.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:31 smithi136 bash[24812]: audit 2024-09-17T09:04:30.842628+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:31 smithi078 bash[32124]: audit 2024-09-17T09:04:29.795840+0000 mgr.y (mgr.14532) 501 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:31 smithi078 bash[32124]: audit 2024-09-17T09:04:30.837735+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:31 smithi078 bash[32124]: audit 2024-09-17T09:04:30.842628+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:31 smithi078 bash[22670]: audit 2024-09-17T09:04:29.795840+0000 mgr.y (mgr.14532) 501 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:31 smithi078 bash[22670]: audit 2024-09-17T09:04:30.837735+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:31.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:31 smithi078 bash[22670]: audit 2024-09-17T09:04:30.842628+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:32 smithi136 bash[24812]: cluster 2024-09-17T09:04:31.070685+0000 mgr.y (mgr.14532) 502 : cluster [DBG] pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-17T09:04:32.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:32 smithi136 bash[24812]: audit 2024-09-17T09:04:31.517641+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:32 smithi136 bash[24812]: audit 2024-09-17T09:04:31.531910+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:32 smithi136 bash[24812]: audit 2024-09-17T09:04:32.003969+0000 mon.a (mon.0) 2948 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:04:32.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:32 smithi136 bash[24812]: audit 2024-09-17T09:04:32.005714+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:04:32.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:32 smithi136 bash[24812]: audit 2024-09-17T09:04:32.021641+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[22670]: cluster 2024-09-17T09:04:31.070685+0000 mgr.y (mgr.14532) 502 : cluster [DBG] pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-17T09:04:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[22670]: audit 2024-09-17T09:04:31.517641+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[22670]: audit 2024-09-17T09:04:31.531910+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[22670]: audit 2024-09-17T09:04:32.003969+0000 mon.a (mon.0) 2948 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[22670]: audit 2024-09-17T09:04:32.005714+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[22670]: audit 2024-09-17T09:04:32.021641+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[32124]: cluster 2024-09-17T09:04:31.070685+0000 mgr.y (mgr.14532) 502 : cluster [DBG] pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[32124]: audit 2024-09-17T09:04:31.517641+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[32124]: audit 2024-09-17T09:04:31.531910+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[32124]: audit 2024-09-17T09:04:32.003969+0000 mon.a (mon.0) 2948 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[32124]: audit 2024-09-17T09:04:32.005714+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:04:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:32 smithi078 bash[32124]: audit 2024-09-17T09:04:32.021641+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:04:33.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:33 smithi136 bash[24812]: cluster 2024-09-17T09:04:32.788012+0000 mon.a (mon.0) 2951 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:33 smithi078 bash[22670]: cluster 2024-09-17T09:04:32.788012+0000 mon.a (mon.0) 2951 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:33.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:33 smithi078 bash[32124]: cluster 2024-09-17T09:04:32.788012+0000 mon.a (mon.0) 2951 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:34.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:34 smithi136 bash[24812]: cluster 2024-09-17T09:04:33.072753+0000 mgr.y (mgr.14532) 503 : cluster [DBG] pgmap v781: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 966 B/s wr, 4 op/s 2024-09-17T09:04:34.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:34 smithi078 bash[32124]: cluster 2024-09-17T09:04:33.072753+0000 mgr.y (mgr.14532) 503 : cluster [DBG] pgmap v781: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 966 B/s wr, 4 op/s 2024-09-17T09:04:34.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:34 smithi078 bash[22670]: cluster 2024-09-17T09:04:33.072753+0000 mgr.y (mgr.14532) 503 : cluster [DBG] pgmap v781: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 966 B/s wr, 4 op/s 2024-09-17T09:04:36.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:36 smithi136 bash[24812]: cluster 2024-09-17T09:04:35.073561+0000 mgr.y (mgr.14532) 504 : cluster [DBG] pgmap v782: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-09-17T09:04:36.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:36 smithi078 bash[22670]: cluster 2024-09-17T09:04:35.073561+0000 mgr.y (mgr.14532) 504 : cluster [DBG] pgmap v782: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-09-17T09:04:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:36 smithi078 bash[32124]: cluster 2024-09-17T09:04:35.073561+0000 mgr.y (mgr.14532) 504 : cluster [DBG] pgmap v782: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-09-17T09:04:37.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:37 smithi136 bash[24812]: cluster 2024-09-17T09:04:36.166976+0000 mon.a (mon.0) 2952 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-09-17T09:04:37.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:37 smithi136 bash[24812]: cluster 2024-09-17T09:04:37.074429+0000 mgr.y (mgr.14532) 505 : cluster [DBG] pgmap v784: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-09-17T09:04:37.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:37 smithi078 bash[22670]: cluster 2024-09-17T09:04:36.166976+0000 mon.a (mon.0) 2952 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-09-17T09:04:37.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:37 smithi078 bash[22670]: cluster 2024-09-17T09:04:37.074429+0000 mgr.y (mgr.14532) 505 : cluster [DBG] pgmap v784: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-09-17T09:04:37.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:37 smithi078 bash[32124]: cluster 2024-09-17T09:04:36.166976+0000 mon.a (mon.0) 2952 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-09-17T09:04:37.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:37 smithi078 bash[32124]: cluster 2024-09-17T09:04:37.074429+0000 mgr.y (mgr.14532) 505 : cluster [DBG] pgmap v784: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-09-17T09:04:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:04:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:04:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:04:40.131 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:04:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:04:40.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:40 smithi136 bash[24812]: cluster 2024-09-17T09:04:39.076579+0000 mgr.y (mgr.14532) 506 : cluster [DBG] pgmap v785: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:40.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:40 smithi078 bash[32124]: cluster 2024-09-17T09:04:39.076579+0000 mgr.y (mgr.14532) 506 : cluster [DBG] pgmap v785: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:40.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:40 smithi078 bash[22670]: cluster 2024-09-17T09:04:39.076579+0000 mgr.y (mgr.14532) 506 : cluster [DBG] pgmap v785: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:41 smithi136 bash[24812]: audit 2024-09-17T09:04:39.807440+0000 mgr.y (mgr.14532) 507 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:41.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:41 smithi136 bash[24812]: audit 2024-09-17T09:04:41.010785+0000 mon.a (mon.0) 2953 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:41.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:41 smithi078 bash[32124]: audit 2024-09-17T09:04:39.807440+0000 mgr.y (mgr.14532) 507 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:41.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:41 smithi078 bash[32124]: audit 2024-09-17T09:04:41.010785+0000 mon.a (mon.0) 2953 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:41 smithi078 bash[22670]: audit 2024-09-17T09:04:39.807440+0000 mgr.y (mgr.14532) 507 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:41 smithi078 bash[22670]: audit 2024-09-17T09:04:41.010785+0000 mon.a (mon.0) 2953 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:42.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:42 smithi136 bash[24812]: cluster 2024-09-17T09:04:41.077365+0000 mgr.y (mgr.14532) 508 : cluster [DBG] pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:42.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:42 smithi078 bash[32124]: cluster 2024-09-17T09:04:41.077365+0000 mgr.y (mgr.14532) 508 : cluster [DBG] pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:42.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:42 smithi078 bash[22670]: cluster 2024-09-17T09:04:41.077365+0000 mgr.y (mgr.14532) 508 : cluster [DBG] pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:44.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:43 smithi078 bash[22670]: cluster 2024-09-17T09:04:42.802020+0000 mon.a (mon.0) 2954 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-09-17T09:04:44.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:43 smithi078 bash[22670]: cluster 2024-09-17T09:04:43.079560+0000 mgr.y (mgr.14532) 509 : cluster [DBG] pgmap v788: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:44.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:43 smithi078 bash[32124]: cluster 2024-09-17T09:04:42.802020+0000 mon.a (mon.0) 2954 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-09-17T09:04:44.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:43 smithi078 bash[32124]: cluster 2024-09-17T09:04:43.079560+0000 mgr.y (mgr.14532) 509 : cluster [DBG] pgmap v788: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:44.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:43 smithi136 bash[24812]: cluster 2024-09-17T09:04:42.802020+0000 mon.a (mon.0) 2954 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-09-17T09:04:44.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:43 smithi136 bash[24812]: cluster 2024-09-17T09:04:43.079560+0000 mgr.y (mgr.14532) 509 : cluster [DBG] pgmap v788: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:46.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:46 smithi136 bash[24812]: cluster 2024-09-17T09:04:45.080447+0000 mgr.y (mgr.14532) 510 : cluster [DBG] pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:46.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:46 smithi078 bash[22670]: cluster 2024-09-17T09:04:45.080447+0000 mgr.y (mgr.14532) 510 : cluster [DBG] pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:46.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:46 smithi078 bash[32124]: cluster 2024-09-17T09:04:45.080447+0000 mgr.y (mgr.14532) 510 : cluster [DBG] pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:47.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:47 smithi136 bash[24812]: audit 2024-09-17T09:04:46.211205+0000 mon.a (mon.0) 2955 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:47.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:47 smithi136 bash[24812]: audit 2024-09-17T09:04:46.212094+0000 mon.a (mon.0) 2956 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-94"}]: dispatch 2024-09-17T09:04:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:47 smithi078 bash[32124]: audit 2024-09-17T09:04:46.211205+0000 mon.a (mon.0) 2955 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:47 smithi078 bash[32124]: audit 2024-09-17T09:04:46.212094+0000 mon.a (mon.0) 2956 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-94"}]: dispatch 2024-09-17T09:04:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:47 smithi078 bash[22670]: audit 2024-09-17T09:04:46.211205+0000 mon.a (mon.0) 2955 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:04:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:47 smithi078 bash[22670]: audit 2024-09-17T09:04:46.212094+0000 mon.a (mon.0) 2956 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-94"}]: dispatch 2024-09-17T09:04:48.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:04:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:04:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:04:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:48 smithi078 bash[22670]: cluster 2024-09-17T09:04:47.081355+0000 mgr.y (mgr.14532) 511 : cluster [DBG] pgmap v790: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:48.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:48 smithi078 bash[22670]: cluster 2024-09-17T09:04:47.154419+0000 mon.a (mon.0) 2957 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-09-17T09:04:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:48 smithi078 bash[32124]: cluster 2024-09-17T09:04:47.081355+0000 mgr.y (mgr.14532) 511 : cluster [DBG] pgmap v790: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:48 smithi078 bash[32124]: cluster 2024-09-17T09:04:47.154419+0000 mon.a (mon.0) 2957 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-09-17T09:04:48.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:48 smithi136 bash[24812]: cluster 2024-09-17T09:04:47.081355+0000 mgr.y (mgr.14532) 511 : cluster [DBG] pgmap v790: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:04:48.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:48 smithi136 bash[24812]: cluster 2024-09-17T09:04:47.154419+0000 mon.a (mon.0) 2957 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-09-17T09:04:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:49 smithi136 bash[24812]: cluster 2024-09-17T09:04:48.165138+0000 mon.a (mon.0) 2958 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-09-17T09:04:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:49 smithi136 bash[24812]: audit 2024-09-17T09:04:48.180629+0000 mon.a (mon.0) 2959 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:49 smithi136 bash[24812]: cluster 2024-09-17T09:04:49.082288+0000 mgr.y (mgr.14532) 512 : cluster [DBG] pgmap v793: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:49 smithi078 bash[22670]: cluster 2024-09-17T09:04:48.165138+0000 mon.a (mon.0) 2958 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-09-17T09:04:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:49 smithi078 bash[22670]: audit 2024-09-17T09:04:48.180629+0000 mon.a (mon.0) 2959 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:49 smithi078 bash[22670]: cluster 2024-09-17T09:04:49.082288+0000 mgr.y (mgr.14532) 512 : cluster [DBG] pgmap v793: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:49 smithi078 bash[32124]: cluster 2024-09-17T09:04:48.165138+0000 mon.a (mon.0) 2958 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-09-17T09:04:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:49 smithi078 bash[32124]: audit 2024-09-17T09:04:48.180629+0000 mon.a (mon.0) 2959 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:04:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:49 smithi078 bash[32124]: cluster 2024-09-17T09:04:49.082288+0000 mgr.y (mgr.14532) 512 : cluster [DBG] pgmap v793: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:50.186 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:04:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:04:50.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:50 smithi136 bash[24812]: cluster 2024-09-17T09:04:49.158239+0000 mon.a (mon.0) 2960 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:50.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:50 smithi136 bash[24812]: audit 2024-09-17T09:04:49.180173+0000 mon.a (mon.0) 2961 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:50.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:50 smithi136 bash[24812]: cluster 2024-09-17T09:04:49.180444+0000 mon.a (mon.0) 2962 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-09-17T09:04:50.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:50 smithi136 bash[24812]: audit 2024-09-17T09:04:49.189281+0000 mon.a (mon.0) 2963 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:50.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:50 smithi136 bash[24812]: audit 2024-09-17T09:04:49.819012+0000 mgr.y (mgr.14532) 513 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[22670]: cluster 2024-09-17T09:04:49.158239+0000 mon.a (mon.0) 2960 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[22670]: audit 2024-09-17T09:04:49.180173+0000 mon.a (mon.0) 2961 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[22670]: cluster 2024-09-17T09:04:49.180444+0000 mon.a (mon.0) 2962 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-09-17T09:04:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[22670]: audit 2024-09-17T09:04:49.189281+0000 mon.a (mon.0) 2963 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[22670]: audit 2024-09-17T09:04:49.819012+0000 mgr.y (mgr.14532) 513 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[32124]: cluster 2024-09-17T09:04:49.158239+0000 mon.a (mon.0) 2960 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[32124]: audit 2024-09-17T09:04:49.180173+0000 mon.a (mon.0) 2961 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:04:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[32124]: cluster 2024-09-17T09:04:49.180444+0000 mon.a (mon.0) 2962 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-09-17T09:04:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[32124]: audit 2024-09-17T09:04:49.189281+0000 mon.a (mon.0) 2963 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:04:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:50 smithi078 bash[32124]: audit 2024-09-17T09:04:49.819012+0000 mgr.y (mgr.14532) 513 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:04:51.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:51 smithi136 bash[24812]: cluster 2024-09-17T09:04:50.183190+0000 mon.a (mon.0) 2964 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-09-17T09:04:51.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:51 smithi136 bash[24812]: cluster 2024-09-17T09:04:51.083247+0000 mgr.y (mgr.14532) 514 : cluster [DBG] pgmap v796: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:51 smithi078 bash[22670]: cluster 2024-09-17T09:04:50.183190+0000 mon.a (mon.0) 2964 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-09-17T09:04:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:51 smithi078 bash[22670]: cluster 2024-09-17T09:04:51.083247+0000 mgr.y (mgr.14532) 514 : cluster [DBG] pgmap v796: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:51 smithi078 bash[32124]: cluster 2024-09-17T09:04:50.183190+0000 mon.a (mon.0) 2964 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-09-17T09:04:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:51 smithi078 bash[32124]: cluster 2024-09-17T09:04:51.083247+0000 mgr.y (mgr.14532) 514 : cluster [DBG] pgmap v796: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:04:54.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:53 smithi078 bash[22670]: cluster 2024-09-17T09:04:53.085311+0000 mgr.y (mgr.14532) 515 : cluster [DBG] pgmap v797: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-17T09:04:54.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:53 smithi078 bash[32124]: cluster 2024-09-17T09:04:53.085311+0000 mgr.y (mgr.14532) 515 : cluster [DBG] pgmap v797: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-17T09:04:54.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:53 smithi136 bash[24812]: cluster 2024-09-17T09:04:53.085311+0000 mgr.y (mgr.14532) 515 : cluster [DBG] pgmap v797: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-17T09:04:56.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:56 smithi136 bash[24812]: cluster 2024-09-17T09:04:55.086109+0000 mgr.y (mgr.14532) 516 : cluster [DBG] pgmap v798: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 739 B/s wr, 2 op/s 2024-09-17T09:04:56.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:56 smithi136 bash[24812]: audit 2024-09-17T09:04:56.040555+0000 mon.a (mon.0) 2965 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:56 smithi078 bash[22670]: cluster 2024-09-17T09:04:55.086109+0000 mgr.y (mgr.14532) 516 : cluster [DBG] pgmap v798: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 739 B/s wr, 2 op/s 2024-09-17T09:04:56.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:56 smithi078 bash[22670]: audit 2024-09-17T09:04:56.040555+0000 mon.a (mon.0) 2965 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:56.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:56 smithi078 bash[32124]: cluster 2024-09-17T09:04:55.086109+0000 mgr.y (mgr.14532) 516 : cluster [DBG] pgmap v798: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 739 B/s wr, 2 op/s 2024-09-17T09:04:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:56 smithi078 bash[32124]: audit 2024-09-17T09:04:56.040555+0000 mon.a (mon.0) 2965 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:04:58.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:04:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:04:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:04:58.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:58 smithi078 bash[32124]: cluster 2024-09-17T09:04:57.086941+0000 mgr.y (mgr.14532) 517 : cluster [DBG] pgmap v799: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-09-17T09:04:58.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:04:58 smithi078 bash[32124]: cluster 2024-09-17T09:04:57.800172+0000 mon.a (mon.0) 2966 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:58 smithi078 bash[22670]: cluster 2024-09-17T09:04:57.086941+0000 mgr.y (mgr.14532) 517 : cluster [DBG] pgmap v799: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-09-17T09:04:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:04:58 smithi078 bash[22670]: cluster 2024-09-17T09:04:57.800172+0000 mon.a (mon.0) 2966 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:04:58.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:58 smithi136 bash[24812]: cluster 2024-09-17T09:04:57.086941+0000 mgr.y (mgr.14532) 517 : cluster [DBG] pgmap v799: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-09-17T09:04:58.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:04:58 smithi136 bash[24812]: cluster 2024-09-17T09:04:57.800172+0000 mon.a (mon.0) 2966 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:00.149 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:04:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:05:00.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:00 smithi136 bash[24812]: cluster 2024-09-17T09:04:59.089101+0000 mgr.y (mgr.14532) 518 : cluster [DBG] pgmap v800: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 516 B/s wr, 2 op/s 2024-09-17T09:05:00.539 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:05:00 smithi136 bash[45001]: debug 2024-09-17T09:05:00.230+0000 7fc044b15640 -1 snap_mapper.add_oid found existing snaps mapped on 65:d42a8a7d:test-rados-api-smithi078-64852-97::foo:31, removing 2024-09-17T09:05:00.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:00 smithi078 bash[32124]: cluster 2024-09-17T09:04:59.089101+0000 mgr.y (mgr.14532) 518 : cluster [DBG] pgmap v800: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 516 B/s wr, 2 op/s 2024-09-17T09:05:00.602 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:05:00 smithi078 bash[35112]: debug 2024-09-17T09:05:00.224+0000 7fce8039e640 -1 snap_mapper.add_oid found existing snaps mapped on 65:d42a8a7d:test-rados-api-smithi078-64852-97::foo:31, removing 2024-09-17T09:05:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:00 smithi078 bash[22670]: cluster 2024-09-17T09:04:59.089101+0000 mgr.y (mgr.14532) 518 : cluster [DBG] pgmap v800: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 516 B/s wr, 2 op/s 2024-09-17T09:05:00.603 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:05:00 smithi078 bash[46309]: debug 2024-09-17T09:05:00.224+0000 7f3f18492640 -1 snap_mapper.add_oid found existing snaps mapped on 65:d42a8a7d:test-rados-api-smithi078-64852-97::foo:31, removing 2024-09-17T09:05:01.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:01 smithi136 bash[24812]: audit 2024-09-17T09:04:59.828431+0000 mgr.y (mgr.14532) 519 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:01.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:01 smithi136 bash[24812]: audit 2024-09-17T09:05:00.264294+0000 mon.a (mon.0) 2967 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:01.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:01 smithi136 bash[24812]: audit 2024-09-17T09:05:00.265290+0000 mon.a (mon.0) 2968 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-96"}]: dispatch 2024-09-17T09:05:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:01 smithi078 bash[22670]: audit 2024-09-17T09:04:59.828431+0000 mgr.y (mgr.14532) 519 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:01 smithi078 bash[22670]: audit 2024-09-17T09:05:00.264294+0000 mon.a (mon.0) 2967 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:01.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:01 smithi078 bash[22670]: audit 2024-09-17T09:05:00.265290+0000 mon.a (mon.0) 2968 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-96"}]: dispatch 2024-09-17T09:05:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:01 smithi078 bash[32124]: audit 2024-09-17T09:04:59.828431+0000 mgr.y (mgr.14532) 519 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:01 smithi078 bash[32124]: audit 2024-09-17T09:05:00.264294+0000 mon.a (mon.0) 2967 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:01 smithi078 bash[32124]: audit 2024-09-17T09:05:00.265290+0000 mon.a (mon.0) 2968 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-96"}]: dispatch 2024-09-17T09:05:02.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:02 smithi136 bash[24812]: cluster 2024-09-17T09:05:01.089903+0000 mgr.y (mgr.14532) 520 : cluster [DBG] pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 469 B/s wr, 1 op/s 2024-09-17T09:05:02.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:02 smithi136 bash[24812]: cluster 2024-09-17T09:05:01.170122+0000 mon.a (mon.0) 2969 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-09-17T09:05:02.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:02 smithi078 bash[22670]: cluster 2024-09-17T09:05:01.089903+0000 mgr.y (mgr.14532) 520 : cluster [DBG] pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 469 B/s wr, 1 op/s 2024-09-17T09:05:02.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:02 smithi078 bash[22670]: cluster 2024-09-17T09:05:01.170122+0000 mon.a (mon.0) 2969 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-09-17T09:05:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:02 smithi078 bash[32124]: cluster 2024-09-17T09:05:01.089903+0000 mgr.y (mgr.14532) 520 : cluster [DBG] pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 469 B/s wr, 1 op/s 2024-09-17T09:05:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:02 smithi078 bash[32124]: cluster 2024-09-17T09:05:01.170122+0000 mon.a (mon.0) 2969 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-09-17T09:05:03.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:03 smithi136 bash[24812]: cluster 2024-09-17T09:05:02.173532+0000 mon.a (mon.0) 2970 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-09-17T09:05:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:03 smithi136 bash[24812]: audit 2024-09-17T09:05:02.176755+0000 mon.a (mon.0) 2971 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:03 smithi136 bash[24812]: cluster 2024-09-17T09:05:03.091987+0000 mgr.y (mgr.14532) 521 : cluster [DBG] pgmap v804: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-09-17T09:05:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:03 smithi136 bash[24812]: audit 2024-09-17T09:05:03.174945+0000 mon.a (mon.0) 2972 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:03.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:03 smithi136 bash[24812]: cluster 2024-09-17T09:05:03.175513+0000 mon.a (mon.0) 2973 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-09-17T09:05:03.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[22670]: cluster 2024-09-17T09:05:02.173532+0000 mon.a (mon.0) 2970 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-09-17T09:05:03.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[22670]: audit 2024-09-17T09:05:02.176755+0000 mon.a (mon.0) 2971 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[22670]: cluster 2024-09-17T09:05:03.091987+0000 mgr.y (mgr.14532) 521 : cluster [DBG] pgmap v804: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-09-17T09:05:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[22670]: audit 2024-09-17T09:05:03.174945+0000 mon.a (mon.0) 2972 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[22670]: cluster 2024-09-17T09:05:03.175513+0000 mon.a (mon.0) 2973 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-09-17T09:05:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[32124]: cluster 2024-09-17T09:05:02.173532+0000 mon.a (mon.0) 2970 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-09-17T09:05:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[32124]: audit 2024-09-17T09:05:02.176755+0000 mon.a (mon.0) 2971 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[32124]: cluster 2024-09-17T09:05:03.091987+0000 mgr.y (mgr.14532) 521 : cluster [DBG] pgmap v804: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-09-17T09:05:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[32124]: audit 2024-09-17T09:05:03.174945+0000 mon.a (mon.0) 2972 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:03.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:03 smithi078 bash[32124]: cluster 2024-09-17T09:05:03.175513+0000 mon.a (mon.0) 2973 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-09-17T09:05:04.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:04 smithi136 bash[24812]: cluster 2024-09-17T09:05:03.185069+0000 mon.a (mon.0) 2974 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:04.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:04 smithi136 bash[24812]: audit 2024-09-17T09:05:03.213881+0000 mon.a (mon.0) 2975 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:05:04.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:04 smithi078 bash[32124]: cluster 2024-09-17T09:05:03.185069+0000 mon.a (mon.0) 2974 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:04.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:04 smithi078 bash[32124]: audit 2024-09-17T09:05:03.213881+0000 mon.a (mon.0) 2975 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:05:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:04 smithi078 bash[22670]: cluster 2024-09-17T09:05:03.185069+0000 mon.a (mon.0) 2974 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:04.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:04 smithi078 bash[22670]: audit 2024-09-17T09:05:03.213881+0000 mon.a (mon.0) 2975 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: audit 2024-09-17T09:05:04.199326+0000 mon.a (mon.0) 2976 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: cluster 2024-09-17T09:05:04.199728+0000 mon.a (mon.0) 2977 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: audit 2024-09-17T09:05:04.202325+0000 mon.a (mon.0) 2978 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-98", "mode": "writeback"}]: dispatch 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: cluster 2024-09-17T09:05:05.092822+0000 mgr.y (mgr.14532) 522 : cluster [DBG] pgmap v807: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: cluster 2024-09-17T09:05:05.192932+0000 mon.a (mon.0) 2979 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: audit 2024-09-17T09:05:05.203533+0000 mon.a (mon.0) 2980 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-98", "mode": "writeback"}]': finished 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: cluster 2024-09-17T09:05:05.203650+0000 mon.a (mon.0) 2981 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-09-17T09:05:05.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:05 smithi136 bash[24812]: audit 2024-09-17T09:05:05.204555+0000 mon.a (mon.0) 2982 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-98"}]: dispatch 2024-09-17T09:05:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: audit 2024-09-17T09:05:04.199326+0000 mon.a (mon.0) 2976 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:05:05.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: cluster 2024-09-17T09:05:04.199728+0000 mon.a (mon.0) 2977 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: audit 2024-09-17T09:05:04.202325+0000 mon.a (mon.0) 2978 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-98", "mode": "writeback"}]: dispatch 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: cluster 2024-09-17T09:05:05.092822+0000 mgr.y (mgr.14532) 522 : cluster [DBG] pgmap v807: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: cluster 2024-09-17T09:05:05.192932+0000 mon.a (mon.0) 2979 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: audit 2024-09-17T09:05:05.203533+0000 mon.a (mon.0) 2980 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-98", "mode": "writeback"}]': finished 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: cluster 2024-09-17T09:05:05.203650+0000 mon.a (mon.0) 2981 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[22670]: audit 2024-09-17T09:05:05.204555+0000 mon.a (mon.0) 2982 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-98"}]: dispatch 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: audit 2024-09-17T09:05:04.199326+0000 mon.a (mon.0) 2976 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: cluster 2024-09-17T09:05:04.199728+0000 mon.a (mon.0) 2977 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: audit 2024-09-17T09:05:04.202325+0000 mon.a (mon.0) 2978 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-98", "mode": "writeback"}]: dispatch 2024-09-17T09:05:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: cluster 2024-09-17T09:05:05.092822+0000 mgr.y (mgr.14532) 522 : cluster [DBG] pgmap v807: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-09-17T09:05:05.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: cluster 2024-09-17T09:05:05.192932+0000 mon.a (mon.0) 2979 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:05.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: audit 2024-09-17T09:05:05.203533+0000 mon.a (mon.0) 2980 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-98", "mode": "writeback"}]': finished 2024-09-17T09:05:05.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: cluster 2024-09-17T09:05:05.203650+0000 mon.a (mon.0) 2981 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-09-17T09:05:05.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:05 smithi078 bash[32124]: audit 2024-09-17T09:05:05.204555+0000 mon.a (mon.0) 2982 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-98"}]: dispatch 2024-09-17T09:05:07.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:07 smithi136 bash[24812]: audit 2024-09-17T09:05:06.204365+0000 mon.a (mon.0) 2983 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-98"}]': finished 2024-09-17T09:05:07.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:07 smithi136 bash[24812]: cluster 2024-09-17T09:05:06.204520+0000 mon.a (mon.0) 2984 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-09-17T09:05:07.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:07 smithi136 bash[24812]: audit 2024-09-17T09:05:06.207368+0000 mon.a (mon.0) 2985 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:05:07.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:07 smithi136 bash[24812]: cluster 2024-09-17T09:05:07.093728+0000 mgr.y (mgr.14532) 523 : cluster [DBG] pgmap v810: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:07.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[32124]: audit 2024-09-17T09:05:06.204365+0000 mon.a (mon.0) 2983 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-98"}]': finished 2024-09-17T09:05:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[32124]: cluster 2024-09-17T09:05:06.204520+0000 mon.a (mon.0) 2984 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-09-17T09:05:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[32124]: audit 2024-09-17T09:05:06.207368+0000 mon.a (mon.0) 2985 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:05:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[32124]: cluster 2024-09-17T09:05:07.093728+0000 mgr.y (mgr.14532) 523 : cluster [DBG] pgmap v810: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[22670]: audit 2024-09-17T09:05:06.204365+0000 mon.a (mon.0) 2983 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-98"}]': finished 2024-09-17T09:05:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[22670]: cluster 2024-09-17T09:05:06.204520+0000 mon.a (mon.0) 2984 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-09-17T09:05:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[22670]: audit 2024-09-17T09:05:06.207368+0000 mon.a (mon.0) 2985 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:05:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[22670]: cluster 2024-09-17T09:05:07.093728+0000 mgr.y (mgr.14532) 523 : cluster [DBG] pgmap v810: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:08.217 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:05:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:05:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:05:08.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:08 smithi136 bash[24812]: cluster 2024-09-17T09:05:07.199093+0000 mon.a (mon.0) 2986 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:08.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:08 smithi136 bash[24812]: audit 2024-09-17T09:05:07.215264+0000 mon.a (mon.0) 2987 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:05:08.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:08 smithi136 bash[24812]: cluster 2024-09-17T09:05:07.215430+0000 mon.a (mon.0) 2988 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-09-17T09:05:08.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:08 smithi136 bash[24812]: audit 2024-09-17T09:05:07.217097+0000 mon.a (mon.0) 2989 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-17T09:05:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[22670]: cluster 2024-09-17T09:05:07.199093+0000 mon.a (mon.0) 2986 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[22670]: audit 2024-09-17T09:05:07.215264+0000 mon.a (mon.0) 2987 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:05:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[22670]: cluster 2024-09-17T09:05:07.215430+0000 mon.a (mon.0) 2988 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-09-17T09:05:08.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[22670]: audit 2024-09-17T09:05:07.217097+0000 mon.a (mon.0) 2989 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-17T09:05:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[32124]: cluster 2024-09-17T09:05:07.199093+0000 mon.a (mon.0) 2986 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[32124]: audit 2024-09-17T09:05:07.215264+0000 mon.a (mon.0) 2987 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:05:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[32124]: cluster 2024-09-17T09:05:07.215430+0000 mon.a (mon.0) 2988 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-09-17T09:05:08.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:08 smithi078 bash[32124]: audit 2024-09-17T09:05:07.217097+0000 mon.a (mon.0) 2989 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-17T09:05:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:09 smithi136 bash[24812]: audit 2024-09-17T09:05:08.216486+0000 mon.a (mon.0) 2990 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_count","val": "1"}]': finished 2024-09-17T09:05:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:09 smithi136 bash[24812]: cluster 2024-09-17T09:05:08.216642+0000 mon.a (mon.0) 2991 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-09-17T09:05:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:09 smithi136 bash[24812]: audit 2024-09-17T09:05:08.218940+0000 mon.a (mon.0) 2992 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:09.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:09 smithi136 bash[24812]: cluster 2024-09-17T09:05:09.094606+0000 mgr.y (mgr.14532) 524 : cluster [DBG] pgmap v813: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:05:09.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[22670]: audit 2024-09-17T09:05:08.216486+0000 mon.a (mon.0) 2990 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_count","val": "1"}]': finished 2024-09-17T09:05:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[22670]: cluster 2024-09-17T09:05:08.216642+0000 mon.a (mon.0) 2991 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-09-17T09:05:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[22670]: audit 2024-09-17T09:05:08.218940+0000 mon.a (mon.0) 2992 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[22670]: cluster 2024-09-17T09:05:09.094606+0000 mgr.y (mgr.14532) 524 : cluster [DBG] pgmap v813: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:05:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[32124]: audit 2024-09-17T09:05:08.216486+0000 mon.a (mon.0) 2990 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_count","val": "1"}]': finished 2024-09-17T09:05:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[32124]: cluster 2024-09-17T09:05:08.216642+0000 mon.a (mon.0) 2991 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-09-17T09:05:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[32124]: audit 2024-09-17T09:05:08.218940+0000 mon.a (mon.0) 2992 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:09.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:09 smithi078 bash[32124]: cluster 2024-09-17T09:05:09.094606+0000 mgr.y (mgr.14532) 524 : cluster [DBG] pgmap v813: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:05:10.236 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:05:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:05:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:10 smithi136 bash[24812]: audit 2024-09-17T09:05:09.221253+0000 mon.a (mon.0) 2993 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:10 smithi136 bash[24812]: cluster 2024-09-17T09:05:09.221457+0000 mon.a (mon.0) 2994 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-09-17T09:05:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:10 smithi136 bash[24812]: audit 2024-09-17T09:05:09.223543+0000 mon.a (mon.0) 2995 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-17T09:05:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:10 smithi136 bash[24812]: audit 2024-09-17T09:05:09.832498+0000 mgr.y (mgr.14532) 525 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:10 smithi136 bash[24812]: audit 2024-09-17T09:05:10.222017+0000 mon.a (mon.0) 2996 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "target_max_objects","val": "250"}]': finished 2024-09-17T09:05:10.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:10 smithi136 bash[24812]: cluster 2024-09-17T09:05:10.222192+0000 mon.a (mon.0) 2997 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-09-17T09:05:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[22670]: audit 2024-09-17T09:05:09.221253+0000 mon.a (mon.0) 2993 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[22670]: cluster 2024-09-17T09:05:09.221457+0000 mon.a (mon.0) 2994 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-09-17T09:05:10.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[22670]: audit 2024-09-17T09:05:09.223543+0000 mon.a (mon.0) 2995 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[22670]: audit 2024-09-17T09:05:09.832498+0000 mgr.y (mgr.14532) 525 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[22670]: audit 2024-09-17T09:05:10.222017+0000 mon.a (mon.0) 2996 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "target_max_objects","val": "250"}]': finished 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[22670]: cluster 2024-09-17T09:05:10.222192+0000 mon.a (mon.0) 2997 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[32124]: audit 2024-09-17T09:05:09.221253+0000 mon.a (mon.0) 2993 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[32124]: cluster 2024-09-17T09:05:09.221457+0000 mon.a (mon.0) 2994 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[32124]: audit 2024-09-17T09:05:09.223543+0000 mon.a (mon.0) 2995 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[32124]: audit 2024-09-17T09:05:09.832498+0000 mgr.y (mgr.14532) 525 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[32124]: audit 2024-09-17T09:05:10.222017+0000 mon.a (mon.0) 2996 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-98","var": "target_max_objects","val": "250"}]': finished 2024-09-17T09:05:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:10 smithi078 bash[32124]: cluster 2024-09-17T09:05:10.222192+0000 mon.a (mon.0) 2997 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-09-17T09:05:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:11 smithi136 bash[24812]: audit 2024-09-17T09:05:10.293280+0000 mon.a (mon.0) 2998 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:11 smithi136 bash[24812]: audit 2024-09-17T09:05:11.069928+0000 mon.a (mon.0) 2999 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:11.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:11 smithi136 bash[24812]: cluster 2024-09-17T09:05:11.095350+0000 mgr.y (mgr.14532) 526 : cluster [DBG] pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:05:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:11 smithi078 bash[22670]: audit 2024-09-17T09:05:10.293280+0000 mon.a (mon.0) 2998 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:11.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:11 smithi078 bash[22670]: audit 2024-09-17T09:05:11.069928+0000 mon.a (mon.0) 2999 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:11.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:11 smithi078 bash[22670]: cluster 2024-09-17T09:05:11.095350+0000 mgr.y (mgr.14532) 526 : cluster [DBG] pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:05:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:11 smithi078 bash[32124]: audit 2024-09-17T09:05:10.293280+0000 mon.a (mon.0) 2998 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:11 smithi078 bash[32124]: audit 2024-09-17T09:05:11.069928+0000 mon.a (mon.0) 2999 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:11 smithi078 bash[32124]: cluster 2024-09-17T09:05:11.095350+0000 mgr.y (mgr.14532) 526 : cluster [DBG] pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:05:12.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:12 smithi136 bash[24812]: audit 2024-09-17T09:05:11.254312+0000 mon.a (mon.0) 3000 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:05:12.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:12 smithi136 bash[24812]: cluster 2024-09-17T09:05:11.254460+0000 mon.a (mon.0) 3001 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-09-17T09:05:12.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:12 smithi136 bash[24812]: audit 2024-09-17T09:05:11.256333+0000 mon.a (mon.0) 3002 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98"}]: dispatch 2024-09-17T09:05:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:12 smithi078 bash[22670]: audit 2024-09-17T09:05:11.254312+0000 mon.a (mon.0) 3000 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:05:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:12 smithi078 bash[22670]: cluster 2024-09-17T09:05:11.254460+0000 mon.a (mon.0) 3001 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-09-17T09:05:12.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:12 smithi078 bash[22670]: audit 2024-09-17T09:05:11.256333+0000 mon.a (mon.0) 3002 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98"}]: dispatch 2024-09-17T09:05:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:12 smithi078 bash[32124]: audit 2024-09-17T09:05:11.254312+0000 mon.a (mon.0) 3000 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:05:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:12 smithi078 bash[32124]: cluster 2024-09-17T09:05:11.254460+0000 mon.a (mon.0) 3001 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-09-17T09:05:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:12 smithi078 bash[32124]: audit 2024-09-17T09:05:11.256333+0000 mon.a (mon.0) 3002 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98"}]: dispatch 2024-09-17T09:05:13.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:13 smithi136 bash[24812]: audit 2024-09-17T09:05:12.259532+0000 mon.a (mon.0) 3003 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98"}]': finished 2024-09-17T09:05:13.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:13 smithi136 bash[24812]: cluster 2024-09-17T09:05:12.259691+0000 mon.a (mon.0) 3004 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-09-17T09:05:13.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:13 smithi136 bash[24812]: cluster 2024-09-17T09:05:12.804125+0000 mon.a (mon.0) 3005 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:13.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:13 smithi136 bash[24812]: cluster 2024-09-17T09:05:13.097463+0000 mgr.y (mgr.14532) 527 : cluster [DBG] pgmap v819: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:13.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[32124]: audit 2024-09-17T09:05:12.259532+0000 mon.a (mon.0) 3003 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98"}]': finished 2024-09-17T09:05:13.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[32124]: cluster 2024-09-17T09:05:12.259691+0000 mon.a (mon.0) 3004 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-09-17T09:05:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[32124]: cluster 2024-09-17T09:05:12.804125+0000 mon.a (mon.0) 3005 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[32124]: cluster 2024-09-17T09:05:13.097463+0000 mgr.y (mgr.14532) 527 : cluster [DBG] pgmap v819: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[22670]: audit 2024-09-17T09:05:12.259532+0000 mon.a (mon.0) 3003 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-98"}]': finished 2024-09-17T09:05:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[22670]: cluster 2024-09-17T09:05:12.259691+0000 mon.a (mon.0) 3004 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-09-17T09:05:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[22670]: cluster 2024-09-17T09:05:12.804125+0000 mon.a (mon.0) 3005 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:13 smithi078 bash[22670]: cluster 2024-09-17T09:05:13.097463+0000 mgr.y (mgr.14532) 527 : cluster [DBG] pgmap v819: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:14.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:14 smithi078 bash[32124]: cluster 2024-09-17T09:05:13.283462+0000 mon.a (mon.0) 3006 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-09-17T09:05:14.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:14 smithi078 bash[22670]: cluster 2024-09-17T09:05:13.283462+0000 mon.a (mon.0) 3006 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-09-17T09:05:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:14 smithi136 bash[24812]: cluster 2024-09-17T09:05:13.283462+0000 mon.a (mon.0) 3006 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-09-17T09:05:15.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[22670]: cluster 2024-09-17T09:05:14.290193+0000 mon.a (mon.0) 3007 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[22670]: audit 2024-09-17T09:05:14.301208+0000 mon.a (mon.0) 3008 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[22670]: cluster 2024-09-17T09:05:15.098280+0000 mgr.y (mgr.14532) 528 : cluster [DBG] pgmap v822: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[22670]: audit 2024-09-17T09:05:15.294089+0000 mon.a (mon.0) 3009 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[22670]: cluster 2024-09-17T09:05:15.294579+0000 mon.a (mon.0) 3010 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[22670]: audit 2024-09-17T09:05:15.299670+0000 mon.a (mon.0) 3011 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[32124]: cluster 2024-09-17T09:05:14.290193+0000 mon.a (mon.0) 3007 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[32124]: audit 2024-09-17T09:05:14.301208+0000 mon.a (mon.0) 3008 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[32124]: cluster 2024-09-17T09:05:15.098280+0000 mgr.y (mgr.14532) 528 : cluster [DBG] pgmap v822: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[32124]: audit 2024-09-17T09:05:15.294089+0000 mon.a (mon.0) 3009 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[32124]: cluster 2024-09-17T09:05:15.294579+0000 mon.a (mon.0) 3010 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-09-17T09:05:15.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:15 smithi078 bash[32124]: audit 2024-09-17T09:05:15.299670+0000 mon.a (mon.0) 3011 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:05:15.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:15 smithi136 bash[24812]: cluster 2024-09-17T09:05:14.290193+0000 mon.a (mon.0) 3007 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-09-17T09:05:15.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:15 smithi136 bash[24812]: audit 2024-09-17T09:05:14.301208+0000 mon.a (mon.0) 3008 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:15.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:15 smithi136 bash[24812]: cluster 2024-09-17T09:05:15.098280+0000 mgr.y (mgr.14532) 528 : cluster [DBG] pgmap v822: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:15.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:15 smithi136 bash[24812]: audit 2024-09-17T09:05:15.294089+0000 mon.a (mon.0) 3009 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:15.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:15 smithi136 bash[24812]: cluster 2024-09-17T09:05:15.294579+0000 mon.a (mon.0) 3010 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-09-17T09:05:15.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:15 smithi136 bash[24812]: audit 2024-09-17T09:05:15.299670+0000 mon.a (mon.0) 3011 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:05:17.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[22670]: audit 2024-09-17T09:05:16.291771+0000 mon.a (mon.0) 3012 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:05:17.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[22670]: cluster 2024-09-17T09:05:16.291970+0000 mon.a (mon.0) 3013 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-09-17T09:05:17.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[22670]: audit 2024-09-17T09:05:16.294465+0000 mon.a (mon.0) 3014 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-100"}]: dispatch 2024-09-17T09:05:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[22670]: cluster 2024-09-17T09:05:17.099132+0000 mgr.y (mgr.14532) 529 : cluster [DBG] pgmap v825: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[32124]: audit 2024-09-17T09:05:16.291771+0000 mon.a (mon.0) 3012 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:05:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[32124]: cluster 2024-09-17T09:05:16.291970+0000 mon.a (mon.0) 3013 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-09-17T09:05:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[32124]: audit 2024-09-17T09:05:16.294465+0000 mon.a (mon.0) 3014 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-100"}]: dispatch 2024-09-17T09:05:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[32124]: cluster 2024-09-17T09:05:17.099132+0000 mgr.y (mgr.14532) 529 : cluster [DBG] pgmap v825: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:17.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:17 smithi136 bash[24812]: audit 2024-09-17T09:05:16.291771+0000 mon.a (mon.0) 3012 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:05:17.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:17 smithi136 bash[24812]: cluster 2024-09-17T09:05:16.291970+0000 mon.a (mon.0) 3013 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-09-17T09:05:17.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:17 smithi136 bash[24812]: audit 2024-09-17T09:05:16.294465+0000 mon.a (mon.0) 3014 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-100"}]: dispatch 2024-09-17T09:05:17.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:17 smithi136 bash[24812]: cluster 2024-09-17T09:05:17.099132+0000 mgr.y (mgr.14532) 529 : cluster [DBG] pgmap v825: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:18.311 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:05:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:05:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:05:18.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:18 smithi078 bash[22670]: audit 2024-09-17T09:05:17.311657+0000 mon.a (mon.0) 3015 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-100"}]': finished 2024-09-17T09:05:18.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:18 smithi078 bash[22670]: cluster 2024-09-17T09:05:17.311836+0000 mon.a (mon.0) 3016 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-09-17T09:05:18.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:18 smithi078 bash[22670]: audit 2024-09-17T09:05:17.313040+0000 mon.a (mon.0) 3017 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-100", "mode": "writeback"}]: dispatch 2024-09-17T09:05:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:18 smithi078 bash[32124]: audit 2024-09-17T09:05:17.311657+0000 mon.a (mon.0) 3015 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-100"}]': finished 2024-09-17T09:05:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:18 smithi078 bash[32124]: cluster 2024-09-17T09:05:17.311836+0000 mon.a (mon.0) 3016 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-09-17T09:05:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:18 smithi078 bash[32124]: audit 2024-09-17T09:05:17.313040+0000 mon.a (mon.0) 3017 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-100", "mode": "writeback"}]: dispatch 2024-09-17T09:05:18.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:18 smithi136 bash[24812]: audit 2024-09-17T09:05:17.311657+0000 mon.a (mon.0) 3015 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-6", "overlaypool": "test-rados-api-smithi078-64852-100"}]': finished 2024-09-17T09:05:18.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:18 smithi136 bash[24812]: cluster 2024-09-17T09:05:17.311836+0000 mon.a (mon.0) 3016 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-09-17T09:05:18.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:18 smithi136 bash[24812]: audit 2024-09-17T09:05:17.313040+0000 mon.a (mon.0) 3017 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-100", "mode": "writeback"}]: dispatch 2024-09-17T09:05:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: cluster 2024-09-17T09:05:18.296561+0000 mon.a (mon.0) 3018 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:19.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: audit 2024-09-17T09:05:18.307921+0000 mon.a (mon.0) 3019 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-100", "mode": "writeback"}]': finished 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: cluster 2024-09-17T09:05:18.308114+0000 mon.a (mon.0) 3020 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: audit 2024-09-17T09:05:18.312344+0000 mon.a (mon.0) 3021 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: cluster 2024-09-17T09:05:19.099873+0000 mgr.y (mgr.14532) 530 : cluster [DBG] pgmap v828: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: audit 2024-09-17T09:05:19.309408+0000 mon.a (mon.0) 3022 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: cluster 2024-09-17T09:05:19.309584+0000 mon.a (mon.0) 3023 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[32124]: audit 2024-09-17T09:05:19.312370+0000 mon.a (mon.0) 3024 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: cluster 2024-09-17T09:05:18.296561+0000 mon.a (mon.0) 3018 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: audit 2024-09-17T09:05:18.307921+0000 mon.a (mon.0) 3019 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-100", "mode": "writeback"}]': finished 2024-09-17T09:05:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: cluster 2024-09-17T09:05:18.308114+0000 mon.a (mon.0) 3020 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-09-17T09:05:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: audit 2024-09-17T09:05:18.312344+0000 mon.a (mon.0) 3021 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: cluster 2024-09-17T09:05:19.099873+0000 mgr.y (mgr.14532) 530 : cluster [DBG] pgmap v828: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: audit 2024-09-17T09:05:19.309408+0000 mon.a (mon.0) 3022 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:05:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: cluster 2024-09-17T09:05:19.309584+0000 mon.a (mon.0) 3023 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-09-17T09:05:19.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:19 smithi078 bash[22670]: audit 2024-09-17T09:05:19.312370+0000 mon.a (mon.0) 3024 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:19.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: cluster 2024-09-17T09:05:18.296561+0000 mon.a (mon.0) 3018 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:19.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: audit 2024-09-17T09:05:18.307921+0000 mon.a (mon.0) 3019 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-100", "mode": "writeback"}]': finished 2024-09-17T09:05:19.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: cluster 2024-09-17T09:05:18.308114+0000 mon.a (mon.0) 3020 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-09-17T09:05:19.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: audit 2024-09-17T09:05:18.312344+0000 mon.a (mon.0) 3021 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: cluster 2024-09-17T09:05:19.099873+0000 mgr.y (mgr.14532) 530 : cluster [DBG] pgmap v828: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: audit 2024-09-17T09:05:19.309408+0000 mon.a (mon.0) 3022 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:05:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: cluster 2024-09-17T09:05:19.309584+0000 mon.a (mon.0) 3023 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-09-17T09:05:19.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[24812]: audit 2024-09-17T09:05:19.312370+0000 mon.a (mon.0) 3024 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:20.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:05:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:05:20.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[22670]: audit 2024-09-17T09:05:19.844016+0000 mgr.y (mgr.14532) 531 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:20.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[22670]: audit 2024-09-17T09:05:20.311331+0000 mon.a (mon.0) 3025 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:20.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[22670]: cluster 2024-09-17T09:05:20.311498+0000 mon.a (mon.0) 3026 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-09-17T09:05:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[22670]: audit 2024-09-17T09:05:20.312867+0000 mon.a (mon.0) 3027 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[32124]: audit 2024-09-17T09:05:19.844016+0000 mgr.y (mgr.14532) 531 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[32124]: audit 2024-09-17T09:05:20.311331+0000 mon.a (mon.0) 3025 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[32124]: cluster 2024-09-17T09:05:20.311498+0000 mon.a (mon.0) 3026 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-09-17T09:05:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:20 smithi078 bash[32124]: audit 2024-09-17T09:05:20.312867+0000 mon.a (mon.0) 3027 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:20.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:20 smithi136 bash[24812]: audit 2024-09-17T09:05:19.844016+0000 mgr.y (mgr.14532) 531 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:20.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:20 smithi136 bash[24812]: audit 2024-09-17T09:05:20.311331+0000 mon.a (mon.0) 3025 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:20.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:20 smithi136 bash[24812]: cluster 2024-09-17T09:05:20.311498+0000 mon.a (mon.0) 3026 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-09-17T09:05:20.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:20 smithi136 bash[24812]: audit 2024-09-17T09:05:20.312867+0000 mon.a (mon.0) 3027 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[22670]: cluster 2024-09-17T09:05:21.100629+0000 mgr.y (mgr.14532) 532 : cluster [DBG] pgmap v831: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:21.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[22670]: cluster 2024-09-17T09:05:21.304485+0000 mon.a (mon.0) 3028 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[22670]: audit 2024-09-17T09:05:21.314914+0000 mon.a (mon.0) 3029 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[22670]: cluster 2024-09-17T09:05:21.315098+0000 mon.a (mon.0) 3030 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[22670]: audit 2024-09-17T09:05:21.316890+0000 mon.a (mon.0) 3031 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[32124]: cluster 2024-09-17T09:05:21.100629+0000 mgr.y (mgr.14532) 532 : cluster [DBG] pgmap v831: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[32124]: cluster 2024-09-17T09:05:21.304485+0000 mon.a (mon.0) 3028 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[32124]: audit 2024-09-17T09:05:21.314914+0000 mon.a (mon.0) 3029 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[32124]: cluster 2024-09-17T09:05:21.315098+0000 mon.a (mon.0) 3030 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-09-17T09:05:21.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:21 smithi078 bash[32124]: audit 2024-09-17T09:05:21.316890+0000 mon.a (mon.0) 3031 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-17T09:05:21.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:21 smithi136 bash[24812]: cluster 2024-09-17T09:05:21.100629+0000 mgr.y (mgr.14532) 532 : cluster [DBG] pgmap v831: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:21.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:21 smithi136 bash[24812]: cluster 2024-09-17T09:05:21.304485+0000 mon.a (mon.0) 3028 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:21.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:21 smithi136 bash[24812]: audit 2024-09-17T09:05:21.314914+0000 mon.a (mon.0) 3029 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:05:21.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:21 smithi136 bash[24812]: cluster 2024-09-17T09:05:21.315098+0000 mon.a (mon.0) 3030 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-09-17T09:05:21.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:21 smithi136 bash[24812]: audit 2024-09-17T09:05:21.316890+0000 mon.a (mon.0) 3031 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-17T09:05:23.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[22670]: audit 2024-09-17T09:05:22.322841+0000 mon.a (mon.0) 3032 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-17T09:05:23.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[22670]: cluster 2024-09-17T09:05:22.323043+0000 mon.a (mon.0) 3033 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-09-17T09:05:23.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[22670]: audit 2024-09-17T09:05:22.384183+0000 mon.a (mon.0) 3034 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:23.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[22670]: cluster 2024-09-17T09:05:23.102847+0000 mgr.y (mgr.14532) 533 : cluster [DBG] pgmap v834: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T09:05:23.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[32124]: audit 2024-09-17T09:05:22.322841+0000 mon.a (mon.0) 3032 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-17T09:05:23.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[32124]: cluster 2024-09-17T09:05:22.323043+0000 mon.a (mon.0) 3033 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-09-17T09:05:23.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[32124]: audit 2024-09-17T09:05:22.384183+0000 mon.a (mon.0) 3034 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:23.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:23 smithi078 bash[32124]: cluster 2024-09-17T09:05:23.102847+0000 mgr.y (mgr.14532) 533 : cluster [DBG] pgmap v834: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T09:05:23.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:23 smithi136 bash[24812]: audit 2024-09-17T09:05:22.322841+0000 mon.a (mon.0) 3032 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-17T09:05:23.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:23 smithi136 bash[24812]: cluster 2024-09-17T09:05:22.323043+0000 mon.a (mon.0) 3033 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-09-17T09:05:23.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:23 smithi136 bash[24812]: audit 2024-09-17T09:05:22.384183+0000 mon.a (mon.0) 3034 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:23.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:23 smithi136 bash[24812]: cluster 2024-09-17T09:05:23.102847+0000 mgr.y (mgr.14532) 533 : cluster [DBG] pgmap v834: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T09:05:24.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:24 smithi078 bash[22670]: audit 2024-09-17T09:05:23.329718+0000 mon.a (mon.0) 3035 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:05:24.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:24 smithi078 bash[22670]: cluster 2024-09-17T09:05:23.329874+0000 mon.a (mon.0) 3036 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-09-17T09:05:24.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:24 smithi078 bash[22670]: audit 2024-09-17T09:05:23.331604+0000 mon.a (mon.0) 3037 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100"}]: dispatch 2024-09-17T09:05:24.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:24 smithi078 bash[32124]: audit 2024-09-17T09:05:23.329718+0000 mon.a (mon.0) 3035 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:05:24.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:24 smithi078 bash[32124]: cluster 2024-09-17T09:05:23.329874+0000 mon.a (mon.0) 3036 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-09-17T09:05:24.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:24 smithi078 bash[32124]: audit 2024-09-17T09:05:23.331604+0000 mon.a (mon.0) 3037 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100"}]: dispatch 2024-09-17T09:05:24.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:24 smithi136 bash[24812]: audit 2024-09-17T09:05:23.329718+0000 mon.a (mon.0) 3035 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]': finished 2024-09-17T09:05:24.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:24 smithi136 bash[24812]: cluster 2024-09-17T09:05:23.329874+0000 mon.a (mon.0) 3036 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-09-17T09:05:24.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:24 smithi136 bash[24812]: audit 2024-09-17T09:05:23.331604+0000 mon.a (mon.0) 3037 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100"}]: dispatch 2024-09-17T09:05:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:25 smithi078 bash[32124]: audit 2024-09-17T09:05:24.330860+0000 mon.a (mon.0) 3038 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100"}]': finished 2024-09-17T09:05:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:25 smithi078 bash[32124]: cluster 2024-09-17T09:05:24.331091+0000 mon.a (mon.0) 3039 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-09-17T09:05:25.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:25 smithi078 bash[32124]: cluster 2024-09-17T09:05:25.103753+0000 mgr.y (mgr.14532) 534 : cluster [DBG] pgmap v837: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T09:05:25.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:25 smithi078 bash[22670]: audit 2024-09-17T09:05:24.330860+0000 mon.a (mon.0) 3038 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100"}]': finished 2024-09-17T09:05:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:25 smithi078 bash[22670]: cluster 2024-09-17T09:05:24.331091+0000 mon.a (mon.0) 3039 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-09-17T09:05:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:25 smithi078 bash[22670]: cluster 2024-09-17T09:05:25.103753+0000 mgr.y (mgr.14532) 534 : cluster [DBG] pgmap v837: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T09:05:25.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:25 smithi136 bash[24812]: audit 2024-09-17T09:05:24.330860+0000 mon.a (mon.0) 3038 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-100"}]': finished 2024-09-17T09:05:25.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:25 smithi136 bash[24812]: cluster 2024-09-17T09:05:24.331091+0000 mon.a (mon.0) 3039 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-09-17T09:05:25.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:25 smithi136 bash[24812]: cluster 2024-09-17T09:05:25.103753+0000 mgr.y (mgr.14532) 534 : cluster [DBG] pgmap v837: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T09:05:26.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:26 smithi136 bash[24812]: cluster 2024-09-17T09:05:25.354073+0000 mon.a (mon.0) 3040 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-09-17T09:05:26.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:26 smithi136 bash[24812]: audit 2024-09-17T09:05:26.098864+0000 mon.a (mon.0) 3041 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:26.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:26 smithi078 bash[32124]: cluster 2024-09-17T09:05:25.354073+0000 mon.a (mon.0) 3040 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-09-17T09:05:26.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:26 smithi078 bash[32124]: audit 2024-09-17T09:05:26.098864+0000 mon.a (mon.0) 3041 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:26.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:26 smithi078 bash[22670]: cluster 2024-09-17T09:05:25.354073+0000 mon.a (mon.0) 3040 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-09-17T09:05:26.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:26 smithi078 bash[22670]: audit 2024-09-17T09:05:26.098864+0000 mon.a (mon.0) 3041 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:27.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:27 smithi136 bash[24812]: cluster 2024-09-17T09:05:26.367814+0000 mon.a (mon.0) 3042 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-09-17T09:05:27.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:27 smithi136 bash[24812]: audit 2024-09-17T09:05:26.378386+0000 mon.a (mon.0) 3043 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:27.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:27 smithi136 bash[24812]: cluster 2024-09-17T09:05:27.104614+0000 mgr.y (mgr.14532) 535 : cluster [DBG] pgmap v840: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:27.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:27 smithi136 bash[24812]: audit 2024-09-17T09:05:27.360325+0000 mon.a (mon.0) 3044 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:27.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:27 smithi136 bash[24812]: cluster 2024-09-17T09:05:27.360582+0000 mon.a (mon.0) 3045 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-09-17T09:05:27.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:27 smithi136 bash[24812]: audit 2024-09-17T09:05:27.365026+0000 mon.a (mon.0) 3046 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:05:27.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[22670]: cluster 2024-09-17T09:05:26.367814+0000 mon.a (mon.0) 3042 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-09-17T09:05:27.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[22670]: audit 2024-09-17T09:05:26.378386+0000 mon.a (mon.0) 3043 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[22670]: cluster 2024-09-17T09:05:27.104614+0000 mgr.y (mgr.14532) 535 : cluster [DBG] pgmap v840: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[22670]: audit 2024-09-17T09:05:27.360325+0000 mon.a (mon.0) 3044 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[22670]: cluster 2024-09-17T09:05:27.360582+0000 mon.a (mon.0) 3045 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[22670]: audit 2024-09-17T09:05:27.365026+0000 mon.a (mon.0) 3046 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[32124]: cluster 2024-09-17T09:05:26.367814+0000 mon.a (mon.0) 3042 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[32124]: audit 2024-09-17T09:05:26.378386+0000 mon.a (mon.0) 3043 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[32124]: cluster 2024-09-17T09:05:27.104614+0000 mgr.y (mgr.14532) 535 : cluster [DBG] pgmap v840: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[32124]: audit 2024-09-17T09:05:27.360325+0000 mon.a (mon.0) 3044 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[32124]: cluster 2024-09-17T09:05:27.360582+0000 mon.a (mon.0) 3045 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-09-17T09:05:27.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[32124]: audit 2024-09-17T09:05:27.365026+0000 mon.a (mon.0) 3046 : audit [DBG] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-17T09:05:28.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:05:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:05:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:05:28.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:28 smithi136 bash[24812]: cluster 2024-09-17T09:05:27.379488+0000 mon.a (mon.0) 3047 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:28.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:28 smithi136 bash[24812]: audit 2024-09-17T09:05:27.386432+0000 mon.a (mon.0) 3048 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:05:28.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:28 smithi136 bash[24812]: audit 2024-09-17T09:05:28.363123+0000 mon.a (mon.0) 3049 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:05:28.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:28 smithi136 bash[24812]: cluster 2024-09-17T09:05:28.363326+0000 mon.a (mon.0) 3050 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-09-17T09:05:28.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:28 smithi136 bash[24812]: audit 2024-09-17T09:05:28.364462+0000 mon.a (mon.0) 3051 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:05:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[22670]: cluster 2024-09-17T09:05:27.379488+0000 mon.a (mon.0) 3047 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[22670]: audit 2024-09-17T09:05:27.386432+0000 mon.a (mon.0) 3048 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:05:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[22670]: audit 2024-09-17T09:05:28.363123+0000 mon.a (mon.0) 3049 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:05:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[22670]: cluster 2024-09-17T09:05:28.363326+0000 mon.a (mon.0) 3050 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-09-17T09:05:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[22670]: audit 2024-09-17T09:05:28.364462+0000 mon.a (mon.0) 3051 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:05:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[32124]: cluster 2024-09-17T09:05:27.379488+0000 mon.a (mon.0) 3047 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[32124]: audit 2024-09-17T09:05:27.386432+0000 mon.a (mon.0) 3048 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-17T09:05:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[32124]: audit 2024-09-17T09:05:28.363123+0000 mon.a (mon.0) 3049 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-17T09:05:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[32124]: cluster 2024-09-17T09:05:28.363326+0000 mon.a (mon.0) 3050 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-09-17T09:05:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:28 smithi078 bash[32124]: audit 2024-09-17T09:05:28.364462+0000 mon.a (mon.0) 3051 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-17T09:05:29.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:29 smithi136 bash[24812]: cluster 2024-09-17T09:05:29.105509+0000 mgr.y (mgr.14532) 536 : cluster [DBG] pgmap v843: 228 pgs: 228 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:29.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:29 smithi136 bash[24812]: audit 2024-09-17T09:05:29.364644+0000 mon.a (mon.0) 3052 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:05:29.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:29 smithi136 bash[24812]: cluster 2024-09-17T09:05:29.364821+0000 mon.a (mon.0) 3053 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-09-17T09:05:29.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:29 smithi136 bash[24812]: audit 2024-09-17T09:05:29.366737+0000 mon.a (mon.0) 3054 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:05:29.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[22670]: cluster 2024-09-17T09:05:29.105509+0000 mgr.y (mgr.14532) 536 : cluster [DBG] pgmap v843: 228 pgs: 228 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:29.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[22670]: audit 2024-09-17T09:05:29.364644+0000 mon.a (mon.0) 3052 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:05:29.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[22670]: cluster 2024-09-17T09:05:29.364821+0000 mon.a (mon.0) 3053 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-09-17T09:05:29.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[22670]: audit 2024-09-17T09:05:29.366737+0000 mon.a (mon.0) 3054 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:05:29.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[32124]: cluster 2024-09-17T09:05:29.105509+0000 mgr.y (mgr.14532) 536 : cluster [DBG] pgmap v843: 228 pgs: 228 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:29.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[32124]: audit 2024-09-17T09:05:29.364644+0000 mon.a (mon.0) 3052 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-17T09:05:29.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[32124]: cluster 2024-09-17T09:05:29.364821+0000 mon.a (mon.0) 3053 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-09-17T09:05:29.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:29 smithi078 bash[32124]: audit 2024-09-17T09:05:29.366737+0000 mon.a (mon.0) 3054 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-17T09:05:30.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:05:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:05:30.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:30 smithi136 bash[24812]: audit 2024-09-17T09:05:29.855517+0000 mgr.y (mgr.14532) 537 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:30.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:30 smithi136 bash[24812]: audit 2024-09-17T09:05:30.367416+0000 mon.a (mon.0) 3055 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:05:30.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:30 smithi136 bash[24812]: cluster 2024-09-17T09:05:30.367530+0000 mon.a (mon.0) 3056 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-09-17T09:05:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:30 smithi078 bash[22670]: audit 2024-09-17T09:05:29.855517+0000 mgr.y (mgr.14532) 537 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:30 smithi078 bash[22670]: audit 2024-09-17T09:05:30.367416+0000 mon.a (mon.0) 3055 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:05:30.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:30 smithi078 bash[22670]: cluster 2024-09-17T09:05:30.367530+0000 mon.a (mon.0) 3056 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-09-17T09:05:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:30 smithi078 bash[32124]: audit 2024-09-17T09:05:29.855517+0000 mgr.y (mgr.14532) 537 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:30 smithi078 bash[32124]: audit 2024-09-17T09:05:30.367416+0000 mon.a (mon.0) 3055 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-17T09:05:30.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:30 smithi078 bash[32124]: cluster 2024-09-17T09:05:30.367530+0000 mon.a (mon.0) 3056 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-09-17T09:05:31.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:31 smithi136 bash[24812]: audit 2024-09-17T09:05:30.431583+0000 mon.a (mon.0) 3057 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:31.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:31 smithi136 bash[24812]: audit 2024-09-17T09:05:30.432637+0000 mon.a (mon.0) 3058 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-102"}]: dispatch 2024-09-17T09:05:31.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:31 smithi136 bash[24812]: cluster 2024-09-17T09:05:31.106342+0000 mgr.y (mgr.14532) 538 : cluster [DBG] pgmap v846: 228 pgs: 228 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:31.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:31 smithi078 bash[22670]: audit 2024-09-17T09:05:30.431583+0000 mon.a (mon.0) 3057 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:31.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:31 smithi078 bash[22670]: audit 2024-09-17T09:05:30.432637+0000 mon.a (mon.0) 3058 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-102"}]: dispatch 2024-09-17T09:05:31.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:31 smithi078 bash[22670]: cluster 2024-09-17T09:05:31.106342+0000 mgr.y (mgr.14532) 538 : cluster [DBG] pgmap v846: 228 pgs: 228 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:31.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:31 smithi078 bash[32124]: audit 2024-09-17T09:05:30.431583+0000 mon.a (mon.0) 3057 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-6"}]: dispatch 2024-09-17T09:05:31.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:31 smithi078 bash[32124]: audit 2024-09-17T09:05:30.432637+0000 mon.a (mon.0) 3058 : audit [INF] from='client.? 172.21.15.78:0/3742145732' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-6", "tierpool": "test-rados-api-smithi078-64852-102"}]: dispatch 2024-09-17T09:05:31.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:31 smithi078 bash[32124]: cluster 2024-09-17T09:05:31.106342+0000 mgr.y (mgr.14532) 538 : cluster [DBG] pgmap v846: 228 pgs: 228 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:32.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:32 smithi136 bash[24812]: cluster 2024-09-17T09:05:31.442903+0000 mon.a (mon.0) 3059 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-09-17T09:05:32.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:32 smithi136 bash[24812]: audit 2024-09-17T09:05:32.136957+0000 mon.a (mon.0) 3060 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:05:32.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:32 smithi078 bash[22670]: cluster 2024-09-17T09:05:31.442903+0000 mon.a (mon.0) 3059 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-09-17T09:05:32.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:32 smithi078 bash[22670]: audit 2024-09-17T09:05:32.136957+0000 mon.a (mon.0) 3060 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:05:32.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:32 smithi078 bash[32124]: cluster 2024-09-17T09:05:31.442903+0000 mon.a (mon.0) 3059 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-09-17T09:05:32.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:32 smithi078 bash[32124]: audit 2024-09-17T09:05:32.136957+0000 mon.a (mon.0) 3060 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:05:33.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: cluster 2024-09-17T09:05:32.447430+0000 mon.a (mon.0) 3061 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-09-17T09:05:33.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.486527+0000 mon.c (mon.2) 289 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.486850+0000 mon.a (mon.0) 3062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.487832+0000 mon.c (mon.2) 290 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.488127+0000 mon.a (mon.0) 3063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.488544+0000 mon.c (mon.2) 291 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.488796+0000 mon.a (mon.0) 3064 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.707899+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.709487+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: audit 2024-09-17T09:05:32.716731+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: cluster 2024-09-17T09:05:32.808790+0000 mon.a (mon.0) 3068 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:33 smithi136 bash[24812]: cluster 2024-09-17T09:05:33.108029+0000 mgr.y (mgr.14532) 539 : cluster [DBG] pgmap v849: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: cluster 2024-09-17T09:05:32.447430+0000 mon.a (mon.0) 3061 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-09-17T09:05:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.486527+0000 mon.c (mon.2) 289 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.486850+0000 mon.a (mon.0) 3062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.487832+0000 mon.c (mon.2) 290 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.488127+0000 mon.a (mon.0) 3063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.488544+0000 mon.c (mon.2) 291 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.488796+0000 mon.a (mon.0) 3064 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.707899+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.709487+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: audit 2024-09-17T09:05:32.716731+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: cluster 2024-09-17T09:05:32.808790+0000 mon.a (mon.0) 3068 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[22670]: cluster 2024-09-17T09:05:33.108029+0000 mgr.y (mgr.14532) 539 : cluster [DBG] pgmap v849: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: cluster 2024-09-17T09:05:32.447430+0000 mon.a (mon.0) 3061 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-09-17T09:05:33.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.486527+0000 mon.c (mon.2) 289 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.486850+0000 mon.a (mon.0) 3062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.487832+0000 mon.c (mon.2) 290 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.856 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.488127+0000 mon.a (mon.0) 3063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:33.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.488544+0000 mon.c (mon.2) 291 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:33.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.488796+0000 mon.a (mon.0) 3064 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:33.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.707899+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:05:33.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.709487+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:05:33.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: audit 2024-09-17T09:05:32.716731+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:05:33.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: cluster 2024-09-17T09:05:32.808790+0000 mon.a (mon.0) 3068 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:33.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:33 smithi078 bash[32124]: cluster 2024-09-17T09:05:33.108029+0000 mgr.y (mgr.14532) 539 : cluster [DBG] pgmap v849: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:35.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:34 smithi136 bash[24812]: audit 2024-09-17T09:05:33.473534+0000 mon.a (mon.0) 3069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:05:35.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:34 smithi136 bash[24812]: cluster 2024-09-17T09:05:33.473747+0000 mon.a (mon.0) 3070 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-09-17T09:05:35.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:34 smithi136 bash[24812]: audit 2024-09-17T09:05:33.480350+0000 mon.c (mon.2) 292 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:35.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:34 smithi136 bash[24812]: audit 2024-09-17T09:05:33.480994+0000 mon.a (mon.0) 3071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:35.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[22670]: audit 2024-09-17T09:05:33.473534+0000 mon.a (mon.0) 3069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:05:35.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[22670]: cluster 2024-09-17T09:05:33.473747+0000 mon.a (mon.0) 3070 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-09-17T09:05:35.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[22670]: audit 2024-09-17T09:05:33.480350+0000 mon.c (mon.2) 292 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:35.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[22670]: audit 2024-09-17T09:05:33.480994+0000 mon.a (mon.0) 3071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:35.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[32124]: audit 2024-09-17T09:05:33.473534+0000 mon.a (mon.0) 3069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:05:35.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[32124]: cluster 2024-09-17T09:05:33.473747+0000 mon.a (mon.0) 3070 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-09-17T09:05:35.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[32124]: audit 2024-09-17T09:05:33.480350+0000 mon.c (mon.2) 292 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:35.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:34 smithi078 bash[32124]: audit 2024-09-17T09:05:33.480994+0000 mon.a (mon.0) 3071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:05:36.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:35 smithi136 bash[24812]: cluster 2024-09-17T09:05:34.916923+0000 mon.a (mon.0) 3072 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-09-17T09:05:36.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:35 smithi136 bash[24812]: cluster 2024-09-17T09:05:35.108801+0000 mgr.y (mgr.14532) 540 : cluster [DBG] pgmap v852: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:36.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:35 smithi136 bash[24812]: audit 2024-09-17T09:05:35.480170+0000 mon.a (mon.0) 3073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:05:36.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:35 smithi136 bash[24812]: cluster 2024-09-17T09:05:35.480423+0000 mon.a (mon.0) 3074 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-09-17T09:05:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[22670]: cluster 2024-09-17T09:05:34.916923+0000 mon.a (mon.0) 3072 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-09-17T09:05:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[22670]: cluster 2024-09-17T09:05:35.108801+0000 mgr.y (mgr.14532) 540 : cluster [DBG] pgmap v852: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[22670]: audit 2024-09-17T09:05:35.480170+0000 mon.a (mon.0) 3073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:05:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[22670]: cluster 2024-09-17T09:05:35.480423+0000 mon.a (mon.0) 3074 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-09-17T09:05:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[32124]: cluster 2024-09-17T09:05:34.916923+0000 mon.a (mon.0) 3072 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-09-17T09:05:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[32124]: cluster 2024-09-17T09:05:35.108801+0000 mgr.y (mgr.14532) 540 : cluster [DBG] pgmap v852: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[32124]: audit 2024-09-17T09:05:35.480170+0000 mon.a (mon.0) 3073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi078-64852-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:05:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:35 smithi078 bash[32124]: cluster 2024-09-17T09:05:35.480423+0000 mon.a (mon.0) 3074 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-09-17T09:05:37.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:37 smithi136 bash[24812]: cluster 2024-09-17T09:05:36.486974+0000 mon.a (mon.0) 3075 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-09-17T09:05:37.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:37 smithi136 bash[24812]: cluster 2024-09-17T09:05:37.109612+0000 mgr.y (mgr.14532) 541 : cluster [DBG] pgmap v855: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:37 smithi078 bash[22670]: cluster 2024-09-17T09:05:36.486974+0000 mon.a (mon.0) 3075 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-09-17T09:05:37.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:37 smithi078 bash[22670]: cluster 2024-09-17T09:05:37.109612+0000 mgr.y (mgr.14532) 541 : cluster [DBG] pgmap v855: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:37.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:37 smithi078 bash[32124]: cluster 2024-09-17T09:05:36.486974+0000 mon.a (mon.0) 3075 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-09-17T09:05:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:37 smithi078 bash[32124]: cluster 2024-09-17T09:05:37.109612+0000 mgr.y (mgr.14532) 541 : cluster [DBG] pgmap v855: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:05:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:05:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:05:38.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:38 smithi136 bash[24812]: cluster 2024-09-17T09:05:37.499795+0000 mon.a (mon.0) 3076 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-09-17T09:05:38.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:38 smithi136 bash[24812]: audit 2024-09-17T09:05:37.502096+0000 mon.c (mon.2) 293 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:38.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:38 smithi136 bash[24812]: audit 2024-09-17T09:05:37.503247+0000 mon.a (mon.0) 3077 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:38.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:38 smithi136 bash[24812]: cluster 2024-09-17T09:05:37.812156+0000 mon.a (mon.0) 3078 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[22670]: cluster 2024-09-17T09:05:37.499795+0000 mon.a (mon.0) 3076 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-09-17T09:05:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[22670]: audit 2024-09-17T09:05:37.502096+0000 mon.c (mon.2) 293 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[22670]: audit 2024-09-17T09:05:37.503247+0000 mon.a (mon.0) 3077 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:38.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[22670]: cluster 2024-09-17T09:05:37.812156+0000 mon.a (mon.0) 3078 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:38.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[32124]: cluster 2024-09-17T09:05:37.499795+0000 mon.a (mon.0) 3076 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-09-17T09:05:38.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[32124]: audit 2024-09-17T09:05:37.502096+0000 mon.c (mon.2) 293 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:38.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[32124]: audit 2024-09-17T09:05:37.503247+0000 mon.a (mon.0) 3077 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:38.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:38 smithi078 bash[32124]: cluster 2024-09-17T09:05:37.812156+0000 mon.a (mon.0) 3078 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:39.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:39 smithi136 bash[24812]: audit 2024-09-17T09:05:38.499628+0000 mon.a (mon.0) 3079 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:39.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:39 smithi136 bash[24812]: cluster 2024-09-17T09:05:38.500173+0000 mon.a (mon.0) 3080 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-09-17T09:05:39.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:39 smithi136 bash[24812]: cluster 2024-09-17T09:05:39.110403+0000 mgr.y (mgr.14532) 542 : cluster [DBG] pgmap v858: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:39.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:39 smithi078 bash[32124]: audit 2024-09-17T09:05:38.499628+0000 mon.a (mon.0) 3079 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:39.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:39 smithi078 bash[32124]: cluster 2024-09-17T09:05:38.500173+0000 mon.a (mon.0) 3080 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-09-17T09:05:39.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:39 smithi078 bash[32124]: cluster 2024-09-17T09:05:39.110403+0000 mgr.y (mgr.14532) 542 : cluster [DBG] pgmap v858: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:39.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:39 smithi078 bash[22670]: audit 2024-09-17T09:05:38.499628+0000 mon.a (mon.0) 3079 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:39.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:39 smithi078 bash[22670]: cluster 2024-09-17T09:05:38.500173+0000 mon.a (mon.0) 3080 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-09-17T09:05:39.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:39 smithi078 bash[22670]: cluster 2024-09-17T09:05:39.110403+0000 mgr.y (mgr.14532) 542 : cluster [DBG] pgmap v858: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:40.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:05:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:05:40.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[22670]: cluster 2024-09-17T09:05:39.540790+0000 mon.a (mon.0) 3081 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-09-17T09:05:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[22670]: audit 2024-09-17T09:05:39.543924+0000 mon.c (mon.2) 294 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[22670]: audit 2024-09-17T09:05:39.544973+0000 mon.a (mon.0) 3082 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[22670]: audit 2024-09-17T09:05:39.867039+0000 mgr.y (mgr.14532) 543 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:40.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[32124]: cluster 2024-09-17T09:05:39.540790+0000 mon.a (mon.0) 3081 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-09-17T09:05:40.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[32124]: audit 2024-09-17T09:05:39.543924+0000 mon.c (mon.2) 294 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[32124]: audit 2024-09-17T09:05:39.544973+0000 mon.a (mon.0) 3082 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:40 smithi078 bash[32124]: audit 2024-09-17T09:05:39.867039+0000 mgr.y (mgr.14532) 543 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:41.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:40 smithi136 bash[24812]: cluster 2024-09-17T09:05:39.540790+0000 mon.a (mon.0) 3081 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-09-17T09:05:41.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:40 smithi136 bash[24812]: audit 2024-09-17T09:05:39.543924+0000 mon.c (mon.2) 294 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:41.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:40 smithi136 bash[24812]: audit 2024-09-17T09:05:39.544973+0000 mon.a (mon.0) 3082 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:41.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:40 smithi136 bash[24812]: audit 2024-09-17T09:05:39.867039+0000 mgr.y (mgr.14532) 543 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: audit 2024-09-17T09:05:40.536459+0000 mon.a (mon.0) 3083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: cluster 2024-09-17T09:05:40.537232+0000 mon.a (mon.0) 3084 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: audit 2024-09-17T09:05:40.541668+0000 mon.c (mon.2) 295 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: audit 2024-09-17T09:05:40.542740+0000 mon.a (mon.0) 3085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: cluster 2024-09-17T09:05:41.111246+0000 mgr.y (mgr.14532) 544 : cluster [DBG] pgmap v861: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: audit 2024-09-17T09:05:41.127544+0000 mon.a (mon.0) 3086 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: audit 2024-09-17T09:05:41.541621+0000 mon.a (mon.0) 3087 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[22670]: cluster 2024-09-17T09:05:41.541844+0000 mon.a (mon.0) 3088 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: audit 2024-09-17T09:05:40.536459+0000 mon.a (mon.0) 3083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: cluster 2024-09-17T09:05:40.537232+0000 mon.a (mon.0) 3084 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: audit 2024-09-17T09:05:40.541668+0000 mon.c (mon.2) 295 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: audit 2024-09-17T09:05:40.542740+0000 mon.a (mon.0) 3085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: cluster 2024-09-17T09:05:41.111246+0000 mgr.y (mgr.14532) 544 : cluster [DBG] pgmap v861: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: audit 2024-09-17T09:05:41.127544+0000 mon.a (mon.0) 3086 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: audit 2024-09-17T09:05:41.541621+0000 mon.a (mon.0) 3087 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:41 smithi078 bash[32124]: cluster 2024-09-17T09:05:41.541844+0000 mon.a (mon.0) 3088 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-09-17T09:05:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: audit 2024-09-17T09:05:40.536459+0000 mon.a (mon.0) 3083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: cluster 2024-09-17T09:05:40.537232+0000 mon.a (mon.0) 3084 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-09-17T09:05:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: audit 2024-09-17T09:05:40.541668+0000 mon.c (mon.2) 295 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:42.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: audit 2024-09-17T09:05:40.542740+0000 mon.a (mon.0) 3085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: cluster 2024-09-17T09:05:41.111246+0000 mgr.y (mgr.14532) 544 : cluster [DBG] pgmap v861: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:05:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: audit 2024-09-17T09:05:41.127544+0000 mon.a (mon.0) 3086 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: audit 2024-09-17T09:05:41.541621+0000 mon.a (mon.0) 3087 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:42.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:41 smithi136 bash[24812]: cluster 2024-09-17T09:05:41.541844+0000 mon.a (mon.0) 3088 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-09-17T09:05:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[22670]: audit 2024-09-17T09:05:41.543484+0000 mon.c (mon.2) 296 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:42.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[22670]: audit 2024-09-17T09:05:41.544941+0000 mon.a (mon.0) 3089 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:42.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[22670]: audit 2024-09-17T09:05:42.541684+0000 mon.a (mon.0) 3090 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:42.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[22670]: cluster 2024-09-17T09:05:42.541873+0000 mon.a (mon.0) 3091 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-09-17T09:05:42.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[32124]: audit 2024-09-17T09:05:41.543484+0000 mon.c (mon.2) 296 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:42.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[32124]: audit 2024-09-17T09:05:41.544941+0000 mon.a (mon.0) 3089 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:42.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[32124]: audit 2024-09-17T09:05:42.541684+0000 mon.a (mon.0) 3090 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:42.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:42 smithi078 bash[32124]: cluster 2024-09-17T09:05:42.541873+0000 mon.a (mon.0) 3091 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-09-17T09:05:43.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:42 smithi136 bash[24812]: audit 2024-09-17T09:05:41.543484+0000 mon.c (mon.2) 296 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:43.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:42 smithi136 bash[24812]: audit 2024-09-17T09:05:41.544941+0000 mon.a (mon.0) 3089 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:43.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:42 smithi136 bash[24812]: audit 2024-09-17T09:05:42.541684+0000 mon.a (mon.0) 3090 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-107", "overlaypool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:43.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:42 smithi136 bash[24812]: cluster 2024-09-17T09:05:42.541873+0000 mon.a (mon.0) 3091 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-09-17T09:05:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[22670]: audit 2024-09-17T09:05:42.544686+0000 mon.c (mon.2) 297 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[22670]: audit 2024-09-17T09:05:42.548066+0000 mon.a (mon.0) 3092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[22670]: cluster 2024-09-17T09:05:43.113385+0000 mgr.y (mgr.14532) 545 : cluster [DBG] pgmap v864: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:43.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[22670]: cluster 2024-09-17T09:05:43.535212+0000 mon.a (mon.0) 3093 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:43.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[32124]: audit 2024-09-17T09:05:42.544686+0000 mon.c (mon.2) 297 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:43.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[32124]: audit 2024-09-17T09:05:42.548066+0000 mon.a (mon.0) 3092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:43.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[32124]: cluster 2024-09-17T09:05:43.113385+0000 mgr.y (mgr.14532) 545 : cluster [DBG] pgmap v864: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:43.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:43 smithi078 bash[32124]: cluster 2024-09-17T09:05:43.535212+0000 mon.a (mon.0) 3093 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:43 smithi136 bash[24812]: audit 2024-09-17T09:05:42.544686+0000 mon.c (mon.2) 297 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:43 smithi136 bash[24812]: audit 2024-09-17T09:05:42.548066+0000 mon.a (mon.0) 3092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:43 smithi136 bash[24812]: cluster 2024-09-17T09:05:43.113385+0000 mgr.y (mgr.14532) 545 : cluster [DBG] pgmap v864: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:44.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:43 smithi136 bash[24812]: cluster 2024-09-17T09:05:43.535212+0000 mon.a (mon.0) 3093 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:44.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[22670]: audit 2024-09-17T09:05:43.548850+0000 mon.a (mon.0) 3094 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]': finished 2024-09-17T09:05:44.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[22670]: cluster 2024-09-17T09:05:43.549226+0000 mon.a (mon.0) 3095 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-09-17T09:05:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[22670]: audit 2024-09-17T09:05:43.596037+0000 mon.c (mon.2) 298 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]: dispatch 2024-09-17T09:05:44.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[22670]: audit 2024-09-17T09:05:43.596640+0000 mon.a (mon.0) 3096 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]: dispatch 2024-09-17T09:05:44.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[32124]: audit 2024-09-17T09:05:43.548850+0000 mon.a (mon.0) 3094 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]': finished 2024-09-17T09:05:44.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[32124]: cluster 2024-09-17T09:05:43.549226+0000 mon.a (mon.0) 3095 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-09-17T09:05:44.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[32124]: audit 2024-09-17T09:05:43.596037+0000 mon.c (mon.2) 298 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]: dispatch 2024-09-17T09:05:44.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:44 smithi078 bash[32124]: audit 2024-09-17T09:05:43.596640+0000 mon.a (mon.0) 3096 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]: dispatch 2024-09-17T09:05:45.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:44 smithi136 bash[24812]: audit 2024-09-17T09:05:43.548850+0000 mon.a (mon.0) 3094 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-107-cache", "mode": "writeback"}]': finished 2024-09-17T09:05:45.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:44 smithi136 bash[24812]: cluster 2024-09-17T09:05:43.549226+0000 mon.a (mon.0) 3095 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-09-17T09:05:45.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:44 smithi136 bash[24812]: audit 2024-09-17T09:05:43.596037+0000 mon.c (mon.2) 298 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]: dispatch 2024-09-17T09:05:45.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:44 smithi136 bash[24812]: audit 2024-09-17T09:05:43.596640+0000 mon.a (mon.0) 3096 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]: dispatch 2024-09-17T09:05:45.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[22670]: audit 2024-09-17T09:05:44.573481+0000 mon.a (mon.0) 3097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]': finished 2024-09-17T09:05:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[22670]: cluster 2024-09-17T09:05:44.573740+0000 mon.a (mon.0) 3098 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-09-17T09:05:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[22670]: audit 2024-09-17T09:05:44.575305+0000 mon.c (mon.2) 299 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[22670]: audit 2024-09-17T09:05:44.576783+0000 mon.a (mon.0) 3099 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:45.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[22670]: cluster 2024-09-17T09:05:45.114217+0000 mgr.y (mgr.14532) 546 : cluster [DBG] pgmap v867: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[32124]: audit 2024-09-17T09:05:44.573481+0000 mon.a (mon.0) 3097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]': finished 2024-09-17T09:05:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[32124]: cluster 2024-09-17T09:05:44.573740+0000 mon.a (mon.0) 3098 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-09-17T09:05:45.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[32124]: audit 2024-09-17T09:05:44.575305+0000 mon.c (mon.2) 299 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[32124]: audit 2024-09-17T09:05:44.576783+0000 mon.a (mon.0) 3099 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:45.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:45 smithi078 bash[32124]: cluster 2024-09-17T09:05:45.114217+0000 mgr.y (mgr.14532) 546 : cluster [DBG] pgmap v867: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:46.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:45 smithi136 bash[24812]: audit 2024-09-17T09:05:44.573481+0000 mon.a (mon.0) 3097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-107"}]': finished 2024-09-17T09:05:46.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:45 smithi136 bash[24812]: cluster 2024-09-17T09:05:44.573740+0000 mon.a (mon.0) 3098 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-09-17T09:05:46.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:45 smithi136 bash[24812]: audit 2024-09-17T09:05:44.575305+0000 mon.c (mon.2) 299 : audit [INF] from='client.? 172.21.15.78:0/1273867933' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:46.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:45 smithi136 bash[24812]: audit 2024-09-17T09:05:44.576783+0000 mon.a (mon.0) 3099 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]: dispatch 2024-09-17T09:05:46.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:45 smithi136 bash[24812]: cluster 2024-09-17T09:05:45.114217+0000 mgr.y (mgr.14532) 546 : cluster [DBG] pgmap v867: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:46.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:46 smithi078 bash[32124]: cluster 2024-09-17T09:05:45.568026+0000 mon.a (mon.0) 3100 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:46.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:46 smithi078 bash[32124]: audit 2024-09-17T09:05:45.585182+0000 mon.a (mon.0) 3101 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:46.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:46 smithi078 bash[32124]: cluster 2024-09-17T09:05:45.585435+0000 mon.a (mon.0) 3102 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-09-17T09:05:46.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:46 smithi078 bash[22670]: cluster 2024-09-17T09:05:45.568026+0000 mon.a (mon.0) 3100 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:46.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:46 smithi078 bash[22670]: audit 2024-09-17T09:05:45.585182+0000 mon.a (mon.0) 3101 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:46.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:46 smithi078 bash[22670]: cluster 2024-09-17T09:05:45.585435+0000 mon.a (mon.0) 3102 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-09-17T09:05:47.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:46 smithi136 bash[24812]: cluster 2024-09-17T09:05:45.568026+0000 mon.a (mon.0) 3100 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:05:47.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:46 smithi136 bash[24812]: audit 2024-09-17T09:05:45.585182+0000 mon.a (mon.0) 3101 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-107", "tierpool": "test-rados-api-smithi078-64852-107-cache"}]': finished 2024-09-17T09:05:47.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:46 smithi136 bash[24812]: cluster 2024-09-17T09:05:45.585435+0000 mon.a (mon.0) 3102 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-09-17T09:05:47.919 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:47 smithi078 bash[22670]: cluster 2024-09-17T09:05:46.587317+0000 mon.a (mon.0) 3103 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-09-17T09:05:47.919 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:47 smithi078 bash[22670]: cluster 2024-09-17T09:05:47.115022+0000 mgr.y (mgr.14532) 547 : cluster [DBG] pgmap v870: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:47.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:47 smithi078 bash[32124]: cluster 2024-09-17T09:05:46.587317+0000 mon.a (mon.0) 3103 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-09-17T09:05:47.920 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:47 smithi078 bash[32124]: cluster 2024-09-17T09:05:47.115022+0000 mgr.y (mgr.14532) 547 : cluster [DBG] pgmap v870: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:48.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:47 smithi136 bash[24812]: cluster 2024-09-17T09:05:46.587317+0000 mon.a (mon.0) 3103 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-09-17T09:05:48.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:47 smithi136 bash[24812]: cluster 2024-09-17T09:05:47.115022+0000 mgr.y (mgr.14532) 547 : cluster [DBG] pgmap v870: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:48.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:05:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:05:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:05:49.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:48 smithi136 bash[24812]: cluster 2024-09-17T09:05:47.612514+0000 mon.a (mon.0) 3104 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-09-17T09:05:49.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:48 smithi136 bash[24812]: audit 2024-09-17T09:05:47.650653+0000 mon.c (mon.2) 300 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:48 smithi136 bash[24812]: audit 2024-09-17T09:05:47.651066+0000 mon.a (mon.0) 3105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:48 smithi136 bash[24812]: audit 2024-09-17T09:05:47.651841+0000 mon.c (mon.2) 301 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:48 smithi136 bash[24812]: audit 2024-09-17T09:05:47.652170+0000 mon.a (mon.0) 3106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:48 smithi136 bash[24812]: audit 2024-09-17T09:05:47.652712+0000 mon.c (mon.2) 302 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:49.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:48 smithi136 bash[24812]: audit 2024-09-17T09:05:47.652998+0000 mon.a (mon.0) 3107 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:49.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[22670]: cluster 2024-09-17T09:05:47.612514+0000 mon.a (mon.0) 3104 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-09-17T09:05:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[22670]: audit 2024-09-17T09:05:47.650653+0000 mon.c (mon.2) 300 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[22670]: audit 2024-09-17T09:05:47.651066+0000 mon.a (mon.0) 3105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[22670]: audit 2024-09-17T09:05:47.651841+0000 mon.c (mon.2) 301 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[22670]: audit 2024-09-17T09:05:47.652170+0000 mon.a (mon.0) 3106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[22670]: audit 2024-09-17T09:05:47.652712+0000 mon.c (mon.2) 302 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:49.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[22670]: audit 2024-09-17T09:05:47.652998+0000 mon.a (mon.0) 3107 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:49.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[32124]: cluster 2024-09-17T09:05:47.612514+0000 mon.a (mon.0) 3104 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-09-17T09:05:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[32124]: audit 2024-09-17T09:05:47.650653+0000 mon.c (mon.2) 300 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[32124]: audit 2024-09-17T09:05:47.651066+0000 mon.a (mon.0) 3105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[32124]: audit 2024-09-17T09:05:47.651841+0000 mon.c (mon.2) 301 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[32124]: audit 2024-09-17T09:05:47.652170+0000 mon.a (mon.0) 3106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[32124]: audit 2024-09-17T09:05:47.652712+0000 mon.c (mon.2) 302 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:49.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:48 smithi078 bash[32124]: audit 2024-09-17T09:05:47.652998+0000 mon.a (mon.0) 3107 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:05:49.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:49 smithi136 bash[24812]: audit 2024-09-17T09:05:48.613477+0000 mon.a (mon.0) 3108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:05:49.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:49 smithi136 bash[24812]: cluster 2024-09-17T09:05:48.613711+0000 mon.a (mon.0) 3109 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-09-17T09:05:49.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:49 smithi136 bash[24812]: audit 2024-09-17T09:05:48.618026+0000 mon.c (mon.2) 303 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:49 smithi136 bash[24812]: audit 2024-09-17T09:05:48.625641+0000 mon.a (mon.0) 3110 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:49 smithi136 bash[24812]: cluster 2024-09-17T09:05:49.115739+0000 mgr.y (mgr.14532) 548 : cluster [DBG] pgmap v873: 172 pgs: 172 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[22670]: audit 2024-09-17T09:05:48.613477+0000 mon.a (mon.0) 3108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:05:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[22670]: cluster 2024-09-17T09:05:48.613711+0000 mon.a (mon.0) 3109 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-09-17T09:05:50.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[22670]: audit 2024-09-17T09:05:48.618026+0000 mon.c (mon.2) 303 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[22670]: audit 2024-09-17T09:05:48.625641+0000 mon.a (mon.0) 3110 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:50.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[22670]: cluster 2024-09-17T09:05:49.115739+0000 mgr.y (mgr.14532) 548 : cluster [DBG] pgmap v873: 172 pgs: 172 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[32124]: audit 2024-09-17T09:05:48.613477+0000 mon.a (mon.0) 3108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:05:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[32124]: cluster 2024-09-17T09:05:48.613711+0000 mon.a (mon.0) 3109 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-09-17T09:05:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[32124]: audit 2024-09-17T09:05:48.618026+0000 mon.c (mon.2) 303 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[32124]: audit 2024-09-17T09:05:48.625641+0000 mon.a (mon.0) 3110 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:05:50.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:49 smithi078 bash[32124]: cluster 2024-09-17T09:05:49.115739+0000 mgr.y (mgr.14532) 548 : cluster [DBG] pgmap v873: 172 pgs: 172 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:50.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:05:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:05:51.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:50 smithi136 bash[24812]: audit 2024-09-17T09:05:49.878585+0000 mgr.y (mgr.14532) 549 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:51.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:50 smithi136 bash[24812]: cluster 2024-09-17T09:05:50.077820+0000 mon.a (mon.0) 3111 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2024-09-17T09:05:51.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:50 smithi078 bash[22670]: audit 2024-09-17T09:05:49.878585+0000 mgr.y (mgr.14532) 549 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:51.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:50 smithi078 bash[22670]: cluster 2024-09-17T09:05:50.077820+0000 mon.a (mon.0) 3111 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2024-09-17T09:05:51.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:50 smithi078 bash[32124]: audit 2024-09-17T09:05:49.878585+0000 mgr.y (mgr.14532) 549 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:05:51.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:50 smithi078 bash[32124]: cluster 2024-09-17T09:05:50.077820+0000 mon.a (mon.0) 3111 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2024-09-17T09:05:52.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:51 smithi136 bash[24812]: audit 2024-09-17T09:05:50.655059+0000 mon.a (mon.0) 3112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:05:52.147 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:51 smithi136 bash[24812]: cluster 2024-09-17T09:05:50.655314+0000 mon.a (mon.0) 3113 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2024-09-17T09:05:52.148 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:51 smithi136 bash[24812]: cluster 2024-09-17T09:05:51.116511+0000 mgr.y (mgr.14532) 550 : cluster [DBG] pgmap v876: 180 pgs: 8 unknown, 172 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:52.148 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:51 smithi078 bash[22670]: audit 2024-09-17T09:05:50.655059+0000 mon.a (mon.0) 3112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:05:52.148 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:51 smithi078 bash[22670]: cluster 2024-09-17T09:05:50.655314+0000 mon.a (mon.0) 3113 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2024-09-17T09:05:52.149 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:51 smithi078 bash[22670]: cluster 2024-09-17T09:05:51.116511+0000 mgr.y (mgr.14532) 550 : cluster [DBG] pgmap v876: 180 pgs: 8 unknown, 172 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:52.149 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:51 smithi078 bash[32124]: audit 2024-09-17T09:05:50.655059+0000 mon.a (mon.0) 3112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:05:52.149 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:51 smithi078 bash[32124]: cluster 2024-09-17T09:05:50.655314+0000 mon.a (mon.0) 3113 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2024-09-17T09:05:52.149 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:51 smithi078 bash[32124]: cluster 2024-09-17T09:05:51.116511+0000 mgr.y (mgr.14532) 550 : cluster [DBG] pgmap v876: 180 pgs: 8 unknown, 172 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:53.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:52 smithi136 bash[24812]: cluster 2024-09-17T09:05:51.645800+0000 mon.a (mon.0) 3114 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:53.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:52 smithi136 bash[24812]: cluster 2024-09-17T09:05:51.670239+0000 mon.a (mon.0) 3115 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2024-09-17T09:05:53.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:52 smithi136 bash[24812]: audit 2024-09-17T09:05:51.680597+0000 mon.c (mon.2) 304 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:53.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:52 smithi136 bash[24812]: audit 2024-09-17T09:05:51.700181+0000 mon.a (mon.0) 3116 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[22670]: cluster 2024-09-17T09:05:51.645800+0000 mon.a (mon.0) 3114 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[22670]: cluster 2024-09-17T09:05:51.670239+0000 mon.a (mon.0) 3115 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2024-09-17T09:05:53.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[22670]: audit 2024-09-17T09:05:51.680597+0000 mon.c (mon.2) 304 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:53.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[22670]: audit 2024-09-17T09:05:51.700181+0000 mon.a (mon.0) 3116 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[32124]: cluster 2024-09-17T09:05:51.645800+0000 mon.a (mon.0) 3114 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:05:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[32124]: cluster 2024-09-17T09:05:51.670239+0000 mon.a (mon.0) 3115 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2024-09-17T09:05:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[32124]: audit 2024-09-17T09:05:51.680597+0000 mon.c (mon.2) 304 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:53.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:52 smithi078 bash[32124]: audit 2024-09-17T09:05:51.700181+0000 mon.a (mon.0) 3116 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:05:54.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:53 smithi136 bash[24812]: audit 2024-09-17T09:05:52.677065+0000 mon.a (mon.0) 3117 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:54.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:53 smithi136 bash[24812]: cluster 2024-09-17T09:05:52.677336+0000 mon.a (mon.0) 3118 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2024-09-17T09:05:54.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:53 smithi136 bash[24812]: audit 2024-09-17T09:05:52.682273+0000 mon.c (mon.2) 305 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:54.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:53 smithi136 bash[24812]: audit 2024-09-17T09:05:52.686159+0000 mon.a (mon.0) 3119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:54.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:53 smithi136 bash[24812]: cluster 2024-09-17T09:05:53.118456+0000 mgr.y (mgr.14532) 551 : cluster [DBG] pgmap v879: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:54.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[22670]: audit 2024-09-17T09:05:52.677065+0000 mon.a (mon.0) 3117 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:54.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[22670]: cluster 2024-09-17T09:05:52.677336+0000 mon.a (mon.0) 3118 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[22670]: audit 2024-09-17T09:05:52.682273+0000 mon.c (mon.2) 305 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[22670]: audit 2024-09-17T09:05:52.686159+0000 mon.a (mon.0) 3119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[22670]: cluster 2024-09-17T09:05:53.118456+0000 mgr.y (mgr.14532) 551 : cluster [DBG] pgmap v879: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[32124]: audit 2024-09-17T09:05:52.677065+0000 mon.a (mon.0) 3117 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[32124]: cluster 2024-09-17T09:05:52.677336+0000 mon.a (mon.0) 3118 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[32124]: audit 2024-09-17T09:05:52.682273+0000 mon.c (mon.2) 305 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[32124]: audit 2024-09-17T09:05:52.686159+0000 mon.a (mon.0) 3119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:54.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:53 smithi078 bash[32124]: cluster 2024-09-17T09:05:53.118456+0000 mgr.y (mgr.14532) 551 : cluster [DBG] pgmap v879: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:54 smithi136 bash[24812]: audit 2024-09-17T09:05:53.691090+0000 mon.a (mon.0) 3120 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:05:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:54 smithi136 bash[24812]: cluster 2024-09-17T09:05:53.691277+0000 mon.a (mon.0) 3121 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2024-09-17T09:05:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:54 smithi136 bash[24812]: audit 2024-09-17T09:05:53.693140+0000 mon.c (mon.2) 306 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:55.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:54 smithi136 bash[24812]: audit 2024-09-17T09:05:53.694970+0000 mon.a (mon.0) 3122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[32124]: audit 2024-09-17T09:05:53.691090+0000 mon.a (mon.0) 3120 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:05:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[32124]: cluster 2024-09-17T09:05:53.691277+0000 mon.a (mon.0) 3121 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2024-09-17T09:05:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[32124]: audit 2024-09-17T09:05:53.693140+0000 mon.c (mon.2) 306 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:55.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[32124]: audit 2024-09-17T09:05:53.694970+0000 mon.a (mon.0) 3122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:55.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[22670]: audit 2024-09-17T09:05:53.691090+0000 mon.a (mon.0) 3120 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:05:55.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[22670]: cluster 2024-09-17T09:05:53.691277+0000 mon.a (mon.0) 3121 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2024-09-17T09:05:55.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[22670]: audit 2024-09-17T09:05:53.693140+0000 mon.c (mon.2) 306 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:55.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:54 smithi078 bash[22670]: audit 2024-09-17T09:05:53.694970+0000 mon.a (mon.0) 3122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:05:56.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:55 smithi136 bash[24812]: audit 2024-09-17T09:05:54.688450+0000 mon.a (mon.0) 3123 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:05:56.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:55 smithi136 bash[24812]: cluster 2024-09-17T09:05:54.688644+0000 mon.a (mon.0) 3124 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2024-09-17T09:05:56.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:55 smithi136 bash[24812]: audit 2024-09-17T09:05:54.691063+0000 mon.c (mon.2) 307 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:56.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:55 smithi136 bash[24812]: audit 2024-09-17T09:05:54.692161+0000 mon.a (mon.0) 3125 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:56.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:55 smithi136 bash[24812]: cluster 2024-09-17T09:05:55.119293+0000 mgr.y (mgr.14532) 552 : cluster [DBG] pgmap v882: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:56.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:55 smithi136 bash[24812]: cluster 2024-09-17T09:05:55.681983+0000 mon.a (mon.0) 3126 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:56.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[22670]: audit 2024-09-17T09:05:54.688450+0000 mon.a (mon.0) 3123 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:05:56.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[22670]: cluster 2024-09-17T09:05:54.688644+0000 mon.a (mon.0) 3124 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2024-09-17T09:05:56.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[22670]: audit 2024-09-17T09:05:54.691063+0000 mon.c (mon.2) 307 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[22670]: audit 2024-09-17T09:05:54.692161+0000 mon.a (mon.0) 3125 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[22670]: cluster 2024-09-17T09:05:55.119293+0000 mgr.y (mgr.14532) 552 : cluster [DBG] pgmap v882: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[22670]: cluster 2024-09-17T09:05:55.681983+0000 mon.a (mon.0) 3126 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[32124]: audit 2024-09-17T09:05:54.688450+0000 mon.a (mon.0) 3123 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-109", "overlaypool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[32124]: cluster 2024-09-17T09:05:54.688644+0000 mon.a (mon.0) 3124 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[32124]: audit 2024-09-17T09:05:54.691063+0000 mon.c (mon.2) 307 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[32124]: audit 2024-09-17T09:05:54.692161+0000 mon.a (mon.0) 3125 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]: dispatch 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[32124]: cluster 2024-09-17T09:05:55.119293+0000 mgr.y (mgr.14532) 552 : cluster [DBG] pgmap v882: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:05:56.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:55 smithi078 bash[32124]: cluster 2024-09-17T09:05:55.681983+0000 mon.a (mon.0) 3126 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:05:57.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: audit 2024-09-17T09:05:55.691048+0000 mon.a (mon.0) 3127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]': finished 2024-09-17T09:05:57.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: cluster 2024-09-17T09:05:55.691342+0000 mon.a (mon.0) 3128 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2024-09-17T09:05:57.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: audit 2024-09-17T09:05:55.696197+0000 mon.c (mon.2) 308 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:57.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: audit 2024-09-17T09:05:55.706006+0000 mon.a (mon.0) 3129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:57.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: audit 2024-09-17T09:05:56.164892+0000 mon.a (mon.0) 3130 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:05:57.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: audit 2024-09-17T09:05:56.167148+0000 mon.a (mon.0) 3131 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:57.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: audit 2024-09-17T09:05:56.705575+0000 mon.a (mon.0) 3132 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:05:57.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:56 smithi136 bash[24812]: cluster 2024-09-17T09:05:56.705788+0000 mon.a (mon.0) 3133 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2024-09-17T09:05:57.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: audit 2024-09-17T09:05:55.691048+0000 mon.a (mon.0) 3127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]': finished 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: cluster 2024-09-17T09:05:55.691342+0000 mon.a (mon.0) 3128 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: audit 2024-09-17T09:05:55.696197+0000 mon.c (mon.2) 308 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: audit 2024-09-17T09:05:55.706006+0000 mon.a (mon.0) 3129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: audit 2024-09-17T09:05:56.164892+0000 mon.a (mon.0) 3130 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: audit 2024-09-17T09:05:56.167148+0000 mon.a (mon.0) 3131 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: audit 2024-09-17T09:05:56.705575+0000 mon.a (mon.0) 3132 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[22670]: cluster 2024-09-17T09:05:56.705788+0000 mon.a (mon.0) 3133 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: audit 2024-09-17T09:05:55.691048+0000 mon.a (mon.0) 3127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-109-cache", "mode": "writeback"}]': finished 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: cluster 2024-09-17T09:05:55.691342+0000 mon.a (mon.0) 3128 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2024-09-17T09:05:57.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: audit 2024-09-17T09:05:55.696197+0000 mon.c (mon.2) 308 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:57.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: audit 2024-09-17T09:05:55.706006+0000 mon.a (mon.0) 3129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:05:57.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: audit 2024-09-17T09:05:56.164892+0000 mon.a (mon.0) 3130 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:05:57.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: audit 2024-09-17T09:05:56.167148+0000 mon.a (mon.0) 3131 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:05:57.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: audit 2024-09-17T09:05:56.705575+0000 mon.a (mon.0) 3132 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:05:57.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:56 smithi078 bash[32124]: cluster 2024-09-17T09:05:56.705788+0000 mon.a (mon.0) 3133 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2024-09-17T09:05:58.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:57 smithi136 bash[24812]: audit 2024-09-17T09:05:56.711718+0000 mon.c (mon.2) 309 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:58.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:57 smithi136 bash[24812]: audit 2024-09-17T09:05:56.721989+0000 mon.a (mon.0) 3134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:58.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:57 smithi136 bash[24812]: cluster 2024-09-17T09:05:57.120200+0000 mgr.y (mgr.14532) 553 : cluster [DBG] pgmap v885: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:58.102 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:05:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:05:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:05:58.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:57 smithi078 bash[22670]: audit 2024-09-17T09:05:56.711718+0000 mon.c (mon.2) 309 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:58.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:57 smithi078 bash[22670]: audit 2024-09-17T09:05:56.721989+0000 mon.a (mon.0) 3134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:58.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:57 smithi078 bash[22670]: cluster 2024-09-17T09:05:57.120200+0000 mgr.y (mgr.14532) 553 : cluster [DBG] pgmap v885: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:58.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:57 smithi078 bash[32124]: audit 2024-09-17T09:05:56.711718+0000 mon.c (mon.2) 309 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:58.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:57 smithi078 bash[32124]: audit 2024-09-17T09:05:56.721989+0000 mon.a (mon.0) 3134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:05:58.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:57 smithi078 bash[32124]: cluster 2024-09-17T09:05:57.120200+0000 mgr.y (mgr.14532) 553 : cluster [DBG] pgmap v885: 212 pgs: 212 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:05:59.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:58 smithi136 bash[24812]: audit 2024-09-17T09:05:57.729697+0000 mon.a (mon.0) 3135 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:59.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:58 smithi136 bash[24812]: cluster 2024-09-17T09:05:57.729888+0000 mon.a (mon.0) 3136 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2024-09-17T09:05:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:58 smithi136 bash[24812]: audit 2024-09-17T09:05:57.733072+0000 mon.c (mon.2) 310 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:59.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:58 smithi136 bash[24812]: audit 2024-09-17T09:05:57.734221+0000 mon.a (mon.0) 3137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:59.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[22670]: audit 2024-09-17T09:05:57.729697+0000 mon.a (mon.0) 3135 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[22670]: cluster 2024-09-17T09:05:57.729888+0000 mon.a (mon.0) 3136 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2024-09-17T09:05:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[22670]: audit 2024-09-17T09:05:57.733072+0000 mon.c (mon.2) 310 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:59.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[22670]: audit 2024-09-17T09:05:57.734221+0000 mon.a (mon.0) 3137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[32124]: audit 2024-09-17T09:05:57.729697+0000 mon.a (mon.0) 3135 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:05:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[32124]: cluster 2024-09-17T09:05:57.729888+0000 mon.a (mon.0) 3136 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2024-09-17T09:05:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[32124]: audit 2024-09-17T09:05:57.733072+0000 mon.c (mon.2) 310 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:05:59.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:58 smithi078 bash[32124]: audit 2024-09-17T09:05:57.734221+0000 mon.a (mon.0) 3137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:06:00.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:06:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: cluster 2024-09-17T09:05:58.723547+0000 mon.a (mon.0) 3138 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: audit 2024-09-17T09:05:58.734134+0000 mon.a (mon.0) 3139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:06:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: cluster 2024-09-17T09:05:58.734346+0000 mon.a (mon.0) 3140 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2024-09-17T09:06:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: audit 2024-09-17T09:05:58.736449+0000 mon.c (mon.2) 311 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-17T09:06:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: audit 2024-09-17T09:05:58.738656+0000 mon.a (mon.0) 3141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-17T09:06:00.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: cluster 2024-09-17T09:05:59.121052+0000 mgr.y (mgr.14532) 554 : cluster [DBG] pgmap v888: 212 pgs: 212 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: audit 2024-09-17T09:05:59.736627+0000 mon.a (mon.0) 3142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-17T09:06:00.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:05:59 smithi136 bash[24812]: cluster 2024-09-17T09:05:59.736823+0000 mon.a (mon.0) 3143 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2024-09-17T09:06:00.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: cluster 2024-09-17T09:05:58.723547+0000 mon.a (mon.0) 3138 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: audit 2024-09-17T09:05:58.734134+0000 mon.a (mon.0) 3139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:06:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: cluster 2024-09-17T09:05:58.734346+0000 mon.a (mon.0) 3140 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2024-09-17T09:06:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: audit 2024-09-17T09:05:58.736449+0000 mon.c (mon.2) 311 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-17T09:06:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: audit 2024-09-17T09:05:58.738656+0000 mon.a (mon.0) 3141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-17T09:06:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: cluster 2024-09-17T09:05:59.121052+0000 mgr.y (mgr.14532) 554 : cluster [DBG] pgmap v888: 212 pgs: 212 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: audit 2024-09-17T09:05:59.736627+0000 mon.a (mon.0) 3142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-17T09:06:00.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[32124]: cluster 2024-09-17T09:05:59.736823+0000 mon.a (mon.0) 3143 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2024-09-17T09:06:00.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: cluster 2024-09-17T09:05:58.723547+0000 mon.a (mon.0) 3138 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:00.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: audit 2024-09-17T09:05:58.734134+0000 mon.a (mon.0) 3139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:06:00.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: cluster 2024-09-17T09:05:58.734346+0000 mon.a (mon.0) 3140 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2024-09-17T09:06:00.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: audit 2024-09-17T09:05:58.736449+0000 mon.c (mon.2) 311 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-17T09:06:00.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: audit 2024-09-17T09:05:58.738656+0000 mon.a (mon.0) 3141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-17T09:06:00.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: cluster 2024-09-17T09:05:59.121052+0000 mgr.y (mgr.14532) 554 : cluster [DBG] pgmap v888: 212 pgs: 212 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:00.105 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: audit 2024-09-17T09:05:59.736627+0000 mon.a (mon.0) 3142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-17T09:06:00.106 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:05:59 smithi078 bash[22670]: cluster 2024-09-17T09:05:59.736823+0000 mon.a (mon.0) 3143 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2024-09-17T09:06:01.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:00 smithi136 bash[24812]: audit 2024-09-17T09:05:59.800719+0000 mon.c (mon.2) 312 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:01.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:00 smithi136 bash[24812]: audit 2024-09-17T09:05:59.801383+0000 mon.a (mon.0) 3144 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:01.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:00 smithi136 bash[24812]: audit 2024-09-17T09:05:59.889661+0000 mgr.y (mgr.14532) 555 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:00 smithi078 bash[32124]: audit 2024-09-17T09:05:59.800719+0000 mon.c (mon.2) 312 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:00 smithi078 bash[32124]: audit 2024-09-17T09:05:59.801383+0000 mon.a (mon.0) 3144 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:01.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:00 smithi078 bash[32124]: audit 2024-09-17T09:05:59.889661+0000 mgr.y (mgr.14532) 555 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:00 smithi078 bash[22670]: audit 2024-09-17T09:05:59.800719+0000 mon.c (mon.2) 312 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:00 smithi078 bash[22670]: audit 2024-09-17T09:05:59.801383+0000 mon.a (mon.0) 3144 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:01.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:00 smithi078 bash[22670]: audit 2024-09-17T09:05:59.889661+0000 mgr.y (mgr.14532) 555 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:02.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:01 smithi136 bash[24812]: audit 2024-09-17T09:06:00.777989+0000 mon.a (mon.0) 3145 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:02.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:01 smithi136 bash[24812]: cluster 2024-09-17T09:06:00.778166+0000 mon.a (mon.0) 3146 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2024-09-17T09:06:02.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:01 smithi136 bash[24812]: audit 2024-09-17T09:06:00.783662+0000 mon.c (mon.2) 313 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:06:02.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:01 smithi136 bash[24812]: audit 2024-09-17T09:06:00.784533+0000 mon.a (mon.0) 3147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:06:02.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:01 smithi136 bash[24812]: cluster 2024-09-17T09:06:01.121904+0000 mgr.y (mgr.14532) 556 : cluster [DBG] pgmap v891: 212 pgs: 212 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[22670]: audit 2024-09-17T09:06:00.777989+0000 mon.a (mon.0) 3145 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[22670]: cluster 2024-09-17T09:06:00.778166+0000 mon.a (mon.0) 3146 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2024-09-17T09:06:02.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[22670]: audit 2024-09-17T09:06:00.783662+0000 mon.c (mon.2) 313 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:06:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[22670]: audit 2024-09-17T09:06:00.784533+0000 mon.a (mon.0) 3147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:06:02.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[22670]: cluster 2024-09-17T09:06:01.121904+0000 mgr.y (mgr.14532) 556 : cluster [DBG] pgmap v891: 212 pgs: 212 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[32124]: audit 2024-09-17T09:06:00.777989+0000 mon.a (mon.0) 3145 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[32124]: cluster 2024-09-17T09:06:00.778166+0000 mon.a (mon.0) 3146 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2024-09-17T09:06:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[32124]: audit 2024-09-17T09:06:00.783662+0000 mon.c (mon.2) 313 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:06:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[32124]: audit 2024-09-17T09:06:00.784533+0000 mon.a (mon.0) 3147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]: dispatch 2024-09-17T09:06:02.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:01 smithi078 bash[32124]: cluster 2024-09-17T09:06:01.121904+0000 mgr.y (mgr.14532) 556 : cluster [DBG] pgmap v891: 212 pgs: 212 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:02 smithi078 bash[22670]: audit 2024-09-17T09:06:01.794202+0000 mon.a (mon.0) 3148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:06:03.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:02 smithi078 bash[22670]: cluster 2024-09-17T09:06:01.794388+0000 mon.a (mon.0) 3149 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2024-09-17T09:06:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:02 smithi078 bash[32124]: audit 2024-09-17T09:06:01.794202+0000 mon.a (mon.0) 3148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:06:03.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:02 smithi078 bash[32124]: cluster 2024-09-17T09:06:01.794388+0000 mon.a (mon.0) 3149 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2024-09-17T09:06:03.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:02 smithi136 bash[24812]: audit 2024-09-17T09:06:01.794202+0000 mon.a (mon.0) 3148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-109", "tierpool": "test-rados-api-smithi078-64852-109-cache"}]': finished 2024-09-17T09:06:03.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:02 smithi136 bash[24812]: cluster 2024-09-17T09:06:01.794388+0000 mon.a (mon.0) 3149 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2024-09-17T09:06:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:03 smithi078 bash[22670]: cluster 2024-09-17T09:06:02.793274+0000 mon.a (mon.0) 3150 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2024-09-17T09:06:04.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:03 smithi078 bash[22670]: cluster 2024-09-17T09:06:03.123950+0000 mgr.y (mgr.14532) 557 : cluster [DBG] pgmap v894: 180 pgs: 180 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:04.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:03 smithi078 bash[32124]: cluster 2024-09-17T09:06:02.793274+0000 mon.a (mon.0) 3150 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2024-09-17T09:06:04.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:03 smithi078 bash[32124]: cluster 2024-09-17T09:06:03.123950+0000 mgr.y (mgr.14532) 557 : cluster [DBG] pgmap v894: 180 pgs: 180 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:04.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:03 smithi136 bash[24812]: cluster 2024-09-17T09:06:02.793274+0000 mon.a (mon.0) 3150 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2024-09-17T09:06:04.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:03 smithi136 bash[24812]: cluster 2024-09-17T09:06:03.123950+0000 mgr.y (mgr.14532) 557 : cluster [DBG] pgmap v894: 180 pgs: 180 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:05.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:04 smithi078 bash[22670]: cluster 2024-09-17T09:06:03.829652+0000 mon.a (mon.0) 3151 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2024-09-17T09:06:05.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:04 smithi078 bash[22670]: audit 2024-09-17T09:06:03.834725+0000 mon.c (mon.2) 314 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:05.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:04 smithi078 bash[22670]: audit 2024-09-17T09:06:03.836177+0000 mon.a (mon.0) 3152 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:05.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:04 smithi078 bash[32124]: cluster 2024-09-17T09:06:03.829652+0000 mon.a (mon.0) 3151 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2024-09-17T09:06:05.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:04 smithi078 bash[32124]: audit 2024-09-17T09:06:03.834725+0000 mon.c (mon.2) 314 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:05.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:04 smithi078 bash[32124]: audit 2024-09-17T09:06:03.836177+0000 mon.a (mon.0) 3152 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:05.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:04 smithi136 bash[24812]: cluster 2024-09-17T09:06:03.829652+0000 mon.a (mon.0) 3151 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2024-09-17T09:06:05.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:04 smithi136 bash[24812]: audit 2024-09-17T09:06:03.834725+0000 mon.c (mon.2) 314 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:05.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:04 smithi136 bash[24812]: audit 2024-09-17T09:06:03.836177+0000 mon.a (mon.0) 3152 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:06.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[22670]: audit 2024-09-17T09:06:04.826638+0000 mon.a (mon.0) 3153 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[22670]: cluster 2024-09-17T09:06:04.826818+0000 mon.a (mon.0) 3154 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[22670]: audit 2024-09-17T09:06:04.831281+0000 mon.c (mon.2) 315 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[22670]: audit 2024-09-17T09:06:04.843100+0000 mon.a (mon.0) 3155 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[22670]: cluster 2024-09-17T09:06:05.124755+0000 mgr.y (mgr.14532) 558 : cluster [DBG] pgmap v897: 172 pgs: 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[32124]: audit 2024-09-17T09:06:04.826638+0000 mon.a (mon.0) 3153 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[32124]: cluster 2024-09-17T09:06:04.826818+0000 mon.a (mon.0) 3154 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[32124]: audit 2024-09-17T09:06:04.831281+0000 mon.c (mon.2) 315 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[32124]: audit 2024-09-17T09:06:04.843100+0000 mon.a (mon.0) 3155 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:06.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:05 smithi078 bash[32124]: cluster 2024-09-17T09:06:05.124755+0000 mgr.y (mgr.14532) 558 : cluster [DBG] pgmap v897: 172 pgs: 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:06.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:05 smithi136 bash[24812]: audit 2024-09-17T09:06:04.826638+0000 mon.a (mon.0) 3153 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:06.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:05 smithi136 bash[24812]: cluster 2024-09-17T09:06:04.826818+0000 mon.a (mon.0) 3154 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2024-09-17T09:06:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:05 smithi136 bash[24812]: audit 2024-09-17T09:06:04.831281+0000 mon.c (mon.2) 315 : audit [INF] from='client.? 172.21.15.78:0/4105178455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:05 smithi136 bash[24812]: audit 2024-09-17T09:06:04.843100+0000 mon.a (mon.0) 3155 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]: dispatch 2024-09-17T09:06:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:05 smithi136 bash[24812]: cluster 2024-09-17T09:06:05.124755+0000 mgr.y (mgr.14532) 558 : cluster [DBG] pgmap v897: 172 pgs: 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:07.102 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:06 smithi078 bash[32124]: cluster 2024-09-17T09:06:05.835143+0000 mon.a (mon.0) 3156 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:07.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:06 smithi078 bash[32124]: audit 2024-09-17T09:06:05.854896+0000 mon.a (mon.0) 3157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:07.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:06 smithi078 bash[32124]: cluster 2024-09-17T09:06:05.855136+0000 mon.a (mon.0) 3158 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2024-09-17T09:06:07.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:06 smithi078 bash[22670]: cluster 2024-09-17T09:06:05.835143+0000 mon.a (mon.0) 3156 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:07.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:06 smithi078 bash[22670]: audit 2024-09-17T09:06:05.854896+0000 mon.a (mon.0) 3157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:07.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:06 smithi078 bash[22670]: cluster 2024-09-17T09:06:05.855136+0000 mon.a (mon.0) 3158 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2024-09-17T09:06:07.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:06 smithi136 bash[24812]: cluster 2024-09-17T09:06:05.835143+0000 mon.a (mon.0) 3156 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:07.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:06 smithi136 bash[24812]: audit 2024-09-17T09:06:05.854896+0000 mon.a (mon.0) 3157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-109"}]': finished 2024-09-17T09:06:07.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:06 smithi136 bash[24812]: cluster 2024-09-17T09:06:05.855136+0000 mon.a (mon.0) 3158 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2024-09-17T09:06:08.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:07 smithi136 bash[24812]: cluster 2024-09-17T09:06:06.853163+0000 mon.a (mon.0) 3159 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2024-09-17T09:06:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:07 smithi136 bash[24812]: audit 2024-09-17T09:06:06.857350+0000 mon.c (mon.2) 316 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:07 smithi136 bash[24812]: audit 2024-09-17T09:06:06.863142+0000 mon.a (mon.0) 3160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:07 smithi136 bash[24812]: cluster 2024-09-17T09:06:07.125634+0000 mgr.y (mgr.14532) 559 : cluster [DBG] pgmap v900: 164 pgs: 164 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:08.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:06:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:06:08.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[32124]: cluster 2024-09-17T09:06:06.853163+0000 mon.a (mon.0) 3159 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2024-09-17T09:06:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[32124]: audit 2024-09-17T09:06:06.857350+0000 mon.c (mon.2) 316 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[32124]: audit 2024-09-17T09:06:06.863142+0000 mon.a (mon.0) 3160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[32124]: cluster 2024-09-17T09:06:07.125634+0000 mgr.y (mgr.14532) 559 : cluster [DBG] pgmap v900: 164 pgs: 164 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[22670]: cluster 2024-09-17T09:06:06.853163+0000 mon.a (mon.0) 3159 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2024-09-17T09:06:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[22670]: audit 2024-09-17T09:06:06.857350+0000 mon.c (mon.2) 316 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[22670]: audit 2024-09-17T09:06:06.863142+0000 mon.a (mon.0) 3160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:07 smithi078 bash[22670]: cluster 2024-09-17T09:06:07.125634+0000 mgr.y (mgr.14532) 559 : cluster [DBG] pgmap v900: 164 pgs: 164 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:09.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:08 smithi136 bash[24812]: audit 2024-09-17T09:06:07.858083+0000 mon.a (mon.0) 3161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:06:09.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:08 smithi136 bash[24812]: cluster 2024-09-17T09:06:07.858282+0000 mon.a (mon.0) 3162 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-09-17T09:06:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:08 smithi136 bash[24812]: audit 2024-09-17T09:06:07.861965+0000 mon.c (mon.2) 317 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:08 smithi136 bash[24812]: audit 2024-09-17T09:06:07.872210+0000 mon.a (mon.0) 3163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:09.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[32124]: audit 2024-09-17T09:06:07.858083+0000 mon.a (mon.0) 3161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:06:09.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[32124]: cluster 2024-09-17T09:06:07.858282+0000 mon.a (mon.0) 3162 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-09-17T09:06:09.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[32124]: audit 2024-09-17T09:06:07.861965+0000 mon.c (mon.2) 317 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:09.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[32124]: audit 2024-09-17T09:06:07.872210+0000 mon.a (mon.0) 3163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:09.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[22670]: audit 2024-09-17T09:06:07.858083+0000 mon.a (mon.0) 3161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:06:09.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[22670]: cluster 2024-09-17T09:06:07.858282+0000 mon.a (mon.0) 3162 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-09-17T09:06:09.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[22670]: audit 2024-09-17T09:06:07.861965+0000 mon.c (mon.2) 317 : audit [INF] from='client.? 172.21.15.78:0/1147674191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:09.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:08 smithi078 bash[22670]: audit 2024-09-17T09:06:07.872210+0000 mon.a (mon.0) 3163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]: dispatch 2024-09-17T09:06:10.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:06:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:06:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:09 smithi136 bash[24812]: audit 2024-09-17T09:06:08.872248+0000 mon.a (mon.0) 3164 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:06:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:09 smithi136 bash[24812]: cluster 2024-09-17T09:06:08.872408+0000 mon.a (mon.0) 3165 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-09-17T09:06:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:09 smithi136 bash[24812]: audit 2024-09-17T09:06:08.927143+0000 mon.a (mon.0) 3166 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:09 smithi136 bash[24812]: audit 2024-09-17T09:06:08.928239+0000 mon.a (mon.0) 3167 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:09 smithi136 bash[24812]: audit 2024-09-17T09:06:08.928690+0000 mon.a (mon.0) 3168 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:06:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:09 smithi136 bash[24812]: cluster 2024-09-17T09:06:09.126418+0000 mgr.y (mgr.14532) 560 : cluster [DBG] pgmap v903: 164 pgs: 164 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-17T09:06:10.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[22670]: audit 2024-09-17T09:06:08.872248+0000 mon.a (mon.0) 3164 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:06:10.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[22670]: cluster 2024-09-17T09:06:08.872408+0000 mon.a (mon.0) 3165 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[22670]: audit 2024-09-17T09:06:08.927143+0000 mon.a (mon.0) 3166 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[22670]: audit 2024-09-17T09:06:08.928239+0000 mon.a (mon.0) 3167 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[22670]: audit 2024-09-17T09:06:08.928690+0000 mon.a (mon.0) 3168 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[22670]: cluster 2024-09-17T09:06:09.126418+0000 mgr.y (mgr.14532) 560 : cluster [DBG] pgmap v903: 164 pgs: 164 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[32124]: audit 2024-09-17T09:06:08.872248+0000 mon.a (mon.0) 3164 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi078-64852-104"}]': finished 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[32124]: cluster 2024-09-17T09:06:08.872408+0000 mon.a (mon.0) 3165 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[32124]: audit 2024-09-17T09:06:08.927143+0000 mon.a (mon.0) 3166 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[32124]: audit 2024-09-17T09:06:08.928239+0000 mon.a (mon.0) 3167 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:10.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[32124]: audit 2024-09-17T09:06:08.928690+0000 mon.a (mon.0) 3168 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-17T09:06:10.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:09 smithi078 bash[32124]: cluster 2024-09-17T09:06:09.126418+0000 mgr.y (mgr.14532) 560 : cluster [DBG] pgmap v903: 164 pgs: 164 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-17T09:06:11.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:10 smithi136 bash[24812]: audit 2024-09-17T09:06:09.900828+0000 mon.a (mon.0) 3169 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:06:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:10 smithi136 bash[24812]: cluster 2024-09-17T09:06:09.901023+0000 mon.a (mon.0) 3170 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-09-17T09:06:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:10 smithi136 bash[24812]: audit 2024-09-17T09:06:09.902523+0000 mon.a (mon.0) 3171 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:10 smithi136 bash[24812]: audit 2024-09-17T09:06:09.904143+0000 mgr.y (mgr.14532) 561 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[32124]: audit 2024-09-17T09:06:09.900828+0000 mon.a (mon.0) 3169 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:06:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[32124]: cluster 2024-09-17T09:06:09.901023+0000 mon.a (mon.0) 3170 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-09-17T09:06:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[32124]: audit 2024-09-17T09:06:09.902523+0000 mon.a (mon.0) 3171 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[32124]: audit 2024-09-17T09:06:09.904143+0000 mgr.y (mgr.14532) 561 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[22670]: audit 2024-09-17T09:06:09.900828+0000 mon.a (mon.0) 3169 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi078-64852-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-17T09:06:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[22670]: cluster 2024-09-17T09:06:09.901023+0000 mon.a (mon.0) 3170 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-09-17T09:06:11.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[22670]: audit 2024-09-17T09:06:09.902523+0000 mon.a (mon.0) 3171 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:11.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:10 smithi078 bash[22670]: audit 2024-09-17T09:06:09.904143+0000 mgr.y (mgr.14532) 561 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:12.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:11 smithi136 bash[24812]: cluster 2024-09-17T09:06:11.127122+0000 mgr.y (mgr.14532) 562 : cluster [DBG] pgmap v906: 164 pgs: 164 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:11 smithi136 bash[24812]: cluster 2024-09-17T09:06:11.347861+0000 mon.a (mon.0) 3172 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-09-17T09:06:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:11 smithi136 bash[24812]: audit 2024-09-17T09:06:11.355162+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:11 smithi136 bash[24812]: audit 2024-09-17T09:06:11.356424+0000 mon.a (mon.0) 3174 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[22670]: cluster 2024-09-17T09:06:11.127122+0000 mgr.y (mgr.14532) 562 : cluster [DBG] pgmap v906: 164 pgs: 164 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:12.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[22670]: cluster 2024-09-17T09:06:11.347861+0000 mon.a (mon.0) 3172 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-09-17T09:06:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[22670]: audit 2024-09-17T09:06:11.355162+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[22670]: audit 2024-09-17T09:06:11.356424+0000 mon.a (mon.0) 3174 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[32124]: cluster 2024-09-17T09:06:11.127122+0000 mgr.y (mgr.14532) 562 : cluster [DBG] pgmap v906: 164 pgs: 164 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[32124]: cluster 2024-09-17T09:06:11.347861+0000 mon.a (mon.0) 3172 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-09-17T09:06:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[32124]: audit 2024-09-17T09:06:11.355162+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:11 smithi078 bash[32124]: audit 2024-09-17T09:06:11.356424+0000 mon.a (mon.0) 3174 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:13.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:12 smithi136 bash[24812]: audit 2024-09-17T09:06:11.917738+0000 mon.a (mon.0) 3175 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:13.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:12 smithi136 bash[24812]: cluster 2024-09-17T09:06:11.917955+0000 mon.a (mon.0) 3176 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-09-17T09:06:13.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:12 smithi136 bash[24812]: cluster 2024-09-17T09:06:12.820749+0000 mon.a (mon.0) 3177 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:13.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:12 smithi078 bash[22670]: audit 2024-09-17T09:06:11.917738+0000 mon.a (mon.0) 3175 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:13.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:12 smithi078 bash[22670]: cluster 2024-09-17T09:06:11.917955+0000 mon.a (mon.0) 3176 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-09-17T09:06:13.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:12 smithi078 bash[22670]: cluster 2024-09-17T09:06:12.820749+0000 mon.a (mon.0) 3177 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:13.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:12 smithi078 bash[32124]: audit 2024-09-17T09:06:11.917738+0000 mon.a (mon.0) 3175 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi078-64852-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:13.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:12 smithi078 bash[32124]: cluster 2024-09-17T09:06:11.917955+0000 mon.a (mon.0) 3176 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-09-17T09:06:13.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:12 smithi078 bash[32124]: cluster 2024-09-17T09:06:12.820749+0000 mon.a (mon.0) 3177 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:14.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:13 smithi136 bash[24812]: cluster 2024-09-17T09:06:12.924382+0000 mon.a (mon.0) 3178 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-09-17T09:06:14.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:13 smithi136 bash[24812]: audit 2024-09-17T09:06:12.936003+0000 mon.a (mon.0) 3179 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:13 smithi136 bash[24812]: cluster 2024-09-17T09:06:13.129012+0000 mgr.y (mgr.14532) 563 : cluster [DBG] pgmap v909: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:14.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:13 smithi078 bash[32124]: cluster 2024-09-17T09:06:12.924382+0000 mon.a (mon.0) 3178 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-09-17T09:06:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:13 smithi078 bash[32124]: audit 2024-09-17T09:06:12.936003+0000 mon.a (mon.0) 3179 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:14.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:13 smithi078 bash[32124]: cluster 2024-09-17T09:06:13.129012+0000 mgr.y (mgr.14532) 563 : cluster [DBG] pgmap v909: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:13 smithi078 bash[22670]: cluster 2024-09-17T09:06:12.924382+0000 mon.a (mon.0) 3178 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-09-17T09:06:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:13 smithi078 bash[22670]: audit 2024-09-17T09:06:12.936003+0000 mon.a (mon.0) 3179 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:13 smithi078 bash[22670]: cluster 2024-09-17T09:06:13.129012+0000 mgr.y (mgr.14532) 563 : cluster [DBG] pgmap v909: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:15.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:14 smithi136 bash[24812]: audit 2024-09-17T09:06:13.924989+0000 mon.a (mon.0) 3180 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:15.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:14 smithi136 bash[24812]: cluster 2024-09-17T09:06:13.925502+0000 mon.a (mon.0) 3181 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-09-17T09:06:15.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:14 smithi136 bash[24812]: audit 2024-09-17T09:06:13.975148+0000 mon.a (mon.0) 3182 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:15.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:14 smithi078 bash[22670]: audit 2024-09-17T09:06:13.924989+0000 mon.a (mon.0) 3180 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:15.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:14 smithi078 bash[22670]: cluster 2024-09-17T09:06:13.925502+0000 mon.a (mon.0) 3181 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-09-17T09:06:15.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:14 smithi078 bash[22670]: audit 2024-09-17T09:06:13.975148+0000 mon.a (mon.0) 3182 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:15.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:14 smithi078 bash[32124]: audit 2024-09-17T09:06:13.924989+0000 mon.a (mon.0) 3180 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:15.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:14 smithi078 bash[32124]: cluster 2024-09-17T09:06:13.925502+0000 mon.a (mon.0) 3181 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-09-17T09:06:15.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:14 smithi078 bash[32124]: audit 2024-09-17T09:06:13.975148+0000 mon.a (mon.0) 3182 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:16.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:15 smithi136 bash[24812]: audit 2024-09-17T09:06:14.949100+0000 mon.a (mon.0) 3183 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:15 smithi136 bash[24812]: cluster 2024-09-17T09:06:14.949276+0000 mon.a (mon.0) 3184 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-09-17T09:06:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:15 smithi136 bash[24812]: audit 2024-09-17T09:06:14.951647+0000 mon.a (mon.0) 3185 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-112"}]: dispatch 2024-09-17T09:06:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:15 smithi136 bash[24812]: cluster 2024-09-17T09:06:15.129824+0000 mgr.y (mgr.14532) 564 : cluster [DBG] pgmap v912: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[22670]: audit 2024-09-17T09:06:14.949100+0000 mon.a (mon.0) 3183 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[22670]: cluster 2024-09-17T09:06:14.949276+0000 mon.a (mon.0) 3184 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-09-17T09:06:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[22670]: audit 2024-09-17T09:06:14.951647+0000 mon.a (mon.0) 3185 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-112"}]: dispatch 2024-09-17T09:06:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[22670]: cluster 2024-09-17T09:06:15.129824+0000 mgr.y (mgr.14532) 564 : cluster [DBG] pgmap v912: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[32124]: audit 2024-09-17T09:06:14.949100+0000 mon.a (mon.0) 3183 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[32124]: cluster 2024-09-17T09:06:14.949276+0000 mon.a (mon.0) 3184 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-09-17T09:06:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[32124]: audit 2024-09-17T09:06:14.951647+0000 mon.a (mon.0) 3185 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-112"}]: dispatch 2024-09-17T09:06:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:15 smithi078 bash[32124]: cluster 2024-09-17T09:06:15.129824+0000 mgr.y (mgr.14532) 564 : cluster [DBG] pgmap v912: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:17.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:16 smithi136 bash[24812]: audit 2024-09-17T09:06:15.949436+0000 mon.a (mon.0) 3186 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-112"}]': finished 2024-09-17T09:06:17.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:16 smithi136 bash[24812]: cluster 2024-09-17T09:06:15.949636+0000 mon.a (mon.0) 3187 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-09-17T09:06:17.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:16 smithi136 bash[24812]: audit 2024-09-17T09:06:16.010992+0000 mon.a (mon.0) 3188 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:16 smithi078 bash[22670]: audit 2024-09-17T09:06:15.949436+0000 mon.a (mon.0) 3186 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-112"}]': finished 2024-09-17T09:06:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:16 smithi078 bash[22670]: cluster 2024-09-17T09:06:15.949636+0000 mon.a (mon.0) 3187 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-09-17T09:06:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:16 smithi078 bash[22670]: audit 2024-09-17T09:06:16.010992+0000 mon.a (mon.0) 3188 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:17.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:16 smithi078 bash[32124]: audit 2024-09-17T09:06:15.949436+0000 mon.a (mon.0) 3186 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-112"}]': finished 2024-09-17T09:06:17.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:16 smithi078 bash[32124]: cluster 2024-09-17T09:06:15.949636+0000 mon.a (mon.0) 3187 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-09-17T09:06:17.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:16 smithi078 bash[32124]: audit 2024-09-17T09:06:16.010992+0000 mon.a (mon.0) 3188 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:17 smithi136 bash[24812]: audit 2024-09-17T09:06:16.983305+0000 mon.a (mon.0) 3189 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:17 smithi136 bash[24812]: cluster 2024-09-17T09:06:16.983465+0000 mon.a (mon.0) 3190 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-09-17T09:06:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:17 smithi136 bash[24812]: audit 2024-09-17T09:06:16.986466+0000 mon.a (mon.0) 3191 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112"}]: dispatch 2024-09-17T09:06:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:17 smithi136 bash[24812]: cluster 2024-09-17T09:06:17.130761+0000 mgr.y (mgr.14532) 565 : cluster [DBG] pgmap v915: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:17 smithi136 bash[24812]: cluster 2024-09-17T09:06:17.822611+0000 mon.a (mon.0) 3192 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:18.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:06:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:06:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[32124]: audit 2024-09-17T09:06:16.983305+0000 mon.a (mon.0) 3189 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[32124]: cluster 2024-09-17T09:06:16.983465+0000 mon.a (mon.0) 3190 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-09-17T09:06:18.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[32124]: audit 2024-09-17T09:06:16.986466+0000 mon.a (mon.0) 3191 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112"}]: dispatch 2024-09-17T09:06:18.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[32124]: cluster 2024-09-17T09:06:17.130761+0000 mgr.y (mgr.14532) 565 : cluster [DBG] pgmap v915: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:18.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[32124]: cluster 2024-09-17T09:06:17.822611+0000 mon.a (mon.0) 3192 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[22670]: audit 2024-09-17T09:06:16.983305+0000 mon.a (mon.0) 3189 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[22670]: cluster 2024-09-17T09:06:16.983465+0000 mon.a (mon.0) 3190 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-09-17T09:06:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[22670]: audit 2024-09-17T09:06:16.986466+0000 mon.a (mon.0) 3191 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112"}]: dispatch 2024-09-17T09:06:18.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[22670]: cluster 2024-09-17T09:06:17.130761+0000 mgr.y (mgr.14532) 565 : cluster [DBG] pgmap v915: 204 pgs: 25 creating+peering, 3 creating+activating, 9 unknown, 167 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:18.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:17 smithi078 bash[22670]: cluster 2024-09-17T09:06:17.822611+0000 mon.a (mon.0) 3192 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:19.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:19 smithi136 bash[24812]: audit 2024-09-17T09:06:17.995803+0000 mon.a (mon.0) 3193 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112"}]': finished 2024-09-17T09:06:19.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:19 smithi136 bash[24812]: cluster 2024-09-17T09:06:17.996162+0000 mon.a (mon.0) 3194 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-09-17T09:06:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:19 smithi078 bash[32124]: audit 2024-09-17T09:06:17.995803+0000 mon.a (mon.0) 3193 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112"}]': finished 2024-09-17T09:06:19.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:19 smithi078 bash[32124]: cluster 2024-09-17T09:06:17.996162+0000 mon.a (mon.0) 3194 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-09-17T09:06:19.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:19 smithi078 bash[22670]: audit 2024-09-17T09:06:17.995803+0000 mon.a (mon.0) 3193 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-112"}]': finished 2024-09-17T09:06:19.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:19 smithi078 bash[22670]: cluster 2024-09-17T09:06:17.996162+0000 mon.a (mon.0) 3194 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-09-17T09:06:20.289 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:06:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:06:20.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:20 smithi136 bash[24812]: cluster 2024-09-17T09:06:19.000465+0000 mon.a (mon.0) 3195 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-09-17T09:06:20.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:20 smithi136 bash[24812]: cluster 2024-09-17T09:06:19.131536+0000 mgr.y (mgr.14532) 566 : cluster [DBG] pgmap v918: 172 pgs: 172 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:20.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:20 smithi136 bash[24812]: audit 2024-09-17T09:06:19.915646+0000 mgr.y (mgr.14532) 567 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:20.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:20 smithi136 bash[24812]: cluster 2024-09-17T09:06:20.005425+0000 mon.a (mon.0) 3196 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-09-17T09:06:20.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:20 smithi136 bash[24812]: audit 2024-09-17T09:06:20.012480+0000 mon.a (mon.0) 3197 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[32124]: cluster 2024-09-17T09:06:19.000465+0000 mon.a (mon.0) 3195 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-09-17T09:06:20.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[32124]: cluster 2024-09-17T09:06:19.131536+0000 mgr.y (mgr.14532) 566 : cluster [DBG] pgmap v918: 172 pgs: 172 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[32124]: audit 2024-09-17T09:06:19.915646+0000 mgr.y (mgr.14532) 567 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[32124]: cluster 2024-09-17T09:06:20.005425+0000 mon.a (mon.0) 3196 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[32124]: audit 2024-09-17T09:06:20.012480+0000 mon.a (mon.0) 3197 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[22670]: cluster 2024-09-17T09:06:19.000465+0000 mon.a (mon.0) 3195 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[22670]: cluster 2024-09-17T09:06:19.131536+0000 mgr.y (mgr.14532) 566 : cluster [DBG] pgmap v918: 172 pgs: 172 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[22670]: audit 2024-09-17T09:06:19.915646+0000 mgr.y (mgr.14532) 567 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[22670]: cluster 2024-09-17T09:06:20.005425+0000 mon.a (mon.0) 3196 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-09-17T09:06:20.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:20 smithi078 bash[22670]: audit 2024-09-17T09:06:20.012480+0000 mon.a (mon.0) 3197 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:22.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:22 smithi136 bash[24812]: audit 2024-09-17T09:06:21.009639+0000 mon.a (mon.0) 3198 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:22 smithi136 bash[24812]: cluster 2024-09-17T09:06:21.010702+0000 mon.a (mon.0) 3199 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-09-17T09:06:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:22 smithi136 bash[24812]: audit 2024-09-17T09:06:21.044056+0000 mon.a (mon.0) 3200 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:22 smithi136 bash[24812]: cluster 2024-09-17T09:06:21.132350+0000 mgr.y (mgr.14532) 568 : cluster [DBG] pgmap v921: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:22.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[22670]: audit 2024-09-17T09:06:21.009639+0000 mon.a (mon.0) 3198 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:22.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[22670]: cluster 2024-09-17T09:06:21.010702+0000 mon.a (mon.0) 3199 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-09-17T09:06:22.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[22670]: audit 2024-09-17T09:06:21.044056+0000 mon.a (mon.0) 3200 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[22670]: cluster 2024-09-17T09:06:21.132350+0000 mgr.y (mgr.14532) 568 : cluster [DBG] pgmap v921: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:22.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[32124]: audit 2024-09-17T09:06:21.009639+0000 mon.a (mon.0) 3198 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:22.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[32124]: cluster 2024-09-17T09:06:21.010702+0000 mon.a (mon.0) 3199 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-09-17T09:06:22.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[32124]: audit 2024-09-17T09:06:21.044056+0000 mon.a (mon.0) 3200 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:22.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:22 smithi078 bash[32124]: cluster 2024-09-17T09:06:21.132350+0000 mgr.y (mgr.14532) 568 : cluster [DBG] pgmap v921: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:23.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:23 smithi136 bash[24812]: audit 2024-09-17T09:06:22.022249+0000 mon.a (mon.0) 3201 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:23.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:23 smithi136 bash[24812]: cluster 2024-09-17T09:06:22.022384+0000 mon.a (mon.0) 3202 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-09-17T09:06:23.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:23 smithi136 bash[24812]: audit 2024-09-17T09:06:22.024004+0000 mon.a (mon.0) 3203 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-114"}]: dispatch 2024-09-17T09:06:23.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:23 smithi078 bash[32124]: audit 2024-09-17T09:06:22.022249+0000 mon.a (mon.0) 3201 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:23.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:23 smithi078 bash[32124]: cluster 2024-09-17T09:06:22.022384+0000 mon.a (mon.0) 3202 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-09-17T09:06:23.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:23 smithi078 bash[32124]: audit 2024-09-17T09:06:22.024004+0000 mon.a (mon.0) 3203 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-114"}]: dispatch 2024-09-17T09:06:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:23 smithi078 bash[22670]: audit 2024-09-17T09:06:22.022249+0000 mon.a (mon.0) 3201 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:23 smithi078 bash[22670]: cluster 2024-09-17T09:06:22.022384+0000 mon.a (mon.0) 3202 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-09-17T09:06:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:23 smithi078 bash[22670]: audit 2024-09-17T09:06:22.024004+0000 mon.a (mon.0) 3203 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-114"}]: dispatch 2024-09-17T09:06:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[32124]: audit 2024-09-17T09:06:23.021163+0000 mon.a (mon.0) 3204 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-114"}]': finished 2024-09-17T09:06:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[32124]: cluster 2024-09-17T09:06:23.021335+0000 mon.a (mon.0) 3205 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-09-17T09:06:24.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[32124]: audit 2024-09-17T09:06:23.024034+0000 mon.a (mon.0) 3206 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-114", "mode": "writeback"}]: dispatch 2024-09-17T09:06:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[32124]: cluster 2024-09-17T09:06:23.133219+0000 mgr.y (mgr.14532) 569 : cluster [DBG] pgmap v924: 204 pgs: 204 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[32124]: cluster 2024-09-17T09:06:24.015331+0000 mon.a (mon.0) 3207 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[22670]: audit 2024-09-17T09:06:23.021163+0000 mon.a (mon.0) 3204 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-114"}]': finished 2024-09-17T09:06:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[22670]: cluster 2024-09-17T09:06:23.021335+0000 mon.a (mon.0) 3205 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-09-17T09:06:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[22670]: audit 2024-09-17T09:06:23.024034+0000 mon.a (mon.0) 3206 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-114", "mode": "writeback"}]: dispatch 2024-09-17T09:06:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[22670]: cluster 2024-09-17T09:06:23.133219+0000 mgr.y (mgr.14532) 569 : cluster [DBG] pgmap v924: 204 pgs: 204 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:24 smithi078 bash[22670]: cluster 2024-09-17T09:06:24.015331+0000 mon.a (mon.0) 3207 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:24.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:24 smithi136 bash[24812]: audit 2024-09-17T09:06:23.021163+0000 mon.a (mon.0) 3204 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-114"}]': finished 2024-09-17T09:06:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:24 smithi136 bash[24812]: cluster 2024-09-17T09:06:23.021335+0000 mon.a (mon.0) 3205 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-09-17T09:06:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:24 smithi136 bash[24812]: audit 2024-09-17T09:06:23.024034+0000 mon.a (mon.0) 3206 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-114", "mode": "writeback"}]: dispatch 2024-09-17T09:06:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:24 smithi136 bash[24812]: cluster 2024-09-17T09:06:23.133219+0000 mgr.y (mgr.14532) 569 : cluster [DBG] pgmap v924: 204 pgs: 204 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:24 smithi136 bash[24812]: cluster 2024-09-17T09:06:24.015331+0000 mon.a (mon.0) 3207 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:25 smithi078 bash[22670]: audit 2024-09-17T09:06:24.029957+0000 mon.a (mon.0) 3208 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-114", "mode": "writeback"}]': finished 2024-09-17T09:06:25.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:25 smithi078 bash[22670]: cluster 2024-09-17T09:06:24.030162+0000 mon.a (mon.0) 3209 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-09-17T09:06:25.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:25 smithi078 bash[22670]: audit 2024-09-17T09:06:24.130919+0000 mon.a (mon.0) 3210 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:25 smithi078 bash[32124]: audit 2024-09-17T09:06:24.029957+0000 mon.a (mon.0) 3208 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-114", "mode": "writeback"}]': finished 2024-09-17T09:06:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:25 smithi078 bash[32124]: cluster 2024-09-17T09:06:24.030162+0000 mon.a (mon.0) 3209 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-09-17T09:06:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:25 smithi078 bash[32124]: audit 2024-09-17T09:06:24.130919+0000 mon.a (mon.0) 3210 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:25.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:25 smithi136 bash[24812]: audit 2024-09-17T09:06:24.029957+0000 mon.a (mon.0) 3208 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-114", "mode": "writeback"}]': finished 2024-09-17T09:06:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:25 smithi136 bash[24812]: cluster 2024-09-17T09:06:24.030162+0000 mon.a (mon.0) 3209 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-09-17T09:06:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:25 smithi136 bash[24812]: audit 2024-09-17T09:06:24.130919+0000 mon.a (mon.0) 3210 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[22670]: audit 2024-09-17T09:06:25.060112+0000 mon.a (mon.0) 3211 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:26.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[22670]: cluster 2024-09-17T09:06:25.060279+0000 mon.a (mon.0) 3212 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-09-17T09:06:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[22670]: audit 2024-09-17T09:06:25.063330+0000 mon.a (mon.0) 3213 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114"}]: dispatch 2024-09-17T09:06:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[22670]: cluster 2024-09-17T09:06:25.134058+0000 mgr.y (mgr.14532) 570 : cluster [DBG] pgmap v927: 204 pgs: 204 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[32124]: audit 2024-09-17T09:06:25.060112+0000 mon.a (mon.0) 3211 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[32124]: cluster 2024-09-17T09:06:25.060279+0000 mon.a (mon.0) 3212 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-09-17T09:06:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[32124]: audit 2024-09-17T09:06:25.063330+0000 mon.a (mon.0) 3213 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114"}]: dispatch 2024-09-17T09:06:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:26 smithi078 bash[32124]: cluster 2024-09-17T09:06:25.134058+0000 mgr.y (mgr.14532) 570 : cluster [DBG] pgmap v927: 204 pgs: 204 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:26 smithi136 bash[24812]: audit 2024-09-17T09:06:25.060112+0000 mon.a (mon.0) 3211 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:26 smithi136 bash[24812]: cluster 2024-09-17T09:06:25.060279+0000 mon.a (mon.0) 3212 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-09-17T09:06:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:26 smithi136 bash[24812]: audit 2024-09-17T09:06:25.063330+0000 mon.a (mon.0) 3213 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114"}]: dispatch 2024-09-17T09:06:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:26 smithi136 bash[24812]: cluster 2024-09-17T09:06:25.134058+0000 mgr.y (mgr.14532) 570 : cluster [DBG] pgmap v927: 204 pgs: 204 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:06:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[32124]: cluster 2024-09-17T09:06:26.056082+0000 mon.a (mon.0) 3214 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[32124]: audit 2024-09-17T09:06:26.074965+0000 mon.a (mon.0) 3215 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114"}]': finished 2024-09-17T09:06:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[32124]: cluster 2024-09-17T09:06:26.075146+0000 mon.a (mon.0) 3216 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-09-17T09:06:27.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[32124]: audit 2024-09-17T09:06:26.371515+0000 mon.a (mon.0) 3217 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:27.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[22670]: cluster 2024-09-17T09:06:26.056082+0000 mon.a (mon.0) 3214 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:27.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[22670]: audit 2024-09-17T09:06:26.074965+0000 mon.a (mon.0) 3215 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114"}]': finished 2024-09-17T09:06:27.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[22670]: cluster 2024-09-17T09:06:26.075146+0000 mon.a (mon.0) 3216 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-09-17T09:06:27.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[22670]: audit 2024-09-17T09:06:26.371515+0000 mon.a (mon.0) 3217 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:27 smithi136 bash[24812]: cluster 2024-09-17T09:06:26.056082+0000 mon.a (mon.0) 3214 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:27 smithi136 bash[24812]: audit 2024-09-17T09:06:26.074965+0000 mon.a (mon.0) 3215 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-114"}]': finished 2024-09-17T09:06:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:27 smithi136 bash[24812]: cluster 2024-09-17T09:06:26.075146+0000 mon.a (mon.0) 3216 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-09-17T09:06:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:27 smithi136 bash[24812]: audit 2024-09-17T09:06:26.371515+0000 mon.a (mon.0) 3217 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:28.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:06:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:06:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:06:28.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:28 smithi078 bash[22670]: cluster 2024-09-17T09:06:27.075633+0000 mon.a (mon.0) 3218 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-09-17T09:06:28.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:28 smithi078 bash[22670]: cluster 2024-09-17T09:06:27.134849+0000 mgr.y (mgr.14532) 571 : cluster [DBG] pgmap v930: 172 pgs: 172 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:28.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:28 smithi078 bash[32124]: cluster 2024-09-17T09:06:27.075633+0000 mon.a (mon.0) 3218 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-09-17T09:06:28.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:28 smithi078 bash[32124]: cluster 2024-09-17T09:06:27.134849+0000 mgr.y (mgr.14532) 571 : cluster [DBG] pgmap v930: 172 pgs: 172 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:28.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:28 smithi136 bash[24812]: cluster 2024-09-17T09:06:27.075633+0000 mon.a (mon.0) 3218 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-09-17T09:06:28.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:28 smithi136 bash[24812]: cluster 2024-09-17T09:06:27.134849+0000 mgr.y (mgr.14532) 571 : cluster [DBG] pgmap v930: 172 pgs: 172 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:29.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:29 smithi136 bash[24812]: cluster 2024-09-17T09:06:28.106088+0000 mon.a (mon.0) 3219 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-09-17T09:06:29.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:29 smithi136 bash[24812]: audit 2024-09-17T09:06:28.116832+0000 mon.a (mon.0) 3220 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:29 smithi078 bash[32124]: cluster 2024-09-17T09:06:28.106088+0000 mon.a (mon.0) 3219 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-09-17T09:06:29.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:29 smithi078 bash[32124]: audit 2024-09-17T09:06:28.116832+0000 mon.a (mon.0) 3220 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:29 smithi078 bash[22670]: cluster 2024-09-17T09:06:28.106088+0000 mon.a (mon.0) 3219 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-09-17T09:06:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:29 smithi078 bash[22670]: audit 2024-09-17T09:06:28.116832+0000 mon.a (mon.0) 3220 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:30.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:06:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:06:30.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:30 smithi136 bash[24812]: audit 2024-09-17T09:06:29.108447+0000 mon.a (mon.0) 3221 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:30.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:30 smithi136 bash[24812]: cluster 2024-09-17T09:06:29.109748+0000 mon.a (mon.0) 3222 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-09-17T09:06:30.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:30 smithi136 bash[24812]: cluster 2024-09-17T09:06:29.135860+0000 mgr.y (mgr.14532) 572 : cluster [DBG] pgmap v933: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:30.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:30 smithi078 bash[32124]: audit 2024-09-17T09:06:29.108447+0000 mon.a (mon.0) 3221 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:30.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:30 smithi078 bash[32124]: cluster 2024-09-17T09:06:29.109748+0000 mon.a (mon.0) 3222 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-09-17T09:06:30.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:30 smithi078 bash[32124]: cluster 2024-09-17T09:06:29.135860+0000 mgr.y (mgr.14532) 572 : cluster [DBG] pgmap v933: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:30 smithi078 bash[22670]: audit 2024-09-17T09:06:29.108447+0000 mon.a (mon.0) 3221 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:30 smithi078 bash[22670]: cluster 2024-09-17T09:06:29.109748+0000 mon.a (mon.0) 3222 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-09-17T09:06:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:30 smithi078 bash[22670]: cluster 2024-09-17T09:06:29.135860+0000 mgr.y (mgr.14532) 572 : cluster [DBG] pgmap v933: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:31.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:31 smithi136 bash[24812]: audit 2024-09-17T09:06:29.927165+0000 mgr.y (mgr.14532) 573 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:31.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:31 smithi136 bash[24812]: cluster 2024-09-17T09:06:30.133414+0000 mon.a (mon.0) 3223 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-09-17T09:06:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:31 smithi136 bash[24812]: audit 2024-09-17T09:06:30.162146+0000 mon.a (mon.0) 3224 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:31 smithi078 bash[32124]: audit 2024-09-17T09:06:29.927165+0000 mgr.y (mgr.14532) 573 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:31 smithi078 bash[32124]: cluster 2024-09-17T09:06:30.133414+0000 mon.a (mon.0) 3223 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-09-17T09:06:31.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:31 smithi078 bash[32124]: audit 2024-09-17T09:06:30.162146+0000 mon.a (mon.0) 3224 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:31 smithi078 bash[22670]: audit 2024-09-17T09:06:29.927165+0000 mgr.y (mgr.14532) 573 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:31 smithi078 bash[22670]: cluster 2024-09-17T09:06:30.133414+0000 mon.a (mon.0) 3223 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-09-17T09:06:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:31 smithi078 bash[22670]: audit 2024-09-17T09:06:30.162146+0000 mon.a (mon.0) 3224 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:32 smithi136 bash[24812]: audit 2024-09-17T09:06:31.134016+0000 mon.a (mon.0) 3225 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:32 smithi136 bash[24812]: cluster 2024-09-17T09:06:31.134239+0000 mon.a (mon.0) 3226 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-09-17T09:06:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:32 smithi136 bash[24812]: audit 2024-09-17T09:06:31.135884+0000 mon.a (mon.0) 3227 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-116"}]: dispatch 2024-09-17T09:06:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:32 smithi136 bash[24812]: cluster 2024-09-17T09:06:31.140243+0000 mgr.y (mgr.14532) 574 : cluster [DBG] pgmap v936: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 1 op/s 2024-09-17T09:06:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:32 smithi136 bash[24812]: audit 2024-09-17T09:06:32.146366+0000 mon.a (mon.0) 3228 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-116"}]': finished 2024-09-17T09:06:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:32 smithi136 bash[24812]: cluster 2024-09-17T09:06:32.146577+0000 mon.a (mon.0) 3229 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-09-17T09:06:32.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[32124]: audit 2024-09-17T09:06:31.134016+0000 mon.a (mon.0) 3225 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:32.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[32124]: cluster 2024-09-17T09:06:31.134239+0000 mon.a (mon.0) 3226 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[32124]: audit 2024-09-17T09:06:31.135884+0000 mon.a (mon.0) 3227 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-116"}]: dispatch 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[32124]: cluster 2024-09-17T09:06:31.140243+0000 mgr.y (mgr.14532) 574 : cluster [DBG] pgmap v936: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 1 op/s 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[32124]: audit 2024-09-17T09:06:32.146366+0000 mon.a (mon.0) 3228 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-116"}]': finished 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[32124]: cluster 2024-09-17T09:06:32.146577+0000 mon.a (mon.0) 3229 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[22670]: audit 2024-09-17T09:06:31.134016+0000 mon.a (mon.0) 3225 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[22670]: cluster 2024-09-17T09:06:31.134239+0000 mon.a (mon.0) 3226 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[22670]: audit 2024-09-17T09:06:31.135884+0000 mon.a (mon.0) 3227 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-116"}]: dispatch 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[22670]: cluster 2024-09-17T09:06:31.140243+0000 mgr.y (mgr.14532) 574 : cluster [DBG] pgmap v936: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 1 op/s 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[22670]: audit 2024-09-17T09:06:32.146366+0000 mon.a (mon.0) 3228 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-116"}]': finished 2024-09-17T09:06:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:32 smithi078 bash[22670]: cluster 2024-09-17T09:06:32.146577+0000 mon.a (mon.0) 3229 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-09-17T09:06:33.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:33 smithi136 bash[24812]: audit 2024-09-17T09:06:32.150048+0000 mon.a (mon.0) 3230 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-116", "mode": "writeback"}]: dispatch 2024-09-17T09:06:33.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:33 smithi136 bash[24812]: audit 2024-09-17T09:06:32.856639+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:06:33.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:33 smithi136 bash[24812]: cluster 2024-09-17T09:06:33.139142+0000 mon.a (mon.0) 3232 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:33.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:33 smithi136 bash[24812]: audit 2024-09-17T09:06:33.148293+0000 mon.a (mon.0) 3233 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-116", "mode": "writeback"}]': finished 2024-09-17T09:06:33.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:33 smithi136 bash[24812]: cluster 2024-09-17T09:06:33.148459+0000 mon.a (mon.0) 3234 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-09-17T09:06:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[22670]: audit 2024-09-17T09:06:32.150048+0000 mon.a (mon.0) 3230 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-116", "mode": "writeback"}]: dispatch 2024-09-17T09:06:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[22670]: audit 2024-09-17T09:06:32.856639+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:06:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[22670]: cluster 2024-09-17T09:06:33.139142+0000 mon.a (mon.0) 3232 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[22670]: audit 2024-09-17T09:06:33.148293+0000 mon.a (mon.0) 3233 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-116", "mode": "writeback"}]': finished 2024-09-17T09:06:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[22670]: cluster 2024-09-17T09:06:33.148459+0000 mon.a (mon.0) 3234 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-09-17T09:06:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[32124]: audit 2024-09-17T09:06:32.150048+0000 mon.a (mon.0) 3230 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-116", "mode": "writeback"}]: dispatch 2024-09-17T09:06:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[32124]: audit 2024-09-17T09:06:32.856639+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:06:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[32124]: cluster 2024-09-17T09:06:33.139142+0000 mon.a (mon.0) 3232 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[32124]: audit 2024-09-17T09:06:33.148293+0000 mon.a (mon.0) 3233 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-116", "mode": "writeback"}]': finished 2024-09-17T09:06:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:33 smithi078 bash[32124]: cluster 2024-09-17T09:06:33.148459+0000 mon.a (mon.0) 3234 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-09-17T09:06:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:34 smithi136 bash[24812]: cluster 2024-09-17T09:06:33.142597+0000 mgr.y (mgr.14532) 575 : cluster [DBG] pgmap v938: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:06:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:34 smithi136 bash[24812]: audit 2024-09-17T09:06:33.173123+0000 mon.a (mon.0) 3235 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "245.6"}]: dispatch 2024-09-17T09:06:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:34 smithi136 bash[24812]: audit 2024-09-17T09:06:33.413462+0000 mon.a (mon.0) 3236 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:06:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:34 smithi136 bash[24812]: audit 2024-09-17T09:06:33.414758+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:06:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:34 smithi136 bash[24812]: audit 2024-09-17T09:06:33.420672+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:34.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[22670]: cluster 2024-09-17T09:06:33.142597+0000 mgr.y (mgr.14532) 575 : cluster [DBG] pgmap v938: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:06:34.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[22670]: audit 2024-09-17T09:06:33.173123+0000 mon.a (mon.0) 3235 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "245.6"}]: dispatch 2024-09-17T09:06:34.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[22670]: audit 2024-09-17T09:06:33.413462+0000 mon.a (mon.0) 3236 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:06:34.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[22670]: audit 2024-09-17T09:06:33.414758+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:06:34.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[22670]: audit 2024-09-17T09:06:33.420672+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:34.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[32124]: cluster 2024-09-17T09:06:33.142597+0000 mgr.y (mgr.14532) 575 : cluster [DBG] pgmap v938: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:06:34.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[32124]: audit 2024-09-17T09:06:33.173123+0000 mon.a (mon.0) 3235 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "245.6"}]: dispatch 2024-09-17T09:06:34.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[32124]: audit 2024-09-17T09:06:33.413462+0000 mon.a (mon.0) 3236 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:06:34.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[32124]: audit 2024-09-17T09:06:33.414758+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:06:34.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:34 smithi078 bash[32124]: audit 2024-09-17T09:06:33.420672+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:35.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:35 smithi136 bash[24812]: audit 2024-09-17T09:06:33.173398+0000 mgr.y (mgr.14532) 576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "245.6"}]: dispatch 2024-09-17T09:06:35.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:35 smithi136 bash[24812]: cluster 2024-09-17T09:06:34.470855+0000 osd.7 (osd.7) 13 : cluster [DBG] 245.6 scrub starts 2024-09-17T09:06:35.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:35 smithi136 bash[24812]: cluster 2024-09-17T09:06:34.474556+0000 osd.7 (osd.7) 14 : cluster [DBG] 245.6 scrub ok 2024-09-17T09:06:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:35 smithi078 bash[22670]: audit 2024-09-17T09:06:33.173398+0000 mgr.y (mgr.14532) 576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "245.6"}]: dispatch 2024-09-17T09:06:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:35 smithi078 bash[22670]: cluster 2024-09-17T09:06:34.470855+0000 osd.7 (osd.7) 13 : cluster [DBG] 245.6 scrub starts 2024-09-17T09:06:35.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:35 smithi078 bash[22670]: cluster 2024-09-17T09:06:34.474556+0000 osd.7 (osd.7) 14 : cluster [DBG] 245.6 scrub ok 2024-09-17T09:06:35.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:35 smithi078 bash[32124]: audit 2024-09-17T09:06:33.173398+0000 mgr.y (mgr.14532) 576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "245.6"}]: dispatch 2024-09-17T09:06:35.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:35 smithi078 bash[32124]: cluster 2024-09-17T09:06:34.470855+0000 osd.7 (osd.7) 13 : cluster [DBG] 245.6 scrub starts 2024-09-17T09:06:35.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:35 smithi078 bash[32124]: cluster 2024-09-17T09:06:34.474556+0000 osd.7 (osd.7) 14 : cluster [DBG] 245.6 scrub ok 2024-09-17T09:06:36.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:36 smithi136 bash[24812]: cluster 2024-09-17T09:06:35.143607+0000 mgr.y (mgr.14532) 577 : cluster [DBG] pgmap v940: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-17T09:06:36.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:36 smithi078 bash[32124]: cluster 2024-09-17T09:06:35.143607+0000 mgr.y (mgr.14532) 577 : cluster [DBG] pgmap v940: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-17T09:06:36.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:36 smithi078 bash[22670]: cluster 2024-09-17T09:06:35.143607+0000 mgr.y (mgr.14532) 577 : cluster [DBG] pgmap v940: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-17T09:06:37.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:37 smithi136 bash[24812]: cluster 2024-09-17T09:06:37.144411+0000 mgr.y (mgr.14532) 578 : cluster [DBG] pgmap v941: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:06:37.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:37 smithi078 bash[32124]: cluster 2024-09-17T09:06:37.144411+0000 mgr.y (mgr.14532) 578 : cluster [DBG] pgmap v941: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:06:37.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:37 smithi078 bash[22670]: cluster 2024-09-17T09:06:37.144411+0000 mgr.y (mgr.14532) 578 : cluster [DBG] pgmap v941: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-17T09:06:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:06:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:06:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:06:39.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:39 smithi136 bash[24812]: cluster 2024-09-17T09:06:39.146507+0000 mgr.y (mgr.14532) 579 : cluster [DBG] pgmap v942: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 2 op/s 2024-09-17T09:06:39.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:39 smithi078 bash[32124]: cluster 2024-09-17T09:06:39.146507+0000 mgr.y (mgr.14532) 579 : cluster [DBG] pgmap v942: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 2 op/s 2024-09-17T09:06:39.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:39 smithi078 bash[22670]: cluster 2024-09-17T09:06:39.146507+0000 mgr.y (mgr.14532) 579 : cluster [DBG] pgmap v942: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 895 B/s wr, 2 op/s 2024-09-17T09:06:40.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:06:39 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:06:40.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:40 smithi136 bash[24812]: audit 2024-09-17T09:06:39.936784+0000 mgr.y (mgr.14532) 580 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:40.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:40 smithi078 bash[22670]: audit 2024-09-17T09:06:39.936784+0000 mgr.y (mgr.14532) 580 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:40.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:40 smithi078 bash[32124]: audit 2024-09-17T09:06:39.936784+0000 mgr.y (mgr.14532) 580 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:41.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:41 smithi136 bash[24812]: cluster 2024-09-17T09:06:41.147284+0000 mgr.y (mgr.14532) 581 : cluster [DBG] pgmap v943: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 796 B/s wr, 2 op/s 2024-09-17T09:06:41.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:41 smithi078 bash[22670]: cluster 2024-09-17T09:06:41.147284+0000 mgr.y (mgr.14532) 581 : cluster [DBG] pgmap v943: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 796 B/s wr, 2 op/s 2024-09-17T09:06:41.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:41 smithi078 bash[32124]: cluster 2024-09-17T09:06:41.147284+0000 mgr.y (mgr.14532) 581 : cluster [DBG] pgmap v943: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 796 B/s wr, 2 op/s 2024-09-17T09:06:42.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:42 smithi136 bash[24812]: audit 2024-09-17T09:06:41.407546+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:42.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:42 smithi136 bash[24812]: audit 2024-09-17T09:06:41.409867+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:42 smithi078 bash[22670]: audit 2024-09-17T09:06:41.407546+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:42.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:42 smithi078 bash[22670]: audit 2024-09-17T09:06:41.409867+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:42.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:42 smithi078 bash[32124]: audit 2024-09-17T09:06:41.407546+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:42.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:42 smithi078 bash[32124]: audit 2024-09-17T09:06:41.409867+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:43.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:43 smithi136 bash[24812]: cluster 2024-09-17T09:06:43.149254+0000 mgr.y (mgr.14532) 582 : cluster [DBG] pgmap v944: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:43.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:43 smithi078 bash[22670]: cluster 2024-09-17T09:06:43.149254+0000 mgr.y (mgr.14532) 582 : cluster [DBG] pgmap v944: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:43.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:43 smithi078 bash[32124]: cluster 2024-09-17T09:06:43.149254+0000 mgr.y (mgr.14532) 582 : cluster [DBG] pgmap v944: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:06:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:45 smithi136 bash[24812]: cluster 2024-09-17T09:06:45.150022+0000 mgr.y (mgr.14532) 583 : cluster [DBG] pgmap v945: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:45 smithi078 bash[22670]: cluster 2024-09-17T09:06:45.150022+0000 mgr.y (mgr.14532) 583 : cluster [DBG] pgmap v945: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:45.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:45 smithi078 bash[32124]: cluster 2024-09-17T09:06:45.150022+0000 mgr.y (mgr.14532) 583 : cluster [DBG] pgmap v945: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:47.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:47 smithi136 bash[24812]: cluster 2024-09-17T09:06:47.150873+0000 mgr.y (mgr.14532) 584 : cluster [DBG] pgmap v946: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:47 smithi078 bash[22670]: cluster 2024-09-17T09:06:47.150873+0000 mgr.y (mgr.14532) 584 : cluster [DBG] pgmap v946: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:47.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:47 smithi078 bash[32124]: cluster 2024-09-17T09:06:47.150873+0000 mgr.y (mgr.14532) 584 : cluster [DBG] pgmap v946: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T09:06:48.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:06:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:06:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:06:49.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:49 smithi136 bash[24812]: cluster 2024-09-17T09:06:48.236257+0000 mon.a (mon.0) 3241 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-09-17T09:06:49.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:49 smithi136 bash[24812]: audit 2024-09-17T09:06:48.294604+0000 mon.a (mon.0) 3242 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:49.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:49 smithi136 bash[24812]: cluster 2024-09-17T09:06:49.151658+0000 mgr.y (mgr.14532) 585 : cluster [DBG] pgmap v948: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:06:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:49 smithi078 bash[22670]: cluster 2024-09-17T09:06:48.236257+0000 mon.a (mon.0) 3241 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-09-17T09:06:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:49 smithi078 bash[22670]: audit 2024-09-17T09:06:48.294604+0000 mon.a (mon.0) 3242 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:49.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:49 smithi078 bash[22670]: cluster 2024-09-17T09:06:49.151658+0000 mgr.y (mgr.14532) 585 : cluster [DBG] pgmap v948: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:06:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:49 smithi078 bash[32124]: cluster 2024-09-17T09:06:48.236257+0000 mon.a (mon.0) 3241 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-09-17T09:06:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:49 smithi078 bash[32124]: audit 2024-09-17T09:06:48.294604+0000 mon.a (mon.0) 3242 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:49 smithi078 bash[32124]: cluster 2024-09-17T09:06:49.151658+0000 mgr.y (mgr.14532) 585 : cluster [DBG] pgmap v948: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:06:50.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:06:49 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:06:50.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:50 smithi136 bash[24812]: audit 2024-09-17T09:06:49.245750+0000 mon.a (mon.0) 3243 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:50.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:50 smithi136 bash[24812]: cluster 2024-09-17T09:06:49.245962+0000 mon.a (mon.0) 3244 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-09-17T09:06:50.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:50 smithi136 bash[24812]: audit 2024-09-17T09:06:49.246982+0000 mon.a (mon.0) 3245 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116"}]: dispatch 2024-09-17T09:06:50.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:50 smithi136 bash[24812]: audit 2024-09-17T09:06:49.948347+0000 mgr.y (mgr.14532) 586 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[22670]: audit 2024-09-17T09:06:49.245750+0000 mon.a (mon.0) 3243 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[22670]: cluster 2024-09-17T09:06:49.245962+0000 mon.a (mon.0) 3244 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-09-17T09:06:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[22670]: audit 2024-09-17T09:06:49.246982+0000 mon.a (mon.0) 3245 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116"}]: dispatch 2024-09-17T09:06:50.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[22670]: audit 2024-09-17T09:06:49.948347+0000 mgr.y (mgr.14532) 586 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[32124]: audit 2024-09-17T09:06:49.245750+0000 mon.a (mon.0) 3243 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:06:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[32124]: cluster 2024-09-17T09:06:49.245962+0000 mon.a (mon.0) 3244 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-09-17T09:06:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[32124]: audit 2024-09-17T09:06:49.246982+0000 mon.a (mon.0) 3245 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116"}]: dispatch 2024-09-17T09:06:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:50 smithi078 bash[32124]: audit 2024-09-17T09:06:49.948347+0000 mgr.y (mgr.14532) 586 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:06:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:51 smithi136 bash[24812]: cluster 2024-09-17T09:06:50.238050+0000 mon.a (mon.0) 3246 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:51 smithi136 bash[24812]: audit 2024-09-17T09:06:50.247675+0000 mon.a (mon.0) 3247 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116"}]': finished 2024-09-17T09:06:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:51 smithi136 bash[24812]: cluster 2024-09-17T09:06:50.247864+0000 mon.a (mon.0) 3248 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-09-17T09:06:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:51 smithi136 bash[24812]: cluster 2024-09-17T09:06:51.152411+0000 mgr.y (mgr.14532) 587 : cluster [DBG] pgmap v951: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:06:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[22670]: cluster 2024-09-17T09:06:50.238050+0000 mon.a (mon.0) 3246 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[22670]: audit 2024-09-17T09:06:50.247675+0000 mon.a (mon.0) 3247 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116"}]': finished 2024-09-17T09:06:51.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[22670]: cluster 2024-09-17T09:06:50.247864+0000 mon.a (mon.0) 3248 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-09-17T09:06:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[22670]: cluster 2024-09-17T09:06:51.152411+0000 mgr.y (mgr.14532) 587 : cluster [DBG] pgmap v951: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:06:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[32124]: cluster 2024-09-17T09:06:50.238050+0000 mon.a (mon.0) 3246 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:06:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[32124]: audit 2024-09-17T09:06:50.247675+0000 mon.a (mon.0) 3247 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-116"}]': finished 2024-09-17T09:06:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[32124]: cluster 2024-09-17T09:06:50.247864+0000 mon.a (mon.0) 3248 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-09-17T09:06:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:51 smithi078 bash[32124]: cluster 2024-09-17T09:06:51.152411+0000 mgr.y (mgr.14532) 587 : cluster [DBG] pgmap v951: 204 pgs: 204 active+clean; 582 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:06:52.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:52 smithi136 bash[24812]: cluster 2024-09-17T09:06:51.253454+0000 mon.a (mon.0) 3249 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:52 smithi136 bash[24812]: cluster 2024-09-17T09:06:51.277685+0000 mon.a (mon.0) 3250 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-09-17T09:06:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:52 smithi078 bash[22670]: cluster 2024-09-17T09:06:51.253454+0000 mon.a (mon.0) 3249 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:52.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:52 smithi078 bash[22670]: cluster 2024-09-17T09:06:51.277685+0000 mon.a (mon.0) 3250 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-09-17T09:06:52.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:52 smithi078 bash[32124]: cluster 2024-09-17T09:06:51.253454+0000 mon.a (mon.0) 3249 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:52 smithi078 bash[32124]: cluster 2024-09-17T09:06:51.277685+0000 mon.a (mon.0) 3250 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-09-17T09:06:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:53 smithi136 bash[24812]: cluster 2024-09-17T09:06:52.285017+0000 mon.a (mon.0) 3251 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-09-17T09:06:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:53 smithi136 bash[24812]: audit 2024-09-17T09:06:52.290154+0000 mon.a (mon.0) 3252 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:53 smithi136 bash[24812]: cluster 2024-09-17T09:06:53.154358+0000 mgr.y (mgr.14532) 588 : cluster [DBG] pgmap v954: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T09:06:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:53 smithi078 bash[22670]: cluster 2024-09-17T09:06:52.285017+0000 mon.a (mon.0) 3251 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-09-17T09:06:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:53 smithi078 bash[22670]: audit 2024-09-17T09:06:52.290154+0000 mon.a (mon.0) 3252 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:53.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:53 smithi078 bash[22670]: cluster 2024-09-17T09:06:53.154358+0000 mgr.y (mgr.14532) 588 : cluster [DBG] pgmap v954: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T09:06:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:53 smithi078 bash[32124]: cluster 2024-09-17T09:06:52.285017+0000 mon.a (mon.0) 3251 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-09-17T09:06:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:53 smithi078 bash[32124]: audit 2024-09-17T09:06:52.290154+0000 mon.a (mon.0) 3252 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:06:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:53 smithi078 bash[32124]: cluster 2024-09-17T09:06:53.154358+0000 mgr.y (mgr.14532) 588 : cluster [DBG] pgmap v954: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T09:06:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:54 smithi136 bash[24812]: audit 2024-09-17T09:06:53.301661+0000 mon.a (mon.0) 3253 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:54 smithi136 bash[24812]: cluster 2024-09-17T09:06:53.302687+0000 mon.a (mon.0) 3254 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-09-17T09:06:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:54 smithi078 bash[22670]: audit 2024-09-17T09:06:53.301661+0000 mon.a (mon.0) 3253 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:54.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:54 smithi078 bash[22670]: cluster 2024-09-17T09:06:53.302687+0000 mon.a (mon.0) 3254 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-09-17T09:06:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:54 smithi078 bash[32124]: audit 2024-09-17T09:06:53.301661+0000 mon.a (mon.0) 3253 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:06:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:54 smithi078 bash[32124]: cluster 2024-09-17T09:06:53.302687+0000 mon.a (mon.0) 3254 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-09-17T09:06:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:55 smithi078 bash[22670]: cluster 2024-09-17T09:06:54.304524+0000 mon.a (mon.0) 3255 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-09-17T09:06:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:55 smithi078 bash[22670]: audit 2024-09-17T09:06:54.322720+0000 mon.a (mon.0) 3256 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:55 smithi078 bash[22670]: cluster 2024-09-17T09:06:55.155220+0000 mgr.y (mgr.14532) 589 : cluster [DBG] pgmap v957: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T09:06:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:55 smithi078 bash[32124]: cluster 2024-09-17T09:06:54.304524+0000 mon.a (mon.0) 3255 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-09-17T09:06:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:55 smithi078 bash[32124]: audit 2024-09-17T09:06:54.322720+0000 mon.a (mon.0) 3256 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:55 smithi078 bash[32124]: cluster 2024-09-17T09:06:55.155220+0000 mgr.y (mgr.14532) 589 : cluster [DBG] pgmap v957: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T09:06:55.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:55 smithi136 bash[24812]: cluster 2024-09-17T09:06:54.304524+0000 mon.a (mon.0) 3255 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-09-17T09:06:55.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:55 smithi136 bash[24812]: audit 2024-09-17T09:06:54.322720+0000 mon.a (mon.0) 3256 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:06:55.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:55 smithi136 bash[24812]: cluster 2024-09-17T09:06:55.155220+0000 mgr.y (mgr.14532) 589 : cluster [DBG] pgmap v957: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T09:06:56.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:56 smithi078 bash[32124]: audit 2024-09-17T09:06:55.321799+0000 mon.a (mon.0) 3257 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:56.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:56 smithi078 bash[32124]: cluster 2024-09-17T09:06:55.321961+0000 mon.a (mon.0) 3258 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-09-17T09:06:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:56 smithi078 bash[32124]: audit 2024-09-17T09:06:55.325032+0000 mon.a (mon.0) 3259 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-118"}]: dispatch 2024-09-17T09:06:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:56 smithi078 bash[22670]: audit 2024-09-17T09:06:55.321799+0000 mon.a (mon.0) 3257 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:56 smithi078 bash[22670]: cluster 2024-09-17T09:06:55.321961+0000 mon.a (mon.0) 3258 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-09-17T09:06:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:56 smithi078 bash[22670]: audit 2024-09-17T09:06:55.325032+0000 mon.a (mon.0) 3259 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-118"}]: dispatch 2024-09-17T09:06:56.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:56 smithi136 bash[24812]: audit 2024-09-17T09:06:55.321799+0000 mon.a (mon.0) 3257 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:06:56.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:56 smithi136 bash[24812]: cluster 2024-09-17T09:06:55.321961+0000 mon.a (mon.0) 3258 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-09-17T09:06:56.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:56 smithi136 bash[24812]: audit 2024-09-17T09:06:55.325032+0000 mon.a (mon.0) 3259 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-118"}]: dispatch 2024-09-17T09:06:57.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: audit 2024-09-17T09:06:56.319499+0000 mon.a (mon.0) 3260 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-118"}]': finished 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: cluster 2024-09-17T09:06:56.320455+0000 mon.a (mon.0) 3261 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: audit 2024-09-17T09:06:56.322202+0000 mon.a (mon.0) 3262 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-118", "mode": "writeback"}]: dispatch 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: audit 2024-09-17T09:06:56.444217+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: audit 2024-09-17T09:06:56.446429+0000 mon.a (mon.0) 3264 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: cluster 2024-09-17T09:06:57.156061+0000 mgr.y (mgr.14532) 590 : cluster [DBG] pgmap v960: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: cluster 2024-09-17T09:06:57.311081+0000 mon.a (mon.0) 3265 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: audit 2024-09-17T09:06:57.321566+0000 mon.a (mon.0) 3266 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-118", "mode": "writeback"}]': finished 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22670]: cluster 2024-09-17T09:06:57.321803+0000 mon.a (mon.0) 3267 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: audit 2024-09-17T09:06:56.319499+0000 mon.a (mon.0) 3260 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-118"}]': finished 2024-09-17T09:06:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: cluster 2024-09-17T09:06:56.320455+0000 mon.a (mon.0) 3261 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-09-17T09:06:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: audit 2024-09-17T09:06:56.322202+0000 mon.a (mon.0) 3262 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-118", "mode": "writeback"}]: dispatch 2024-09-17T09:06:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: audit 2024-09-17T09:06:56.444217+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: audit 2024-09-17T09:06:56.446429+0000 mon.a (mon.0) 3264 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: cluster 2024-09-17T09:06:57.156061+0000 mgr.y (mgr.14532) 590 : cluster [DBG] pgmap v960: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: cluster 2024-09-17T09:06:57.311081+0000 mon.a (mon.0) 3265 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: audit 2024-09-17T09:06:57.321566+0000 mon.a (mon.0) 3266 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-118", "mode": "writeback"}]': finished 2024-09-17T09:06:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[32124]: cluster 2024-09-17T09:06:57.321803+0000 mon.a (mon.0) 3267 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-09-17T09:06:57.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: audit 2024-09-17T09:06:56.319499+0000 mon.a (mon.0) 3260 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-118"}]': finished 2024-09-17T09:06:57.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: cluster 2024-09-17T09:06:56.320455+0000 mon.a (mon.0) 3261 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-09-17T09:06:57.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: audit 2024-09-17T09:06:56.322202+0000 mon.a (mon.0) 3262 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-118", "mode": "writeback"}]: dispatch 2024-09-17T09:06:57.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: audit 2024-09-17T09:06:56.444217+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:06:57.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: audit 2024-09-17T09:06:56.446429+0000 mon.a (mon.0) 3264 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:06:57.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: cluster 2024-09-17T09:06:57.156061+0000 mgr.y (mgr.14532) 590 : cluster [DBG] pgmap v960: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:06:57.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: cluster 2024-09-17T09:06:57.311081+0000 mon.a (mon.0) 3265 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:06:57.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: audit 2024-09-17T09:06:57.321566+0000 mon.a (mon.0) 3266 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-118", "mode": "writeback"}]': finished 2024-09-17T09:06:57.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:57 smithi136 bash[24812]: cluster 2024-09-17T09:06:57.321803+0000 mon.a (mon.0) 3267 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-09-17T09:06:58.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:06:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:06:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:06:58.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:58 smithi136 bash[24812]: cluster 2024-09-17T09:06:57.833251+0000 mon.a (mon.0) 3268 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:58.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:58 smithi136 bash[24812]: cluster 2024-09-17T09:06:57.842899+0000 mon.a (mon.0) 3269 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-09-17T09:06:58.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:58 smithi136 bash[24812]: audit 2024-09-17T09:06:57.908889+0000 mon.a (mon.0) 3270 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:58.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:58 smithi078 bash[32124]: cluster 2024-09-17T09:06:57.833251+0000 mon.a (mon.0) 3268 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:58.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:58 smithi078 bash[32124]: cluster 2024-09-17T09:06:57.842899+0000 mon.a (mon.0) 3269 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-09-17T09:06:58.852 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:58 smithi078 bash[32124]: audit 2024-09-17T09:06:57.908889+0000 mon.a (mon.0) 3270 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:06:58.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:58 smithi078 bash[22670]: cluster 2024-09-17T09:06:57.833251+0000 mon.a (mon.0) 3268 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:06:58.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:58 smithi078 bash[22670]: cluster 2024-09-17T09:06:57.842899+0000 mon.a (mon.0) 3269 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-09-17T09:06:58.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:58 smithi078 bash[22670]: audit 2024-09-17T09:06:57.908889+0000 mon.a (mon.0) 3270 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[22670]: audit 2024-09-17T09:06:58.847102+0000 mon.a (mon.0) 3271 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:00.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[22670]: cluster 2024-09-17T09:06:58.847266+0000 mon.a (mon.0) 3272 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-09-17T09:07:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[22670]: audit 2024-09-17T09:06:58.849341+0000 mon.a (mon.0) 3273 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118"}]: dispatch 2024-09-17T09:07:00.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[22670]: cluster 2024-09-17T09:06:59.156927+0000 mgr.y (mgr.14532) 591 : cluster [DBG] pgmap v964: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 532 B/s wr, 2 op/s 2024-09-17T09:07:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[32124]: audit 2024-09-17T09:06:58.847102+0000 mon.a (mon.0) 3271 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[32124]: cluster 2024-09-17T09:06:58.847266+0000 mon.a (mon.0) 3272 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-09-17T09:07:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[32124]: audit 2024-09-17T09:06:58.849341+0000 mon.a (mon.0) 3273 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118"}]: dispatch 2024-09-17T09:07:00.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:06:59 smithi078 bash[32124]: cluster 2024-09-17T09:06:59.156927+0000 mgr.y (mgr.14532) 591 : cluster [DBG] pgmap v964: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 532 B/s wr, 2 op/s 2024-09-17T09:07:00.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:06:59 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:07:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:59 smithi136 bash[24812]: audit 2024-09-17T09:06:58.847102+0000 mon.a (mon.0) 3271 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:59 smithi136 bash[24812]: cluster 2024-09-17T09:06:58.847266+0000 mon.a (mon.0) 3272 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-09-17T09:07:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:59 smithi136 bash[24812]: audit 2024-09-17T09:06:58.849341+0000 mon.a (mon.0) 3273 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118"}]: dispatch 2024-09-17T09:07:00.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:06:59 smithi136 bash[24812]: cluster 2024-09-17T09:06:59.156927+0000 mgr.y (mgr.14532) 591 : cluster [DBG] pgmap v964: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 532 B/s wr, 2 op/s 2024-09-17T09:07:01.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:00 smithi136 bash[24812]: cluster 2024-09-17T09:06:59.840290+0000 mon.a (mon.0) 3274 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:01.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:00 smithi136 bash[24812]: audit 2024-09-17T09:06:59.858225+0000 mon.a (mon.0) 3275 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118"}]': finished 2024-09-17T09:07:01.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:00 smithi136 bash[24812]: cluster 2024-09-17T09:06:59.858406+0000 mon.a (mon.0) 3276 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-09-17T09:07:01.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:00 smithi136 bash[24812]: audit 2024-09-17T09:06:59.959885+0000 mgr.y (mgr.14532) 592 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[32124]: cluster 2024-09-17T09:06:59.840290+0000 mon.a (mon.0) 3274 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[32124]: audit 2024-09-17T09:06:59.858225+0000 mon.a (mon.0) 3275 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118"}]': finished 2024-09-17T09:07:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[32124]: cluster 2024-09-17T09:06:59.858406+0000 mon.a (mon.0) 3276 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-09-17T09:07:01.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[32124]: audit 2024-09-17T09:06:59.959885+0000 mgr.y (mgr.14532) 592 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[22670]: cluster 2024-09-17T09:06:59.840290+0000 mon.a (mon.0) 3274 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[22670]: audit 2024-09-17T09:06:59.858225+0000 mon.a (mon.0) 3275 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-118"}]': finished 2024-09-17T09:07:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[22670]: cluster 2024-09-17T09:06:59.858406+0000 mon.a (mon.0) 3276 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-09-17T09:07:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:00 smithi078 bash[22670]: audit 2024-09-17T09:06:59.959885+0000 mgr.y (mgr.14532) 592 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:02.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:01 smithi136 bash[24812]: cluster 2024-09-17T09:07:00.857837+0000 mon.a (mon.0) 3277 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-09-17T09:07:02.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:01 smithi136 bash[24812]: cluster 2024-09-17T09:07:01.157699+0000 mgr.y (mgr.14532) 593 : cluster [DBG] pgmap v967: 172 pgs: 172 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 533 B/s wr, 2 op/s 2024-09-17T09:07:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:01 smithi078 bash[22670]: cluster 2024-09-17T09:07:00.857837+0000 mon.a (mon.0) 3277 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-09-17T09:07:02.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:01 smithi078 bash[22670]: cluster 2024-09-17T09:07:01.157699+0000 mgr.y (mgr.14532) 593 : cluster [DBG] pgmap v967: 172 pgs: 172 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 533 B/s wr, 2 op/s 2024-09-17T09:07:02.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:01 smithi078 bash[32124]: cluster 2024-09-17T09:07:00.857837+0000 mon.a (mon.0) 3277 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-09-17T09:07:02.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:01 smithi078 bash[32124]: cluster 2024-09-17T09:07:01.157699+0000 mgr.y (mgr.14532) 593 : cluster [DBG] pgmap v967: 172 pgs: 172 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 533 B/s wr, 2 op/s 2024-09-17T09:07:03.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:02 smithi136 bash[24812]: cluster 2024-09-17T09:07:01.884463+0000 mon.a (mon.0) 3278 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-09-17T09:07:03.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:02 smithi136 bash[24812]: audit 2024-09-17T09:07:01.887320+0000 mon.a (mon.0) 3279 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:03.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:02 smithi136 bash[24812]: audit 2024-09-17T09:07:02.846399+0000 mon.a (mon.0) 3280 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:03.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:02 smithi136 bash[24812]: cluster 2024-09-17T09:07:02.847010+0000 mon.a (mon.0) 3281 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-09-17T09:07:03.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[22670]: cluster 2024-09-17T09:07:01.884463+0000 mon.a (mon.0) 3278 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-09-17T09:07:03.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[22670]: audit 2024-09-17T09:07:01.887320+0000 mon.a (mon.0) 3279 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:03.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[22670]: audit 2024-09-17T09:07:02.846399+0000 mon.a (mon.0) 3280 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[22670]: cluster 2024-09-17T09:07:02.847010+0000 mon.a (mon.0) 3281 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-09-17T09:07:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[32124]: cluster 2024-09-17T09:07:01.884463+0000 mon.a (mon.0) 3278 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-09-17T09:07:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[32124]: audit 2024-09-17T09:07:01.887320+0000 mon.a (mon.0) 3279 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[32124]: audit 2024-09-17T09:07:02.846399+0000 mon.a (mon.0) 3280 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:02 smithi078 bash[32124]: cluster 2024-09-17T09:07:02.847010+0000 mon.a (mon.0) 3281 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-09-17T09:07:04.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:03 smithi136 bash[24812]: audit 2024-09-17T09:07:02.895343+0000 mon.a (mon.0) 3282 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:04.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:03 smithi136 bash[24812]: cluster 2024-09-17T09:07:03.159631+0000 mgr.y (mgr.14532) 594 : cluster [DBG] pgmap v970: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:04.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:03 smithi136 bash[24812]: audit 2024-09-17T09:07:03.850337+0000 mon.a (mon.0) 3283 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:04.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:03 smithi136 bash[24812]: cluster 2024-09-17T09:07:03.850515+0000 mon.a (mon.0) 3284 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-09-17T09:07:04.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:03 smithi136 bash[24812]: audit 2024-09-17T09:07:03.851772+0000 mon.a (mon.0) 3285 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-120"}]: dispatch 2024-09-17T09:07:04.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[22670]: audit 2024-09-17T09:07:02.895343+0000 mon.a (mon.0) 3282 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:04.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[22670]: cluster 2024-09-17T09:07:03.159631+0000 mgr.y (mgr.14532) 594 : cluster [DBG] pgmap v970: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[22670]: audit 2024-09-17T09:07:03.850337+0000 mon.a (mon.0) 3283 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[22670]: cluster 2024-09-17T09:07:03.850515+0000 mon.a (mon.0) 3284 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[22670]: audit 2024-09-17T09:07:03.851772+0000 mon.a (mon.0) 3285 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-120"}]: dispatch 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[32124]: audit 2024-09-17T09:07:02.895343+0000 mon.a (mon.0) 3282 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[32124]: cluster 2024-09-17T09:07:03.159631+0000 mgr.y (mgr.14532) 594 : cluster [DBG] pgmap v970: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[32124]: audit 2024-09-17T09:07:03.850337+0000 mon.a (mon.0) 3283 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[32124]: cluster 2024-09-17T09:07:03.850515+0000 mon.a (mon.0) 3284 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-09-17T09:07:04.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:03 smithi078 bash[32124]: audit 2024-09-17T09:07:03.851772+0000 mon.a (mon.0) 3285 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-120"}]: dispatch 2024-09-17T09:07:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:05 smithi136 bash[24812]: audit 2024-09-17T09:07:04.851748+0000 mon.a (mon.0) 3286 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-120"}]': finished 2024-09-17T09:07:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:05 smithi136 bash[24812]: cluster 2024-09-17T09:07:04.852669+0000 mon.a (mon.0) 3287 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-09-17T09:07:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:05 smithi136 bash[24812]: audit 2024-09-17T09:07:04.856078+0000 mon.a (mon.0) 3288 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-120", "mode": "writeback"}]: dispatch 2024-09-17T09:07:06.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:05 smithi136 bash[24812]: cluster 2024-09-17T09:07:05.160550+0000 mgr.y (mgr.14532) 595 : cluster [DBG] pgmap v973: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[22670]: audit 2024-09-17T09:07:04.851748+0000 mon.a (mon.0) 3286 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-120"}]': finished 2024-09-17T09:07:06.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[22670]: cluster 2024-09-17T09:07:04.852669+0000 mon.a (mon.0) 3287 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-09-17T09:07:06.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[22670]: audit 2024-09-17T09:07:04.856078+0000 mon.a (mon.0) 3288 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-120", "mode": "writeback"}]: dispatch 2024-09-17T09:07:06.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[22670]: cluster 2024-09-17T09:07:05.160550+0000 mgr.y (mgr.14532) 595 : cluster [DBG] pgmap v973: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:06.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[32124]: audit 2024-09-17T09:07:04.851748+0000 mon.a (mon.0) 3286 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-120"}]': finished 2024-09-17T09:07:06.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[32124]: cluster 2024-09-17T09:07:04.852669+0000 mon.a (mon.0) 3287 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-09-17T09:07:06.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[32124]: audit 2024-09-17T09:07:04.856078+0000 mon.a (mon.0) 3288 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-120", "mode": "writeback"}]: dispatch 2024-09-17T09:07:06.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:05 smithi078 bash[32124]: cluster 2024-09-17T09:07:05.160550+0000 mgr.y (mgr.14532) 595 : cluster [DBG] pgmap v973: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:06 smithi136 bash[24812]: cluster 2024-09-17T09:07:05.846288+0000 mon.a (mon.0) 3289 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:06 smithi136 bash[24812]: audit 2024-09-17T09:07:05.864159+0000 mon.a (mon.0) 3290 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-120", "mode": "writeback"}]': finished 2024-09-17T09:07:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:06 smithi136 bash[24812]: cluster 2024-09-17T09:07:05.864320+0000 mon.a (mon.0) 3291 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-09-17T09:07:07.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:06 smithi136 bash[24812]: audit 2024-09-17T09:07:05.998447+0000 mon.a (mon.0) 3292 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:07.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[22670]: cluster 2024-09-17T09:07:05.846288+0000 mon.a (mon.0) 3289 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:07.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[22670]: audit 2024-09-17T09:07:05.864159+0000 mon.a (mon.0) 3290 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-120", "mode": "writeback"}]': finished 2024-09-17T09:07:07.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[22670]: cluster 2024-09-17T09:07:05.864320+0000 mon.a (mon.0) 3291 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-09-17T09:07:07.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[22670]: audit 2024-09-17T09:07:05.998447+0000 mon.a (mon.0) 3292 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[32124]: cluster 2024-09-17T09:07:05.846288+0000 mon.a (mon.0) 3289 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[32124]: audit 2024-09-17T09:07:05.864159+0000 mon.a (mon.0) 3290 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-120", "mode": "writeback"}]': finished 2024-09-17T09:07:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[32124]: cluster 2024-09-17T09:07:05.864320+0000 mon.a (mon.0) 3291 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-09-17T09:07:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:06 smithi078 bash[32124]: audit 2024-09-17T09:07:05.998447+0000 mon.a (mon.0) 3292 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:07 smithi136 bash[24812]: audit 2024-09-17T09:07:06.863452+0000 mon.a (mon.0) 3293 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:07 smithi136 bash[24812]: cluster 2024-09-17T09:07:06.863655+0000 mon.a (mon.0) 3294 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2024-09-17T09:07:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:07 smithi136 bash[24812]: audit 2024-09-17T09:07:06.865850+0000 mon.a (mon.0) 3295 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120"}]: dispatch 2024-09-17T09:07:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:07 smithi136 bash[24812]: cluster 2024-09-17T09:07:07.161381+0000 mgr.y (mgr.14532) 596 : cluster [DBG] pgmap v976: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:08.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:07 smithi136 bash[24812]: cluster 2024-09-17T09:07:07.856869+0000 mon.a (mon.0) 3296 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:08.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:07:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[32124]: audit 2024-09-17T09:07:06.863452+0000 mon.a (mon.0) 3293 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[32124]: cluster 2024-09-17T09:07:06.863655+0000 mon.a (mon.0) 3294 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[32124]: audit 2024-09-17T09:07:06.865850+0000 mon.a (mon.0) 3295 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120"}]: dispatch 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[32124]: cluster 2024-09-17T09:07:07.161381+0000 mgr.y (mgr.14532) 596 : cluster [DBG] pgmap v976: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[32124]: cluster 2024-09-17T09:07:07.856869+0000 mon.a (mon.0) 3296 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[22670]: audit 2024-09-17T09:07:06.863452+0000 mon.a (mon.0) 3293 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[22670]: cluster 2024-09-17T09:07:06.863655+0000 mon.a (mon.0) 3294 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[22670]: audit 2024-09-17T09:07:06.865850+0000 mon.a (mon.0) 3295 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120"}]: dispatch 2024-09-17T09:07:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[22670]: cluster 2024-09-17T09:07:07.161381+0000 mgr.y (mgr.14532) 596 : cluster [DBG] pgmap v976: 204 pgs: 204 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:07 smithi078 bash[22670]: cluster 2024-09-17T09:07:07.856869+0000 mon.a (mon.0) 3296 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:08 smithi136 bash[24812]: audit 2024-09-17T09:07:07.866850+0000 mon.a (mon.0) 3297 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120"}]': finished 2024-09-17T09:07:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:08 smithi136 bash[24812]: cluster 2024-09-17T09:07:07.867031+0000 mon.a (mon.0) 3298 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2024-09-17T09:07:09.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:08 smithi078 bash[22670]: audit 2024-09-17T09:07:07.866850+0000 mon.a (mon.0) 3297 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120"}]': finished 2024-09-17T09:07:09.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:08 smithi078 bash[22670]: cluster 2024-09-17T09:07:07.867031+0000 mon.a (mon.0) 3298 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2024-09-17T09:07:09.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:08 smithi078 bash[32124]: audit 2024-09-17T09:07:07.866850+0000 mon.a (mon.0) 3297 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-120"}]': finished 2024-09-17T09:07:09.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:08 smithi078 bash[32124]: cluster 2024-09-17T09:07:07.867031+0000 mon.a (mon.0) 3298 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2024-09-17T09:07:10.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:07:09 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:07:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:09 smithi136 bash[24812]: cluster 2024-09-17T09:07:08.896816+0000 mon.a (mon.0) 3299 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2024-09-17T09:07:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:09 smithi136 bash[24812]: cluster 2024-09-17T09:07:09.162117+0000 mgr.y (mgr.14532) 597 : cluster [DBG] pgmap v979: 172 pgs: 172 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:10.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:09 smithi078 bash[32124]: cluster 2024-09-17T09:07:08.896816+0000 mon.a (mon.0) 3299 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2024-09-17T09:07:10.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:09 smithi078 bash[32124]: cluster 2024-09-17T09:07:09.162117+0000 mgr.y (mgr.14532) 597 : cluster [DBG] pgmap v979: 172 pgs: 172 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:10.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:09 smithi078 bash[22670]: cluster 2024-09-17T09:07:08.896816+0000 mon.a (mon.0) 3299 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2024-09-17T09:07:10.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:09 smithi078 bash[22670]: cluster 2024-09-17T09:07:09.162117+0000 mgr.y (mgr.14532) 597 : cluster [DBG] pgmap v979: 172 pgs: 172 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:10 smithi136 bash[24812]: cluster 2024-09-17T09:07:09.913784+0000 mon.a (mon.0) 3300 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2024-09-17T09:07:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:10 smithi136 bash[24812]: audit 2024-09-17T09:07:09.918715+0000 mon.a (mon.0) 3301 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:10 smithi136 bash[24812]: audit 2024-09-17T09:07:09.971423+0000 mgr.y (mgr.14532) 598 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:11.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:10 smithi078 bash[32124]: cluster 2024-09-17T09:07:09.913784+0000 mon.a (mon.0) 3300 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2024-09-17T09:07:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:10 smithi078 bash[32124]: audit 2024-09-17T09:07:09.918715+0000 mon.a (mon.0) 3301 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:10 smithi078 bash[32124]: audit 2024-09-17T09:07:09.971423+0000 mgr.y (mgr.14532) 598 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:10 smithi078 bash[22670]: cluster 2024-09-17T09:07:09.913784+0000 mon.a (mon.0) 3300 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2024-09-17T09:07:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:10 smithi078 bash[22670]: audit 2024-09-17T09:07:09.918715+0000 mon.a (mon.0) 3301 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:11.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:10 smithi078 bash[22670]: audit 2024-09-17T09:07:09.971423+0000 mgr.y (mgr.14532) 598 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:11 smithi136 bash[24812]: audit 2024-09-17T09:07:10.911049+0000 mon.a (mon.0) 3302 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:11 smithi136 bash[24812]: cluster 2024-09-17T09:07:10.911614+0000 mon.a (mon.0) 3303 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2024-09-17T09:07:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:11 smithi136 bash[24812]: audit 2024-09-17T09:07:10.949328+0000 mon.a (mon.0) 3304 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:11 smithi136 bash[24812]: cluster 2024-09-17T09:07:11.163059+0000 mgr.y (mgr.14532) 599 : cluster [DBG] pgmap v982: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:12.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:11 smithi136 bash[24812]: audit 2024-09-17T09:07:11.474837+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:12.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[32124]: audit 2024-09-17T09:07:10.911049+0000 mon.a (mon.0) 3302 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[32124]: cluster 2024-09-17T09:07:10.911614+0000 mon.a (mon.0) 3303 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[32124]: audit 2024-09-17T09:07:10.949328+0000 mon.a (mon.0) 3304 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[32124]: cluster 2024-09-17T09:07:11.163059+0000 mgr.y (mgr.14532) 599 : cluster [DBG] pgmap v982: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[32124]: audit 2024-09-17T09:07:11.474837+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[22670]: audit 2024-09-17T09:07:10.911049+0000 mon.a (mon.0) 3302 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[22670]: cluster 2024-09-17T09:07:10.911614+0000 mon.a (mon.0) 3303 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[22670]: audit 2024-09-17T09:07:10.949328+0000 mon.a (mon.0) 3304 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[22670]: cluster 2024-09-17T09:07:11.163059+0000 mgr.y (mgr.14532) 599 : cluster [DBG] pgmap v982: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:12.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:11 smithi078 bash[22670]: audit 2024-09-17T09:07:11.474837+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:13.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:12 smithi136 bash[24812]: audit 2024-09-17T09:07:11.937327+0000 mon.a (mon.0) 3306 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:13.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:12 smithi136 bash[24812]: cluster 2024-09-17T09:07:11.937485+0000 mon.a (mon.0) 3307 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2024-09-17T09:07:13.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:12 smithi136 bash[24812]: audit 2024-09-17T09:07:11.938485+0000 mon.a (mon.0) 3308 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-122"}]: dispatch 2024-09-17T09:07:13.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:12 smithi078 bash[32124]: audit 2024-09-17T09:07:11.937327+0000 mon.a (mon.0) 3306 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:13.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:12 smithi078 bash[32124]: cluster 2024-09-17T09:07:11.937485+0000 mon.a (mon.0) 3307 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2024-09-17T09:07:13.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:12 smithi078 bash[32124]: audit 2024-09-17T09:07:11.938485+0000 mon.a (mon.0) 3308 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-122"}]: dispatch 2024-09-17T09:07:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:12 smithi078 bash[22670]: audit 2024-09-17T09:07:11.937327+0000 mon.a (mon.0) 3306 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:12 smithi078 bash[22670]: cluster 2024-09-17T09:07:11.937485+0000 mon.a (mon.0) 3307 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2024-09-17T09:07:13.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:12 smithi078 bash[22670]: audit 2024-09-17T09:07:11.938485+0000 mon.a (mon.0) 3308 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-122"}]: dispatch 2024-09-17T09:07:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:13 smithi136 bash[24812]: audit 2024-09-17T09:07:12.937120+0000 mon.a (mon.0) 3309 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-122"}]': finished 2024-09-17T09:07:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:13 smithi136 bash[24812]: cluster 2024-09-17T09:07:12.937603+0000 mon.a (mon.0) 3310 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2024-09-17T09:07:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:13 smithi136 bash[24812]: audit 2024-09-17T09:07:12.939682+0000 mon.a (mon.0) 3311 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-122", "mode": "writeback"}]: dispatch 2024-09-17T09:07:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:13 smithi136 bash[24812]: cluster 2024-09-17T09:07:13.164800+0000 mgr.y (mgr.14532) 600 : cluster [DBG] pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:13 smithi136 bash[24812]: cluster 2024-09-17T09:07:13.930771+0000 mon.a (mon.0) 3312 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:13 smithi136 bash[24812]: audit 2024-09-17T09:07:13.940458+0000 mon.a (mon.0) 3313 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-122", "mode": "writeback"}]': finished 2024-09-17T09:07:14.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:13 smithi136 bash[24812]: cluster 2024-09-17T09:07:13.940646+0000 mon.a (mon.0) 3314 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2024-09-17T09:07:14.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[22670]: audit 2024-09-17T09:07:12.937120+0000 mon.a (mon.0) 3309 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-122"}]': finished 2024-09-17T09:07:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[22670]: cluster 2024-09-17T09:07:12.937603+0000 mon.a (mon.0) 3310 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2024-09-17T09:07:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[22670]: audit 2024-09-17T09:07:12.939682+0000 mon.a (mon.0) 3311 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-122", "mode": "writeback"}]: dispatch 2024-09-17T09:07:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[22670]: cluster 2024-09-17T09:07:13.164800+0000 mgr.y (mgr.14532) 600 : cluster [DBG] pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[22670]: cluster 2024-09-17T09:07:13.930771+0000 mon.a (mon.0) 3312 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[22670]: audit 2024-09-17T09:07:13.940458+0000 mon.a (mon.0) 3313 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-122", "mode": "writeback"}]': finished 2024-09-17T09:07:14.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[22670]: cluster 2024-09-17T09:07:13.940646+0000 mon.a (mon.0) 3314 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2024-09-17T09:07:14.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[32124]: audit 2024-09-17T09:07:12.937120+0000 mon.a (mon.0) 3309 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-122"}]': finished 2024-09-17T09:07:14.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[32124]: cluster 2024-09-17T09:07:12.937603+0000 mon.a (mon.0) 3310 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2024-09-17T09:07:14.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[32124]: audit 2024-09-17T09:07:12.939682+0000 mon.a (mon.0) 3311 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-122", "mode": "writeback"}]: dispatch 2024-09-17T09:07:14.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[32124]: cluster 2024-09-17T09:07:13.164800+0000 mgr.y (mgr.14532) 600 : cluster [DBG] pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:14.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[32124]: cluster 2024-09-17T09:07:13.930771+0000 mon.a (mon.0) 3312 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:14.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[32124]: audit 2024-09-17T09:07:13.940458+0000 mon.a (mon.0) 3313 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-122", "mode": "writeback"}]': finished 2024-09-17T09:07:14.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:13 smithi078 bash[32124]: cluster 2024-09-17T09:07:13.940646+0000 mon.a (mon.0) 3314 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2024-09-17T09:07:15.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:14 smithi136 bash[24812]: audit 2024-09-17T09:07:14.060053+0000 mon.a (mon.0) 3315 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:15.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:14 smithi078 bash[22670]: audit 2024-09-17T09:07:14.060053+0000 mon.a (mon.0) 3315 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:15.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:14 smithi078 bash[32124]: audit 2024-09-17T09:07:14.060053+0000 mon.a (mon.0) 3315 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:15 smithi136 bash[24812]: audit 2024-09-17T09:07:14.975263+0000 mon.a (mon.0) 3316 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:15 smithi136 bash[24812]: cluster 2024-09-17T09:07:14.975418+0000 mon.a (mon.0) 3317 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2024-09-17T09:07:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:15 smithi136 bash[24812]: audit 2024-09-17T09:07:14.977995+0000 mon.a (mon.0) 3318 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122"}]: dispatch 2024-09-17T09:07:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:15 smithi136 bash[24812]: cluster 2024-09-17T09:07:15.165551+0000 mgr.y (mgr.14532) 601 : cluster [DBG] pgmap v988: 204 pgs: 204 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[22670]: audit 2024-09-17T09:07:14.975263+0000 mon.a (mon.0) 3316 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:16.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[22670]: cluster 2024-09-17T09:07:14.975418+0000 mon.a (mon.0) 3317 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2024-09-17T09:07:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[22670]: audit 2024-09-17T09:07:14.977995+0000 mon.a (mon.0) 3318 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122"}]: dispatch 2024-09-17T09:07:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[22670]: cluster 2024-09-17T09:07:15.165551+0000 mgr.y (mgr.14532) 601 : cluster [DBG] pgmap v988: 204 pgs: 204 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[32124]: audit 2024-09-17T09:07:14.975263+0000 mon.a (mon.0) 3316 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[32124]: cluster 2024-09-17T09:07:14.975418+0000 mon.a (mon.0) 3317 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2024-09-17T09:07:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[32124]: audit 2024-09-17T09:07:14.977995+0000 mon.a (mon.0) 3318 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122"}]: dispatch 2024-09-17T09:07:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:15 smithi078 bash[32124]: cluster 2024-09-17T09:07:15.165551+0000 mgr.y (mgr.14532) 601 : cluster [DBG] pgmap v988: 204 pgs: 204 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:17 smithi136 bash[24812]: cluster 2024-09-17T09:07:15.968977+0000 mon.a (mon.0) 3319 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:17 smithi136 bash[24812]: audit 2024-09-17T09:07:15.986186+0000 mon.a (mon.0) 3320 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122"}]': finished 2024-09-17T09:07:17.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:17 smithi136 bash[24812]: cluster 2024-09-17T09:07:15.986368+0000 mon.a (mon.0) 3321 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2024-09-17T09:07:17.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:17 smithi078 bash[22670]: cluster 2024-09-17T09:07:15.968977+0000 mon.a (mon.0) 3319 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:17.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:17 smithi078 bash[22670]: audit 2024-09-17T09:07:15.986186+0000 mon.a (mon.0) 3320 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122"}]': finished 2024-09-17T09:07:17.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:17 smithi078 bash[22670]: cluster 2024-09-17T09:07:15.986368+0000 mon.a (mon.0) 3321 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2024-09-17T09:07:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:17 smithi078 bash[32124]: cluster 2024-09-17T09:07:15.968977+0000 mon.a (mon.0) 3319 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:17 smithi078 bash[32124]: audit 2024-09-17T09:07:15.986186+0000 mon.a (mon.0) 3320 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-122"}]': finished 2024-09-17T09:07:17.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:17 smithi078 bash[32124]: cluster 2024-09-17T09:07:15.986368+0000 mon.a (mon.0) 3321 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2024-09-17T09:07:18.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:07:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:07:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:07:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:18 smithi136 bash[24812]: cluster 2024-09-17T09:07:16.985891+0000 mon.a (mon.0) 3322 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2024-09-17T09:07:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:18 smithi136 bash[24812]: cluster 2024-09-17T09:07:17.166487+0000 mgr.y (mgr.14532) 602 : cluster [DBG] pgmap v991: 172 pgs: 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:18 smithi136 bash[24812]: cluster 2024-09-17T09:07:17.998045+0000 mon.a (mon.0) 3323 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2024-09-17T09:07:18.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:18 smithi136 bash[24812]: audit 2024-09-17T09:07:18.004882+0000 mon.a (mon.0) 3324 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:18.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[22670]: cluster 2024-09-17T09:07:16.985891+0000 mon.a (mon.0) 3322 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2024-09-17T09:07:18.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[22670]: cluster 2024-09-17T09:07:17.166487+0000 mgr.y (mgr.14532) 602 : cluster [DBG] pgmap v991: 172 pgs: 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:18.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[22670]: cluster 2024-09-17T09:07:17.998045+0000 mon.a (mon.0) 3323 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2024-09-17T09:07:18.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[22670]: audit 2024-09-17T09:07:18.004882+0000 mon.a (mon.0) 3324 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:18.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[32124]: cluster 2024-09-17T09:07:16.985891+0000 mon.a (mon.0) 3322 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2024-09-17T09:07:18.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[32124]: cluster 2024-09-17T09:07:17.166487+0000 mgr.y (mgr.14532) 602 : cluster [DBG] pgmap v991: 172 pgs: 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:18.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[32124]: cluster 2024-09-17T09:07:17.998045+0000 mon.a (mon.0) 3323 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2024-09-17T09:07:18.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:18 smithi078 bash[32124]: audit 2024-09-17T09:07:18.004882+0000 mon.a (mon.0) 3324 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:20.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:07:19 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:07:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:20 smithi136 bash[24812]: audit 2024-09-17T09:07:19.006601+0000 mon.a (mon.0) 3325 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:20 smithi136 bash[24812]: cluster 2024-09-17T09:07:19.007051+0000 mon.a (mon.0) 3326 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2024-09-17T09:07:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:20 smithi136 bash[24812]: cluster 2024-09-17T09:07:19.167316+0000 mgr.y (mgr.14532) 603 : cluster [DBG] pgmap v994: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:20.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:20 smithi078 bash[22670]: audit 2024-09-17T09:07:19.006601+0000 mon.a (mon.0) 3325 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:20 smithi078 bash[22670]: cluster 2024-09-17T09:07:19.007051+0000 mon.a (mon.0) 3326 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2024-09-17T09:07:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:20 smithi078 bash[22670]: cluster 2024-09-17T09:07:19.167316+0000 mgr.y (mgr.14532) 603 : cluster [DBG] pgmap v994: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:20.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:20 smithi078 bash[32124]: audit 2024-09-17T09:07:19.006601+0000 mon.a (mon.0) 3325 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:20.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:20 smithi078 bash[32124]: cluster 2024-09-17T09:07:19.007051+0000 mon.a (mon.0) 3326 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2024-09-17T09:07:20.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:20 smithi078 bash[32124]: cluster 2024-09-17T09:07:19.167316+0000 mgr.y (mgr.14532) 603 : cluster [DBG] pgmap v994: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:21 smithi136 bash[24812]: audit 2024-09-17T09:07:19.982920+0000 mgr.y (mgr.14532) 604 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:21 smithi136 bash[24812]: cluster 2024-09-17T09:07:20.012377+0000 mon.a (mon.0) 3327 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2024-09-17T09:07:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:21 smithi136 bash[24812]: audit 2024-09-17T09:07:20.039631+0000 mon.a (mon.0) 3328 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:21.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:21 smithi078 bash[22670]: audit 2024-09-17T09:07:19.982920+0000 mgr.y (mgr.14532) 604 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:21 smithi078 bash[22670]: cluster 2024-09-17T09:07:20.012377+0000 mon.a (mon.0) 3327 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2024-09-17T09:07:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:21 smithi078 bash[22670]: audit 2024-09-17T09:07:20.039631+0000 mon.a (mon.0) 3328 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:21 smithi078 bash[32124]: audit 2024-09-17T09:07:19.982920+0000 mgr.y (mgr.14532) 604 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:21 smithi078 bash[32124]: cluster 2024-09-17T09:07:20.012377+0000 mon.a (mon.0) 3327 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2024-09-17T09:07:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:21 smithi078 bash[32124]: audit 2024-09-17T09:07:20.039631+0000 mon.a (mon.0) 3328 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:22 smithi136 bash[24812]: audit 2024-09-17T09:07:21.016226+0000 mon.a (mon.0) 3329 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:22 smithi136 bash[24812]: cluster 2024-09-17T09:07:21.016416+0000 mon.a (mon.0) 3330 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2024-09-17T09:07:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:22 smithi136 bash[24812]: audit 2024-09-17T09:07:21.017884+0000 mon.a (mon.0) 3331 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-124"}]: dispatch 2024-09-17T09:07:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:22 smithi136 bash[24812]: cluster 2024-09-17T09:07:21.168127+0000 mgr.y (mgr.14532) 605 : cluster [DBG] pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:22.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:22 smithi136 bash[24812]: audit 2024-09-17T09:07:22.018347+0000 mon.a (mon.0) 3332 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-124"}]': finished 2024-09-17T09:07:22.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:22 smithi136 bash[24812]: cluster 2024-09-17T09:07:22.018577+0000 mon.a (mon.0) 3333 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2024-09-17T09:07:22.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:22 smithi136 bash[24812]: audit 2024-09-17T09:07:22.019562+0000 mon.a (mon.0) 3334 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-124", "mode": "writeback"}]: dispatch 2024-09-17T09:07:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[22670]: audit 2024-09-17T09:07:21.016226+0000 mon.a (mon.0) 3329 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[22670]: cluster 2024-09-17T09:07:21.016416+0000 mon.a (mon.0) 3330 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2024-09-17T09:07:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[22670]: audit 2024-09-17T09:07:21.017884+0000 mon.a (mon.0) 3331 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-124"}]: dispatch 2024-09-17T09:07:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[22670]: cluster 2024-09-17T09:07:21.168127+0000 mgr.y (mgr.14532) 605 : cluster [DBG] pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[22670]: audit 2024-09-17T09:07:22.018347+0000 mon.a (mon.0) 3332 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-124"}]': finished 2024-09-17T09:07:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[22670]: cluster 2024-09-17T09:07:22.018577+0000 mon.a (mon.0) 3333 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2024-09-17T09:07:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[22670]: audit 2024-09-17T09:07:22.019562+0000 mon.a (mon.0) 3334 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-124", "mode": "writeback"}]: dispatch 2024-09-17T09:07:22.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[32124]: audit 2024-09-17T09:07:21.016226+0000 mon.a (mon.0) 3329 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:22.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[32124]: cluster 2024-09-17T09:07:21.016416+0000 mon.a (mon.0) 3330 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2024-09-17T09:07:22.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[32124]: audit 2024-09-17T09:07:21.017884+0000 mon.a (mon.0) 3331 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-124"}]: dispatch 2024-09-17T09:07:22.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[32124]: cluster 2024-09-17T09:07:21.168127+0000 mgr.y (mgr.14532) 605 : cluster [DBG] pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:22.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[32124]: audit 2024-09-17T09:07:22.018347+0000 mon.a (mon.0) 3332 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-124"}]': finished 2024-09-17T09:07:22.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[32124]: cluster 2024-09-17T09:07:22.018577+0000 mon.a (mon.0) 3333 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2024-09-17T09:07:22.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:22 smithi078 bash[32124]: audit 2024-09-17T09:07:22.019562+0000 mon.a (mon.0) 3334 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-124", "mode": "writeback"}]: dispatch 2024-09-17T09:07:23.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:23 smithi078 bash[32124]: cluster 2024-09-17T09:07:23.013173+0000 mon.a (mon.0) 3335 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:23 smithi078 bash[32124]: audit 2024-09-17T09:07:23.023509+0000 mon.a (mon.0) 3336 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-124", "mode": "writeback"}]': finished 2024-09-17T09:07:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:23 smithi078 bash[32124]: cluster 2024-09-17T09:07:23.024015+0000 mon.a (mon.0) 3337 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2024-09-17T09:07:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:23 smithi078 bash[22670]: cluster 2024-09-17T09:07:23.013173+0000 mon.a (mon.0) 3335 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:23 smithi078 bash[22670]: audit 2024-09-17T09:07:23.023509+0000 mon.a (mon.0) 3336 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-124", "mode": "writeback"}]': finished 2024-09-17T09:07:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:23 smithi078 bash[22670]: cluster 2024-09-17T09:07:23.024015+0000 mon.a (mon.0) 3337 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2024-09-17T09:07:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:23 smithi136 bash[24812]: cluster 2024-09-17T09:07:23.013173+0000 mon.a (mon.0) 3335 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:23 smithi136 bash[24812]: audit 2024-09-17T09:07:23.023509+0000 mon.a (mon.0) 3336 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-124", "mode": "writeback"}]': finished 2024-09-17T09:07:23.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:23 smithi136 bash[24812]: cluster 2024-09-17T09:07:23.024015+0000 mon.a (mon.0) 3337 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2024-09-17T09:07:24.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:24 smithi078 bash[22670]: cluster 2024-09-17T09:07:23.169004+0000 mgr.y (mgr.14532) 606 : cluster [DBG] pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:07:24.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:24 smithi078 bash[32124]: cluster 2024-09-17T09:07:23.169004+0000 mgr.y (mgr.14532) 606 : cluster [DBG] pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:07:24.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:24 smithi136 bash[24812]: cluster 2024-09-17T09:07:23.169004+0000 mgr.y (mgr.14532) 606 : cluster [DBG] pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:07:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:25 smithi078 bash[22670]: cluster 2024-09-17T09:07:24.062792+0000 mon.a (mon.0) 3338 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2024-09-17T09:07:25.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:25 smithi078 bash[22670]: audit 2024-09-17T09:07:24.128148+0000 mon.a (mon.0) 3339 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:25 smithi078 bash[32124]: cluster 2024-09-17T09:07:24.062792+0000 mon.a (mon.0) 3338 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2024-09-17T09:07:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:25 smithi078 bash[32124]: audit 2024-09-17T09:07:24.128148+0000 mon.a (mon.0) 3339 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:25 smithi136 bash[24812]: cluster 2024-09-17T09:07:24.062792+0000 mon.a (mon.0) 3338 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2024-09-17T09:07:25.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:25 smithi136 bash[24812]: audit 2024-09-17T09:07:24.128148+0000 mon.a (mon.0) 3339 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:26.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[32124]: audit 2024-09-17T09:07:25.062238+0000 mon.a (mon.0) 3340 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[32124]: cluster 2024-09-17T09:07:25.062404+0000 mon.a (mon.0) 3341 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[32124]: audit 2024-09-17T09:07:25.064749+0000 mon.a (mon.0) 3342 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124"}]: dispatch 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[32124]: cluster 2024-09-17T09:07:25.169840+0000 mgr.y (mgr.14532) 607 : cluster [DBG] pgmap v1003: 204 pgs: 204 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[32124]: cluster 2024-09-17T09:07:26.055797+0000 mon.a (mon.0) 3343 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[22670]: audit 2024-09-17T09:07:25.062238+0000 mon.a (mon.0) 3340 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[22670]: cluster 2024-09-17T09:07:25.062404+0000 mon.a (mon.0) 3341 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[22670]: audit 2024-09-17T09:07:25.064749+0000 mon.a (mon.0) 3342 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124"}]: dispatch 2024-09-17T09:07:26.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[22670]: cluster 2024-09-17T09:07:25.169840+0000 mgr.y (mgr.14532) 607 : cluster [DBG] pgmap v1003: 204 pgs: 204 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:07:26.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:26 smithi078 bash[22670]: cluster 2024-09-17T09:07:26.055797+0000 mon.a (mon.0) 3343 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:26 smithi136 bash[24812]: audit 2024-09-17T09:07:25.062238+0000 mon.a (mon.0) 3340 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:26 smithi136 bash[24812]: cluster 2024-09-17T09:07:25.062404+0000 mon.a (mon.0) 3341 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2024-09-17T09:07:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:26 smithi136 bash[24812]: audit 2024-09-17T09:07:25.064749+0000 mon.a (mon.0) 3342 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124"}]: dispatch 2024-09-17T09:07:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:26 smithi136 bash[24812]: cluster 2024-09-17T09:07:25.169840+0000 mgr.y (mgr.14532) 607 : cluster [DBG] pgmap v1003: 204 pgs: 204 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-17T09:07:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:26 smithi136 bash[24812]: cluster 2024-09-17T09:07:26.055797+0000 mon.a (mon.0) 3343 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:27.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:27 smithi136 bash[24812]: audit 2024-09-17T09:07:26.065577+0000 mon.a (mon.0) 3344 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124"}]': finished 2024-09-17T09:07:27.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:27 smithi136 bash[24812]: cluster 2024-09-17T09:07:26.065812+0000 mon.a (mon.0) 3345 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2024-09-17T09:07:27.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:27 smithi136 bash[24812]: audit 2024-09-17T09:07:26.504359+0000 mon.a (mon.0) 3346 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:27 smithi078 bash[32124]: audit 2024-09-17T09:07:26.065577+0000 mon.a (mon.0) 3344 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124"}]': finished 2024-09-17T09:07:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:27 smithi078 bash[32124]: cluster 2024-09-17T09:07:26.065812+0000 mon.a (mon.0) 3345 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2024-09-17T09:07:27.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:27 smithi078 bash[32124]: audit 2024-09-17T09:07:26.504359+0000 mon.a (mon.0) 3346 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:27 smithi078 bash[22670]: audit 2024-09-17T09:07:26.065577+0000 mon.a (mon.0) 3344 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-124"}]': finished 2024-09-17T09:07:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:27 smithi078 bash[22670]: cluster 2024-09-17T09:07:26.065812+0000 mon.a (mon.0) 3345 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2024-09-17T09:07:27.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:27 smithi078 bash[22670]: audit 2024-09-17T09:07:26.504359+0000 mon.a (mon.0) 3346 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:28.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:07:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:07:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:07:28.852 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[22670]: cluster 2024-09-17T09:07:27.090959+0000 mon.a (mon.0) 3347 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2024-09-17T09:07:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[22670]: cluster 2024-09-17T09:07:27.170619+0000 mgr.y (mgr.14532) 608 : cluster [DBG] pgmap v1006: 172 pgs: 172 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[22670]: cluster 2024-09-17T09:07:28.102603+0000 mon.a (mon.0) 3348 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2024-09-17T09:07:28.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[22670]: audit 2024-09-17T09:07:28.109691+0000 mon.a (mon.0) 3349 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[32124]: cluster 2024-09-17T09:07:27.090959+0000 mon.a (mon.0) 3347 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2024-09-17T09:07:28.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[32124]: cluster 2024-09-17T09:07:27.170619+0000 mgr.y (mgr.14532) 608 : cluster [DBG] pgmap v1006: 172 pgs: 172 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[32124]: cluster 2024-09-17T09:07:28.102603+0000 mon.a (mon.0) 3348 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2024-09-17T09:07:28.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:28 smithi078 bash[32124]: audit 2024-09-17T09:07:28.109691+0000 mon.a (mon.0) 3349 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:28 smithi136 bash[24812]: cluster 2024-09-17T09:07:27.090959+0000 mon.a (mon.0) 3347 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2024-09-17T09:07:29.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:28 smithi136 bash[24812]: cluster 2024-09-17T09:07:27.170619+0000 mgr.y (mgr.14532) 608 : cluster [DBG] pgmap v1006: 172 pgs: 172 active+clean; 582 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:28 smithi136 bash[24812]: cluster 2024-09-17T09:07:28.102603+0000 mon.a (mon.0) 3348 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2024-09-17T09:07:29.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:28 smithi136 bash[24812]: audit 2024-09-17T09:07:28.109691+0000 mon.a (mon.0) 3349 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:30.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:07:29 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:07:30.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:30 smithi136 bash[24812]: audit 2024-09-17T09:07:29.106256+0000 mon.a (mon.0) 3350 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:30.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:30 smithi136 bash[24812]: cluster 2024-09-17T09:07:29.106709+0000 mon.a (mon.0) 3351 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2024-09-17T09:07:30.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:30 smithi136 bash[24812]: audit 2024-09-17T09:07:29.113805+0000 mon.a (mon.0) 3352 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:30.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:30 smithi136 bash[24812]: cluster 2024-09-17T09:07:29.171223+0000 mgr.y (mgr.14532) 609 : cluster [DBG] pgmap v1009: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:30.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[22670]: audit 2024-09-17T09:07:29.106256+0000 mon.a (mon.0) 3350 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[22670]: cluster 2024-09-17T09:07:29.106709+0000 mon.a (mon.0) 3351 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2024-09-17T09:07:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[22670]: audit 2024-09-17T09:07:29.113805+0000 mon.a (mon.0) 3352 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[22670]: cluster 2024-09-17T09:07:29.171223+0000 mgr.y (mgr.14532) 609 : cluster [DBG] pgmap v1009: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[32124]: audit 2024-09-17T09:07:29.106256+0000 mon.a (mon.0) 3350 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[32124]: cluster 2024-09-17T09:07:29.106709+0000 mon.a (mon.0) 3351 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2024-09-17T09:07:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[32124]: audit 2024-09-17T09:07:29.113805+0000 mon.a (mon.0) 3352 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:30 smithi078 bash[32124]: cluster 2024-09-17T09:07:29.171223+0000 mgr.y (mgr.14532) 609 : cluster [DBG] pgmap v1009: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:31 smithi136 bash[24812]: audit 2024-09-17T09:07:29.994362+0000 mgr.y (mgr.14532) 610 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:31 smithi136 bash[24812]: audit 2024-09-17T09:07:30.118575+0000 mon.a (mon.0) 3353 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:31 smithi136 bash[24812]: cluster 2024-09-17T09:07:30.118968+0000 mon.a (mon.0) 3354 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2024-09-17T09:07:31.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:31 smithi136 bash[24812]: audit 2024-09-17T09:07:30.119938+0000 mon.a (mon.0) 3355 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-126"}]: dispatch 2024-09-17T09:07:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[32124]: audit 2024-09-17T09:07:29.994362+0000 mgr.y (mgr.14532) 610 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[32124]: audit 2024-09-17T09:07:30.118575+0000 mon.a (mon.0) 3353 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[32124]: cluster 2024-09-17T09:07:30.118968+0000 mon.a (mon.0) 3354 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2024-09-17T09:07:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[32124]: audit 2024-09-17T09:07:30.119938+0000 mon.a (mon.0) 3355 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-126"}]: dispatch 2024-09-17T09:07:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[22670]: audit 2024-09-17T09:07:29.994362+0000 mgr.y (mgr.14532) 610 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[22670]: audit 2024-09-17T09:07:30.118575+0000 mon.a (mon.0) 3353 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[22670]: cluster 2024-09-17T09:07:30.118968+0000 mon.a (mon.0) 3354 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2024-09-17T09:07:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:31 smithi078 bash[22670]: audit 2024-09-17T09:07:30.119938+0000 mon.a (mon.0) 3355 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-126"}]: dispatch 2024-09-17T09:07:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:32 smithi136 bash[24812]: audit 2024-09-17T09:07:31.118149+0000 mon.a (mon.0) 3356 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-126"}]': finished 2024-09-17T09:07:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:32 smithi136 bash[24812]: cluster 2024-09-17T09:07:31.118921+0000 mon.a (mon.0) 3357 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2024-09-17T09:07:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:32 smithi136 bash[24812]: audit 2024-09-17T09:07:31.120467+0000 mon.a (mon.0) 3358 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-126", "mode": "writeback"}]: dispatch 2024-09-17T09:07:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:32 smithi136 bash[24812]: cluster 2024-09-17T09:07:31.171955+0000 mgr.y (mgr.14532) 611 : cluster [DBG] pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:32 smithi136 bash[24812]: cluster 2024-09-17T09:07:32.111577+0000 mon.a (mon.0) 3359 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:32.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[22670]: audit 2024-09-17T09:07:31.118149+0000 mon.a (mon.0) 3356 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-126"}]': finished 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[22670]: cluster 2024-09-17T09:07:31.118921+0000 mon.a (mon.0) 3357 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[22670]: audit 2024-09-17T09:07:31.120467+0000 mon.a (mon.0) 3358 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-126", "mode": "writeback"}]: dispatch 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[22670]: cluster 2024-09-17T09:07:31.171955+0000 mgr.y (mgr.14532) 611 : cluster [DBG] pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[22670]: cluster 2024-09-17T09:07:32.111577+0000 mon.a (mon.0) 3359 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[32124]: audit 2024-09-17T09:07:31.118149+0000 mon.a (mon.0) 3356 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-126"}]': finished 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[32124]: cluster 2024-09-17T09:07:31.118921+0000 mon.a (mon.0) 3357 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[32124]: audit 2024-09-17T09:07:31.120467+0000 mon.a (mon.0) 3358 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-126", "mode": "writeback"}]: dispatch 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[32124]: cluster 2024-09-17T09:07:31.171955+0000 mgr.y (mgr.14532) 611 : cluster [DBG] pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:32 smithi078 bash[32124]: cluster 2024-09-17T09:07:32.111577+0000 mon.a (mon.0) 3359 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:33.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:33 smithi136 bash[24812]: audit 2024-09-17T09:07:32.126199+0000 mon.a (mon.0) 3360 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-126", "mode": "writeback"}]': finished 2024-09-17T09:07:33.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:33 smithi136 bash[24812]: cluster 2024-09-17T09:07:32.126353+0000 mon.a (mon.0) 3361 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2024-09-17T09:07:33.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:33 smithi136 bash[24812]: audit 2024-09-17T09:07:32.264005+0000 mon.a (mon.0) 3362 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:33.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:33 smithi136 bash[24812]: audit 2024-09-17T09:07:32.857847+0000 mon.a (mon.0) 3363 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:33.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:33 smithi136 bash[24812]: cluster 2024-09-17T09:07:32.858000+0000 mon.a (mon.0) 3364 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2024-09-17T09:07:33.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:33 smithi136 bash[24812]: audit 2024-09-17T09:07:32.859877+0000 mon.a (mon.0) 3365 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126"}]: dispatch 2024-09-17T09:07:33.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[22670]: audit 2024-09-17T09:07:32.126199+0000 mon.a (mon.0) 3360 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-126", "mode": "writeback"}]': finished 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[22670]: cluster 2024-09-17T09:07:32.126353+0000 mon.a (mon.0) 3361 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[22670]: audit 2024-09-17T09:07:32.264005+0000 mon.a (mon.0) 3362 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[22670]: audit 2024-09-17T09:07:32.857847+0000 mon.a (mon.0) 3363 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[22670]: cluster 2024-09-17T09:07:32.858000+0000 mon.a (mon.0) 3364 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[22670]: audit 2024-09-17T09:07:32.859877+0000 mon.a (mon.0) 3365 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126"}]: dispatch 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[32124]: audit 2024-09-17T09:07:32.126199+0000 mon.a (mon.0) 3360 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-126", "mode": "writeback"}]': finished 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[32124]: cluster 2024-09-17T09:07:32.126353+0000 mon.a (mon.0) 3361 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[32124]: audit 2024-09-17T09:07:32.264005+0000 mon.a (mon.0) 3362 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[32124]: audit 2024-09-17T09:07:32.857847+0000 mon.a (mon.0) 3363 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:33.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[32124]: cluster 2024-09-17T09:07:32.858000+0000 mon.a (mon.0) 3364 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2024-09-17T09:07:33.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:33 smithi078 bash[32124]: audit 2024-09-17T09:07:32.859877+0000 mon.a (mon.0) 3365 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126"}]: dispatch 2024-09-17T09:07:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: cluster 2024-09-17T09:07:33.174817+0000 mgr.y (mgr.14532) 612 : cluster [DBG] pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T09:07:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: audit 2024-09-17T09:07:33.549075+0000 mon.a (mon.0) 3366 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:07:34.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: cluster 2024-09-17T09:07:33.849643+0000 mon.a (mon.0) 3367 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: audit 2024-09-17T09:07:33.860274+0000 mon.a (mon.0) 3368 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126"}]': finished 2024-09-17T09:07:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: cluster 2024-09-17T09:07:33.860431+0000 mon.a (mon.0) 3369 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2024-09-17T09:07:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: audit 2024-09-17T09:07:34.144981+0000 mon.a (mon.0) 3370 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:07:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: audit 2024-09-17T09:07:34.146498+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:07:34.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:34 smithi136 bash[24812]: audit 2024-09-17T09:07:34.155982+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:34.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: cluster 2024-09-17T09:07:33.174817+0000 mgr.y (mgr.14532) 612 : cluster [DBG] pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T09:07:34.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: audit 2024-09-17T09:07:33.549075+0000 mon.a (mon.0) 3366 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:07:34.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: cluster 2024-09-17T09:07:33.849643+0000 mon.a (mon.0) 3367 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: audit 2024-09-17T09:07:33.860274+0000 mon.a (mon.0) 3368 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126"}]': finished 2024-09-17T09:07:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: cluster 2024-09-17T09:07:33.860431+0000 mon.a (mon.0) 3369 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2024-09-17T09:07:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: audit 2024-09-17T09:07:34.144981+0000 mon.a (mon.0) 3370 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:07:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: audit 2024-09-17T09:07:34.146498+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:07:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[22670]: audit 2024-09-17T09:07:34.155982+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:34.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: cluster 2024-09-17T09:07:33.174817+0000 mgr.y (mgr.14532) 612 : cluster [DBG] pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T09:07:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: audit 2024-09-17T09:07:33.549075+0000 mon.a (mon.0) 3366 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:07:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: cluster 2024-09-17T09:07:33.849643+0000 mon.a (mon.0) 3367 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: audit 2024-09-17T09:07:33.860274+0000 mon.a (mon.0) 3368 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-126"}]': finished 2024-09-17T09:07:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: cluster 2024-09-17T09:07:33.860431+0000 mon.a (mon.0) 3369 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2024-09-17T09:07:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: audit 2024-09-17T09:07:34.144981+0000 mon.a (mon.0) 3370 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:07:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: audit 2024-09-17T09:07:34.146498+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:07:34.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:34 smithi078 bash[32124]: audit 2024-09-17T09:07:34.155982+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:34.867 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:07:34.867 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9091 ms) 2024-09-17T09:07:34.867 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-17T09:07:34.867 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:07:34.867 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6034 ms) 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5035 ms) 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25592 ms) 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14015 ms) 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12118 ms) 2024-09-17T09:07:34.868 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: 00000010 69 73 |is| 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: 00000012 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12068 ms) 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: require_osd_release = reef 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6090 ms) 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (560565 ms total) 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1035 ms) 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-17T09:07:34.869 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11101 ms) 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18244 ms) 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (4 ms) 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30384 ms total) 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7084 ms) 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8072 ms) 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-17T09:07:34.870 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: waiting for scrub... 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: done waiting 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24204 ms) 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9579 ms) 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8037 ms) 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8089 ms) 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10105 ms) 2024-09-17T09:07:34.871 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-17T09:07:36.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:35 smithi136 bash[24812]: cluster 2024-09-17T09:07:34.863877+0000 mon.a (mon.0) 3373 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2024-09-17T09:07:36.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:35 smithi136 bash[24812]: cluster 2024-09-17T09:07:35.175538+0000 mgr.y (mgr.14532) 613 : cluster [DBG] pgmap v1018: 172 pgs: 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:36.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:35 smithi078 bash[22670]: cluster 2024-09-17T09:07:34.863877+0000 mon.a (mon.0) 3373 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2024-09-17T09:07:36.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:35 smithi078 bash[22670]: cluster 2024-09-17T09:07:35.175538+0000 mgr.y (mgr.14532) 613 : cluster [DBG] pgmap v1018: 172 pgs: 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:35 smithi078 bash[32124]: cluster 2024-09-17T09:07:34.863877+0000 mon.a (mon.0) 3373 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2024-09-17T09:07:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:35 smithi078 bash[32124]: cluster 2024-09-17T09:07:35.175538+0000 mgr.y (mgr.14532) 613 : cluster [DBG] pgmap v1018: 172 pgs: 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:07:37.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:36 smithi136 bash[24812]: cluster 2024-09-17T09:07:35.880102+0000 mon.a (mon.0) 3374 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2024-09-17T09:07:37.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:36 smithi136 bash[24812]: audit 2024-09-17T09:07:35.893948+0000 mon.a (mon.0) 3375 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:37.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:36 smithi078 bash[32124]: cluster 2024-09-17T09:07:35.880102+0000 mon.a (mon.0) 3374 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2024-09-17T09:07:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:36 smithi078 bash[32124]: audit 2024-09-17T09:07:35.893948+0000 mon.a (mon.0) 3375 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:37.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:36 smithi078 bash[22670]: cluster 2024-09-17T09:07:35.880102+0000 mon.a (mon.0) 3374 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2024-09-17T09:07:37.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:36 smithi078 bash[22670]: audit 2024-09-17T09:07:35.893948+0000 mon.a (mon.0) 3375 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:38.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:37 smithi136 bash[24812]: audit 2024-09-17T09:07:36.878995+0000 mon.a (mon.0) 3376 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:38.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:37 smithi136 bash[24812]: cluster 2024-09-17T09:07:36.879446+0000 mon.a (mon.0) 3377 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2024-09-17T09:07:38.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:37 smithi136 bash[24812]: audit 2024-09-17T09:07:36.903845+0000 mon.a (mon.0) 3378 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:38.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:37 smithi136 bash[24812]: cluster 2024-09-17T09:07:37.176279+0000 mgr.y (mgr.14532) 614 : cluster [DBG] pgmap v1021: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:38.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:07:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:07:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[32124]: audit 2024-09-17T09:07:36.878995+0000 mon.a (mon.0) 3376 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[32124]: cluster 2024-09-17T09:07:36.879446+0000 mon.a (mon.0) 3377 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2024-09-17T09:07:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[32124]: audit 2024-09-17T09:07:36.903845+0000 mon.a (mon.0) 3378 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[32124]: cluster 2024-09-17T09:07:37.176279+0000 mgr.y (mgr.14532) 614 : cluster [DBG] pgmap v1021: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:38.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[22670]: audit 2024-09-17T09:07:36.878995+0000 mon.a (mon.0) 3376 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:38.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[22670]: cluster 2024-09-17T09:07:36.879446+0000 mon.a (mon.0) 3377 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2024-09-17T09:07:38.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[22670]: audit 2024-09-17T09:07:36.903845+0000 mon.a (mon.0) 3378 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:38.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:37 smithi078 bash[22670]: cluster 2024-09-17T09:07:37.176279+0000 mgr.y (mgr.14532) 614 : cluster [DBG] pgmap v1021: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:39.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:38 smithi136 bash[24812]: audit 2024-09-17T09:07:37.909636+0000 mon.a (mon.0) 3379 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:39.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:38 smithi136 bash[24812]: cluster 2024-09-17T09:07:37.909863+0000 mon.a (mon.0) 3380 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2024-09-17T09:07:39.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:38 smithi136 bash[24812]: audit 2024-09-17T09:07:37.912059+0000 mon.a (mon.0) 3381 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-128"}]: dispatch 2024-09-17T09:07:39.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:38 smithi078 bash[22670]: audit 2024-09-17T09:07:37.909636+0000 mon.a (mon.0) 3379 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:38 smithi078 bash[22670]: cluster 2024-09-17T09:07:37.909863+0000 mon.a (mon.0) 3380 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2024-09-17T09:07:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:38 smithi078 bash[22670]: audit 2024-09-17T09:07:37.912059+0000 mon.a (mon.0) 3381 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-128"}]: dispatch 2024-09-17T09:07:39.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:38 smithi078 bash[32124]: audit 2024-09-17T09:07:37.909636+0000 mon.a (mon.0) 3379 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:39.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:38 smithi078 bash[32124]: cluster 2024-09-17T09:07:37.909863+0000 mon.a (mon.0) 3380 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2024-09-17T09:07:39.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:38 smithi078 bash[32124]: audit 2024-09-17T09:07:37.912059+0000 mon.a (mon.0) 3381 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-128"}]: dispatch 2024-09-17T09:07:40.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:07:40 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:07:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:39 smithi136 bash[24812]: audit 2024-09-17T09:07:38.904604+0000 mon.a (mon.0) 3382 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-128"}]': finished 2024-09-17T09:07:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:39 smithi136 bash[24812]: cluster 2024-09-17T09:07:38.904752+0000 mon.a (mon.0) 3383 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2024-09-17T09:07:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:39 smithi136 bash[24812]: audit 2024-09-17T09:07:38.906503+0000 mon.a (mon.0) 3384 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-128", "mode": "writeback"}]: dispatch 2024-09-17T09:07:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:39 smithi136 bash[24812]: cluster 2024-09-17T09:07:39.177021+0000 mgr.y (mgr.14532) 615 : cluster [DBG] pgmap v1024: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:40.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:39 smithi136 bash[24812]: cluster 2024-09-17T09:07:39.898014+0000 mon.a (mon.0) 3385 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:40.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[32124]: audit 2024-09-17T09:07:38.904604+0000 mon.a (mon.0) 3382 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-128"}]': finished 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[32124]: cluster 2024-09-17T09:07:38.904752+0000 mon.a (mon.0) 3383 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[32124]: audit 2024-09-17T09:07:38.906503+0000 mon.a (mon.0) 3384 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-128", "mode": "writeback"}]: dispatch 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[32124]: cluster 2024-09-17T09:07:39.177021+0000 mgr.y (mgr.14532) 615 : cluster [DBG] pgmap v1024: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[32124]: cluster 2024-09-17T09:07:39.898014+0000 mon.a (mon.0) 3385 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[22670]: audit 2024-09-17T09:07:38.904604+0000 mon.a (mon.0) 3382 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-128"}]': finished 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[22670]: cluster 2024-09-17T09:07:38.904752+0000 mon.a (mon.0) 3383 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[22670]: audit 2024-09-17T09:07:38.906503+0000 mon.a (mon.0) 3384 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-128", "mode": "writeback"}]: dispatch 2024-09-17T09:07:40.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[22670]: cluster 2024-09-17T09:07:39.177021+0000 mgr.y (mgr.14532) 615 : cluster [DBG] pgmap v1024: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:40.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:39 smithi078 bash[22670]: cluster 2024-09-17T09:07:39.898014+0000 mon.a (mon.0) 3385 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:41.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:40 smithi136 bash[24812]: audit 2024-09-17T09:07:39.908268+0000 mon.a (mon.0) 3386 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-128", "mode": "writeback"}]': finished 2024-09-17T09:07:41.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:40 smithi136 bash[24812]: cluster 2024-09-17T09:07:39.908449+0000 mon.a (mon.0) 3387 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2024-09-17T09:07:41.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:40 smithi136 bash[24812]: audit 2024-09-17T09:07:40.005707+0000 mgr.y (mgr.14532) 616 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:41.352 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:40 smithi078 bash[32124]: audit 2024-09-17T09:07:39.908268+0000 mon.a (mon.0) 3386 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-128", "mode": "writeback"}]': finished 2024-09-17T09:07:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:40 smithi078 bash[32124]: cluster 2024-09-17T09:07:39.908449+0000 mon.a (mon.0) 3387 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2024-09-17T09:07:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:40 smithi078 bash[32124]: audit 2024-09-17T09:07:40.005707+0000 mgr.y (mgr.14532) 616 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:41.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:40 smithi078 bash[22670]: audit 2024-09-17T09:07:39.908268+0000 mon.a (mon.0) 3386 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-128", "mode": "writeback"}]': finished 2024-09-17T09:07:41.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:40 smithi078 bash[22670]: cluster 2024-09-17T09:07:39.908449+0000 mon.a (mon.0) 3387 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2024-09-17T09:07:41.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:40 smithi078 bash[22670]: audit 2024-09-17T09:07:40.005707+0000 mgr.y (mgr.14532) 616 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:42.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:41 smithi136 bash[24812]: cluster 2024-09-17T09:07:41.177858+0000 mgr.y (mgr.14532) 617 : cluster [DBG] pgmap v1026: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:42.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:41 smithi136 bash[24812]: audit 2024-09-17T09:07:41.538829+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:42.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:41 smithi136 bash[24812]: audit 2024-09-17T09:07:41.540984+0000 mon.a (mon.0) 3389 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:42.352 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:41 smithi078 bash[22670]: cluster 2024-09-17T09:07:41.177858+0000 mgr.y (mgr.14532) 617 : cluster [DBG] pgmap v1026: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:41 smithi078 bash[22670]: audit 2024-09-17T09:07:41.538829+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:41 smithi078 bash[22670]: audit 2024-09-17T09:07:41.540984+0000 mon.a (mon.0) 3389 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:41 smithi078 bash[32124]: cluster 2024-09-17T09:07:41.177858+0000 mgr.y (mgr.14532) 617 : cluster [DBG] pgmap v1026: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:41 smithi078 bash[32124]: audit 2024-09-17T09:07:41.538829+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:41 smithi078 bash[32124]: audit 2024-09-17T09:07:41.540984+0000 mon.a (mon.0) 3389 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:43.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:43 smithi136 bash[24812]: cluster 2024-09-17T09:07:43.179899+0000 mgr.y (mgr.14532) 618 : cluster [DBG] pgmap v1027: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-17T09:07:43.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:43 smithi078 bash[32124]: cluster 2024-09-17T09:07:43.179899+0000 mgr.y (mgr.14532) 618 : cluster [DBG] pgmap v1027: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-17T09:07:43.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:43 smithi078 bash[22670]: cluster 2024-09-17T09:07:43.179899+0000 mgr.y (mgr.14532) 618 : cluster [DBG] pgmap v1027: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-17T09:07:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:45 smithi136 bash[24812]: audit 2024-09-17T09:07:45.057305+0000 mon.a (mon.0) 3390 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:45.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:45 smithi078 bash[22670]: audit 2024-09-17T09:07:45.057305+0000 mon.a (mon.0) 3390 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:45.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:45 smithi078 bash[32124]: audit 2024-09-17T09:07:45.057305+0000 mon.a (mon.0) 3390 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:46 smithi136 bash[24812]: audit 2024-09-17T09:07:45.115851+0000 mon.a (mon.0) 3391 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:46 smithi136 bash[24812]: cluster 2024-09-17T09:07:45.116005+0000 mon.a (mon.0) 3392 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2024-09-17T09:07:46.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:46 smithi136 bash[24812]: audit 2024-09-17T09:07:45.117688+0000 mon.a (mon.0) 3393 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128"}]: dispatch 2024-09-17T09:07:46.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:46 smithi136 bash[24812]: cluster 2024-09-17T09:07:45.180739+0000 mgr.y (mgr.14532) 619 : cluster [DBG] pgmap v1029: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 326 B/s wr, 1 op/s 2024-09-17T09:07:46.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:46 smithi136 bash[24812]: cluster 2024-09-17T09:07:46.110977+0000 mon.a (mon.0) 3394 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[22670]: audit 2024-09-17T09:07:45.115851+0000 mon.a (mon.0) 3391 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[22670]: cluster 2024-09-17T09:07:45.116005+0000 mon.a (mon.0) 3392 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[22670]: audit 2024-09-17T09:07:45.117688+0000 mon.a (mon.0) 3393 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128"}]: dispatch 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[22670]: cluster 2024-09-17T09:07:45.180739+0000 mgr.y (mgr.14532) 619 : cluster [DBG] pgmap v1029: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 326 B/s wr, 1 op/s 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[22670]: cluster 2024-09-17T09:07:46.110977+0000 mon.a (mon.0) 3394 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[32124]: audit 2024-09-17T09:07:45.115851+0000 mon.a (mon.0) 3391 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[32124]: cluster 2024-09-17T09:07:45.116005+0000 mon.a (mon.0) 3392 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2024-09-17T09:07:46.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[32124]: audit 2024-09-17T09:07:45.117688+0000 mon.a (mon.0) 3393 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128"}]: dispatch 2024-09-17T09:07:46.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[32124]: cluster 2024-09-17T09:07:45.180739+0000 mgr.y (mgr.14532) 619 : cluster [DBG] pgmap v1029: 204 pgs: 204 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 326 B/s wr, 1 op/s 2024-09-17T09:07:46.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:46 smithi078 bash[32124]: cluster 2024-09-17T09:07:46.110977+0000 mon.a (mon.0) 3394 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:47.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:47 smithi136 bash[24812]: audit 2024-09-17T09:07:46.122673+0000 mon.a (mon.0) 3395 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128"}]': finished 2024-09-17T09:07:47.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:47 smithi136 bash[24812]: cluster 2024-09-17T09:07:46.122885+0000 mon.a (mon.0) 3396 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2024-09-17T09:07:47.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:47 smithi078 bash[22670]: audit 2024-09-17T09:07:46.122673+0000 mon.a (mon.0) 3395 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128"}]': finished 2024-09-17T09:07:47.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:47 smithi078 bash[22670]: cluster 2024-09-17T09:07:46.122885+0000 mon.a (mon.0) 3396 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2024-09-17T09:07:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:47 smithi078 bash[32124]: audit 2024-09-17T09:07:46.122673+0000 mon.a (mon.0) 3395 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-128"}]': finished 2024-09-17T09:07:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:47 smithi078 bash[32124]: cluster 2024-09-17T09:07:46.122885+0000 mon.a (mon.0) 3396 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2024-09-17T09:07:48.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:07:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:07:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:07:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:48 smithi078 bash[22670]: cluster 2024-09-17T09:07:47.148413+0000 mon.a (mon.0) 3397 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2024-09-17T09:07:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:48 smithi078 bash[22670]: cluster 2024-09-17T09:07:47.181772+0000 mgr.y (mgr.14532) 620 : cluster [DBG] pgmap v1032: 172 pgs: 172 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:07:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:48 smithi078 bash[32124]: cluster 2024-09-17T09:07:47.148413+0000 mon.a (mon.0) 3397 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2024-09-17T09:07:48.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:48 smithi078 bash[32124]: cluster 2024-09-17T09:07:47.181772+0000 mgr.y (mgr.14532) 620 : cluster [DBG] pgmap v1032: 172 pgs: 172 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:07:48.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:48 smithi136 bash[24812]: cluster 2024-09-17T09:07:47.148413+0000 mon.a (mon.0) 3397 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2024-09-17T09:07:48.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:48 smithi136 bash[24812]: cluster 2024-09-17T09:07:47.181772+0000 mgr.y (mgr.14532) 620 : cluster [DBG] pgmap v1032: 172 pgs: 172 active+clean; 582 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:07:49.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:49 smithi136 bash[24812]: cluster 2024-09-17T09:07:48.160362+0000 mon.a (mon.0) 3398 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2024-09-17T09:07:49.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:49 smithi136 bash[24812]: audit 2024-09-17T09:07:48.162726+0000 mon.a (mon.0) 3399 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:49 smithi078 bash[32124]: cluster 2024-09-17T09:07:48.160362+0000 mon.a (mon.0) 3398 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2024-09-17T09:07:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:49 smithi078 bash[32124]: audit 2024-09-17T09:07:48.162726+0000 mon.a (mon.0) 3399 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:49.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:49 smithi078 bash[22670]: cluster 2024-09-17T09:07:48.160362+0000 mon.a (mon.0) 3398 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2024-09-17T09:07:49.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:49 smithi078 bash[22670]: audit 2024-09-17T09:07:48.162726+0000 mon.a (mon.0) 3399 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:50.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:07:50 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:07:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:50 smithi136 bash[24812]: audit 2024-09-17T09:07:49.169210+0000 mon.a (mon.0) 3400 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:50.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:50 smithi136 bash[24812]: cluster 2024-09-17T09:07:49.169774+0000 mon.a (mon.0) 3401 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2024-09-17T09:07:50.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:50 smithi136 bash[24812]: audit 2024-09-17T09:07:49.175758+0000 mon.a (mon.0) 3402 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:50.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:50 smithi136 bash[24812]: cluster 2024-09-17T09:07:49.182867+0000 mgr.y (mgr.14532) 621 : cluster [DBG] pgmap v1035: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:07:50.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[32124]: audit 2024-09-17T09:07:49.169210+0000 mon.a (mon.0) 3400 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[32124]: cluster 2024-09-17T09:07:49.169774+0000 mon.a (mon.0) 3401 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2024-09-17T09:07:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[32124]: audit 2024-09-17T09:07:49.175758+0000 mon.a (mon.0) 3402 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:50.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[32124]: cluster 2024-09-17T09:07:49.182867+0000 mgr.y (mgr.14532) 621 : cluster [DBG] pgmap v1035: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:07:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[22670]: audit 2024-09-17T09:07:49.169210+0000 mon.a (mon.0) 3400 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[22670]: cluster 2024-09-17T09:07:49.169774+0000 mon.a (mon.0) 3401 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2024-09-17T09:07:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[22670]: audit 2024-09-17T09:07:49.175758+0000 mon.a (mon.0) 3402 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:50.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:50 smithi078 bash[22670]: cluster 2024-09-17T09:07:49.182867+0000 mgr.y (mgr.14532) 621 : cluster [DBG] pgmap v1035: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:07:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:51 smithi136 bash[24812]: audit 2024-09-17T09:07:50.009528+0000 mgr.y (mgr.14532) 622 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:51 smithi136 bash[24812]: audit 2024-09-17T09:07:50.178228+0000 mon.a (mon.0) 3403 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:51 smithi136 bash[24812]: cluster 2024-09-17T09:07:50.178339+0000 mon.a (mon.0) 3404 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2024-09-17T09:07:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:51 smithi136 bash[24812]: audit 2024-09-17T09:07:50.179429+0000 mon.a (mon.0) 3405 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-130"}]: dispatch 2024-09-17T09:07:51.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[32124]: audit 2024-09-17T09:07:50.009528+0000 mgr.y (mgr.14532) 622 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[32124]: audit 2024-09-17T09:07:50.178228+0000 mon.a (mon.0) 3403 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[32124]: cluster 2024-09-17T09:07:50.178339+0000 mon.a (mon.0) 3404 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2024-09-17T09:07:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[32124]: audit 2024-09-17T09:07:50.179429+0000 mon.a (mon.0) 3405 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-130"}]: dispatch 2024-09-17T09:07:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[22670]: audit 2024-09-17T09:07:50.009528+0000 mgr.y (mgr.14532) 622 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:07:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[22670]: audit 2024-09-17T09:07:50.178228+0000 mon.a (mon.0) 3403 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[22670]: cluster 2024-09-17T09:07:50.178339+0000 mon.a (mon.0) 3404 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2024-09-17T09:07:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:51 smithi078 bash[22670]: audit 2024-09-17T09:07:50.179429+0000 mon.a (mon.0) 3405 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-130"}]: dispatch 2024-09-17T09:07:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:52 smithi136 bash[24812]: audit 2024-09-17T09:07:51.182459+0000 mon.a (mon.0) 3406 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-130"}]': finished 2024-09-17T09:07:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:52 smithi136 bash[24812]: cluster 2024-09-17T09:07:51.182653+0000 mon.a (mon.0) 3407 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2024-09-17T09:07:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:52 smithi136 bash[24812]: cluster 2024-09-17T09:07:51.183930+0000 mgr.y (mgr.14532) 623 : cluster [DBG] pgmap v1038: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:52 smithi136 bash[24812]: audit 2024-09-17T09:07:51.184193+0000 mon.a (mon.0) 3408 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-130", "mode": "writeback"}]: dispatch 2024-09-17T09:07:52.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:52 smithi136 bash[24812]: cluster 2024-09-17T09:07:52.175535+0000 mon.a (mon.0) 3409 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[22670]: audit 2024-09-17T09:07:51.182459+0000 mon.a (mon.0) 3406 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-130"}]': finished 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[22670]: cluster 2024-09-17T09:07:51.182653+0000 mon.a (mon.0) 3407 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[22670]: cluster 2024-09-17T09:07:51.183930+0000 mgr.y (mgr.14532) 623 : cluster [DBG] pgmap v1038: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[22670]: audit 2024-09-17T09:07:51.184193+0000 mon.a (mon.0) 3408 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-130", "mode": "writeback"}]: dispatch 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[22670]: cluster 2024-09-17T09:07:52.175535+0000 mon.a (mon.0) 3409 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[32124]: audit 2024-09-17T09:07:51.182459+0000 mon.a (mon.0) 3406 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-130"}]': finished 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[32124]: cluster 2024-09-17T09:07:51.182653+0000 mon.a (mon.0) 3407 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[32124]: cluster 2024-09-17T09:07:51.183930+0000 mgr.y (mgr.14532) 623 : cluster [DBG] pgmap v1038: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:07:52.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[32124]: audit 2024-09-17T09:07:51.184193+0000 mon.a (mon.0) 3408 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-130", "mode": "writeback"}]: dispatch 2024-09-17T09:07:52.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:52 smithi078 bash[32124]: cluster 2024-09-17T09:07:52.175535+0000 mon.a (mon.0) 3409 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:07:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:53 smithi136 bash[24812]: audit 2024-09-17T09:07:52.187741+0000 mon.a (mon.0) 3410 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-130", "mode": "writeback"}]': finished 2024-09-17T09:07:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:53 smithi136 bash[24812]: cluster 2024-09-17T09:07:52.188104+0000 mon.a (mon.0) 3411 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2024-09-17T09:07:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:53 smithi136 bash[24812]: audit 2024-09-17T09:07:52.376327+0000 mon.a (mon.0) 3412 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:53 smithi136 bash[24812]: cluster 2024-09-17T09:07:53.185878+0000 mgr.y (mgr.14532) 624 : cluster [DBG] pgmap v1040: 204 pgs: 204 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 509 B/s wr, 4 op/s 2024-09-17T09:07:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[22670]: audit 2024-09-17T09:07:52.187741+0000 mon.a (mon.0) 3410 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-130", "mode": "writeback"}]': finished 2024-09-17T09:07:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[22670]: cluster 2024-09-17T09:07:52.188104+0000 mon.a (mon.0) 3411 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2024-09-17T09:07:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[22670]: audit 2024-09-17T09:07:52.376327+0000 mon.a (mon.0) 3412 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[22670]: cluster 2024-09-17T09:07:53.185878+0000 mgr.y (mgr.14532) 624 : cluster [DBG] pgmap v1040: 204 pgs: 204 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 509 B/s wr, 4 op/s 2024-09-17T09:07:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[32124]: audit 2024-09-17T09:07:52.187741+0000 mon.a (mon.0) 3410 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-130", "mode": "writeback"}]': finished 2024-09-17T09:07:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[32124]: cluster 2024-09-17T09:07:52.188104+0000 mon.a (mon.0) 3411 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2024-09-17T09:07:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[32124]: audit 2024-09-17T09:07:52.376327+0000 mon.a (mon.0) 3412 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:07:53.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:53 smithi078 bash[32124]: cluster 2024-09-17T09:07:53.185878+0000 mgr.y (mgr.14532) 624 : cluster [DBG] pgmap v1040: 204 pgs: 204 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 509 B/s wr, 4 op/s 2024-09-17T09:07:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:54 smithi136 bash[24812]: audit 2024-09-17T09:07:53.222884+0000 mon.a (mon.0) 3413 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:54 smithi136 bash[24812]: cluster 2024-09-17T09:07:53.223153+0000 mon.a (mon.0) 3414 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2024-09-17T09:07:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:54 smithi136 bash[24812]: audit 2024-09-17T09:07:53.227011+0000 mon.a (mon.0) 3415 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130"}]: dispatch 2024-09-17T09:07:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:54 smithi078 bash[22670]: audit 2024-09-17T09:07:53.222884+0000 mon.a (mon.0) 3413 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:54 smithi078 bash[22670]: cluster 2024-09-17T09:07:53.223153+0000 mon.a (mon.0) 3414 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2024-09-17T09:07:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:54 smithi078 bash[22670]: audit 2024-09-17T09:07:53.227011+0000 mon.a (mon.0) 3415 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130"}]: dispatch 2024-09-17T09:07:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:54 smithi078 bash[32124]: audit 2024-09-17T09:07:53.222884+0000 mon.a (mon.0) 3413 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:07:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:54 smithi078 bash[32124]: cluster 2024-09-17T09:07:53.223153+0000 mon.a (mon.0) 3414 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2024-09-17T09:07:54.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:54 smithi078 bash[32124]: audit 2024-09-17T09:07:53.227011+0000 mon.a (mon.0) 3415 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130"}]: dispatch 2024-09-17T09:07:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:55 smithi136 bash[24812]: cluster 2024-09-17T09:07:54.213230+0000 mon.a (mon.0) 3416 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:55 smithi136 bash[24812]: audit 2024-09-17T09:07:54.223791+0000 mon.a (mon.0) 3417 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130"}]': finished 2024-09-17T09:07:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:55 smithi136 bash[24812]: cluster 2024-09-17T09:07:54.224263+0000 mon.a (mon.0) 3418 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2024-09-17T09:07:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:55 smithi136 bash[24812]: cluster 2024-09-17T09:07:55.186893+0000 mgr.y (mgr.14532) 625 : cluster [DBG] pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 510 B/s wr, 4 op/s 2024-09-17T09:07:55.602 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[22670]: cluster 2024-09-17T09:07:54.213230+0000 mon.a (mon.0) 3416 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[22670]: audit 2024-09-17T09:07:54.223791+0000 mon.a (mon.0) 3417 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130"}]': finished 2024-09-17T09:07:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[22670]: cluster 2024-09-17T09:07:54.224263+0000 mon.a (mon.0) 3418 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2024-09-17T09:07:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[22670]: cluster 2024-09-17T09:07:55.186893+0000 mgr.y (mgr.14532) 625 : cluster [DBG] pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 510 B/s wr, 4 op/s 2024-09-17T09:07:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[32124]: cluster 2024-09-17T09:07:54.213230+0000 mon.a (mon.0) 3416 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:07:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[32124]: audit 2024-09-17T09:07:54.223791+0000 mon.a (mon.0) 3417 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-130"}]': finished 2024-09-17T09:07:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[32124]: cluster 2024-09-17T09:07:54.224263+0000 mon.a (mon.0) 3418 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2024-09-17T09:07:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:55 smithi078 bash[32124]: cluster 2024-09-17T09:07:55.186893+0000 mgr.y (mgr.14532) 625 : cluster [DBG] pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 510 B/s wr, 4 op/s 2024-09-17T09:07:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:56 smithi136 bash[24812]: cluster 2024-09-17T09:07:55.229160+0000 mon.a (mon.0) 3419 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:07:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:56 smithi136 bash[24812]: cluster 2024-09-17T09:07:55.249433+0000 mon.a (mon.0) 3420 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2024-09-17T09:07:56.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:56 smithi078 bash[32124]: cluster 2024-09-17T09:07:55.229160+0000 mon.a (mon.0) 3419 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:07:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:56 smithi078 bash[32124]: cluster 2024-09-17T09:07:55.249433+0000 mon.a (mon.0) 3420 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2024-09-17T09:07:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:56 smithi078 bash[22670]: cluster 2024-09-17T09:07:55.229160+0000 mon.a (mon.0) 3419 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:07:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:56 smithi078 bash[22670]: cluster 2024-09-17T09:07:55.249433+0000 mon.a (mon.0) 3420 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2024-09-17T09:07:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: cluster 2024-09-17T09:07:56.262122+0000 mon.a (mon.0) 3421 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2024-09-17T09:07:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: audit 2024-09-17T09:07:56.271684+0000 mon.a (mon.0) 3422 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: audit 2024-09-17T09:07:56.577175+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: audit 2024-09-17T09:07:56.579396+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: cluster 2024-09-17T09:07:57.187729+0000 mgr.y (mgr.14532) 626 : cluster [DBG] pgmap v1046: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: audit 2024-09-17T09:07:57.254468+0000 mon.a (mon.0) 3425 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: cluster 2024-09-17T09:07:57.254673+0000 mon.a (mon.0) 3426 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2024-09-17T09:07:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:57 smithi136 bash[24812]: audit 2024-09-17T09:07:57.264399+0000 mon.a (mon.0) 3427 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: cluster 2024-09-17T09:07:56.262122+0000 mon.a (mon.0) 3421 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: audit 2024-09-17T09:07:56.271684+0000 mon.a (mon.0) 3422 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: audit 2024-09-17T09:07:56.577175+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: audit 2024-09-17T09:07:56.579396+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: cluster 2024-09-17T09:07:57.187729+0000 mgr.y (mgr.14532) 626 : cluster [DBG] pgmap v1046: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: audit 2024-09-17T09:07:57.254468+0000 mon.a (mon.0) 3425 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: cluster 2024-09-17T09:07:57.254673+0000 mon.a (mon.0) 3426 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2024-09-17T09:07:57.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[32124]: audit 2024-09-17T09:07:57.264399+0000 mon.a (mon.0) 3427 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: cluster 2024-09-17T09:07:56.262122+0000 mon.a (mon.0) 3421 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: audit 2024-09-17T09:07:56.271684+0000 mon.a (mon.0) 3422 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: audit 2024-09-17T09:07:56.577175+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: audit 2024-09-17T09:07:56.579396+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: cluster 2024-09-17T09:07:57.187729+0000 mgr.y (mgr.14532) 626 : cluster [DBG] pgmap v1046: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: audit 2024-09-17T09:07:57.254468+0000 mon.a (mon.0) 3425 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: cluster 2024-09-17T09:07:57.254673+0000 mon.a (mon.0) 3426 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2024-09-17T09:07:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22670]: audit 2024-09-17T09:07:57.264399+0000 mon.a (mon.0) 3427 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:07:58.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:07:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:07:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:07:59.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:59 smithi136 bash[24812]: audit 2024-09-17T09:07:58.257801+0000 mon.a (mon.0) 3428 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:59.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:59 smithi136 bash[24812]: cluster 2024-09-17T09:07:58.258017+0000 mon.a (mon.0) 3429 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2024-09-17T09:07:59.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:59 smithi136 bash[24812]: audit 2024-09-17T09:07:58.261958+0000 mon.a (mon.0) 3430 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:07:59.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:07:59 smithi136 bash[24812]: cluster 2024-09-17T09:07:59.188504+0000 mgr.y (mgr.14532) 627 : cluster [DBG] pgmap v1049: 204 pgs: 204 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:07:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[32124]: audit 2024-09-17T09:07:58.257801+0000 mon.a (mon.0) 3428 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[32124]: cluster 2024-09-17T09:07:58.258017+0000 mon.a (mon.0) 3429 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2024-09-17T09:07:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[32124]: audit 2024-09-17T09:07:58.261958+0000 mon.a (mon.0) 3430 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:07:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[32124]: cluster 2024-09-17T09:07:59.188504+0000 mgr.y (mgr.14532) 627 : cluster [DBG] pgmap v1049: 204 pgs: 204 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:07:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[22670]: audit 2024-09-17T09:07:58.257801+0000 mon.a (mon.0) 3428 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:07:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[22670]: cluster 2024-09-17T09:07:58.258017+0000 mon.a (mon.0) 3429 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2024-09-17T09:07:59.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[22670]: audit 2024-09-17T09:07:58.261958+0000 mon.a (mon.0) 3430 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:07:59.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:07:59 smithi078 bash[22670]: cluster 2024-09-17T09:07:59.188504+0000 mgr.y (mgr.14532) 627 : cluster [DBG] pgmap v1049: 204 pgs: 204 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:08:00.279 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:08:00 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:08:00.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:00 smithi136 bash[24812]: audit 2024-09-17T09:07:59.271274+0000 mon.a (mon.0) 3431 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:00.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:00 smithi136 bash[24812]: cluster 2024-09-17T09:07:59.271516+0000 mon.a (mon.0) 3432 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2024-09-17T09:08:00.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:00 smithi136 bash[24812]: audit 2024-09-17T09:07:59.273470+0000 mon.a (mon.0) 3433 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-132", "mode": "writeback"}]: dispatch 2024-09-17T09:08:00.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:00 smithi136 bash[24812]: audit 2024-09-17T09:08:00.020929+0000 mgr.y (mgr.14532) 628 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[32124]: audit 2024-09-17T09:07:59.271274+0000 mon.a (mon.0) 3431 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[32124]: cluster 2024-09-17T09:07:59.271516+0000 mon.a (mon.0) 3432 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[32124]: audit 2024-09-17T09:07:59.273470+0000 mon.a (mon.0) 3433 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-132", "mode": "writeback"}]: dispatch 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[32124]: audit 2024-09-17T09:08:00.020929+0000 mgr.y (mgr.14532) 628 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[22670]: audit 2024-09-17T09:07:59.271274+0000 mon.a (mon.0) 3431 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[22670]: cluster 2024-09-17T09:07:59.271516+0000 mon.a (mon.0) 3432 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[22670]: audit 2024-09-17T09:07:59.273470+0000 mon.a (mon.0) 3433 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-132", "mode": "writeback"}]: dispatch 2024-09-17T09:08:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:00 smithi078 bash[22670]: audit 2024-09-17T09:08:00.020929+0000 mgr.y (mgr.14532) 628 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:01 smithi136 bash[24812]: cluster 2024-09-17T09:08:00.262324+0000 mon.a (mon.0) 3434 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:01 smithi136 bash[24812]: audit 2024-09-17T09:08:00.272711+0000 mon.a (mon.0) 3435 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-132", "mode": "writeback"}]': finished 2024-09-17T09:08:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:01 smithi136 bash[24812]: cluster 2024-09-17T09:08:00.272874+0000 mon.a (mon.0) 3436 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2024-09-17T09:08:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:01 smithi136 bash[24812]: cluster 2024-09-17T09:08:01.189299+0000 mgr.y (mgr.14532) 629 : cluster [DBG] pgmap v1052: 204 pgs: 204 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[22670]: cluster 2024-09-17T09:08:00.262324+0000 mon.a (mon.0) 3434 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[22670]: audit 2024-09-17T09:08:00.272711+0000 mon.a (mon.0) 3435 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-132", "mode": "writeback"}]': finished 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[22670]: cluster 2024-09-17T09:08:00.272874+0000 mon.a (mon.0) 3436 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[22670]: cluster 2024-09-17T09:08:01.189299+0000 mgr.y (mgr.14532) 629 : cluster [DBG] pgmap v1052: 204 pgs: 204 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[32124]: cluster 2024-09-17T09:08:00.262324+0000 mon.a (mon.0) 3434 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[32124]: audit 2024-09-17T09:08:00.272711+0000 mon.a (mon.0) 3435 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-132", "mode": "writeback"}]': finished 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[32124]: cluster 2024-09-17T09:08:00.272874+0000 mon.a (mon.0) 3436 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2024-09-17T09:08:01.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:01 smithi078 bash[32124]: cluster 2024-09-17T09:08:01.189299+0000 mgr.y (mgr.14532) 629 : cluster [DBG] pgmap v1052: 204 pgs: 204 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:02 smithi078 bash[22670]: cluster 2024-09-17T09:08:01.295307+0000 mon.a (mon.0) 3437 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2024-09-17T09:08:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:02 smithi078 bash[32124]: cluster 2024-09-17T09:08:01.295307+0000 mon.a (mon.0) 3437 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2024-09-17T09:08:02.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:02 smithi136 bash[24812]: cluster 2024-09-17T09:08:01.295307+0000 mon.a (mon.0) 3437 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2024-09-17T09:08:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:03 smithi078 bash[22670]: cluster 2024-09-17T09:08:02.297386+0000 mon.a (mon.0) 3438 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2024-09-17T09:08:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:03 smithi078 bash[22670]: audit 2024-09-17T09:08:02.386601+0000 mon.a (mon.0) 3439 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:03 smithi078 bash[22670]: cluster 2024-09-17T09:08:02.854320+0000 mon.a (mon.0) 3440 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:03 smithi078 bash[32124]: cluster 2024-09-17T09:08:02.297386+0000 mon.a (mon.0) 3438 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2024-09-17T09:08:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:03 smithi078 bash[32124]: audit 2024-09-17T09:08:02.386601+0000 mon.a (mon.0) 3439 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:03 smithi078 bash[32124]: cluster 2024-09-17T09:08:02.854320+0000 mon.a (mon.0) 3440 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:03.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:03 smithi136 bash[24812]: cluster 2024-09-17T09:08:02.297386+0000 mon.a (mon.0) 3438 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2024-09-17T09:08:03.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:03 smithi136 bash[24812]: audit 2024-09-17T09:08:02.386601+0000 mon.a (mon.0) 3439 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:03.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:03 smithi136 bash[24812]: cluster 2024-09-17T09:08:02.854320+0000 mon.a (mon.0) 3440 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[22670]: cluster 2024-09-17T09:08:03.191318+0000 mgr.y (mgr.14532) 630 : cluster [DBG] pgmap v1055: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:08:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[22670]: audit 2024-09-17T09:08:03.326371+0000 mon.a (mon.0) 3441 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[22670]: cluster 2024-09-17T09:08:03.326673+0000 mon.a (mon.0) 3442 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2024-09-17T09:08:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[22670]: audit 2024-09-17T09:08:03.343777+0000 mon.a (mon.0) 3443 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:08:04.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[32124]: cluster 2024-09-17T09:08:03.191318+0000 mgr.y (mgr.14532) 630 : cluster [DBG] pgmap v1055: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:08:04.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[32124]: audit 2024-09-17T09:08:03.326371+0000 mon.a (mon.0) 3441 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:04.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[32124]: cluster 2024-09-17T09:08:03.326673+0000 mon.a (mon.0) 3442 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2024-09-17T09:08:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:04 smithi078 bash[32124]: audit 2024-09-17T09:08:03.343777+0000 mon.a (mon.0) 3443 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:08:04.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:04 smithi136 bash[24812]: cluster 2024-09-17T09:08:03.191318+0000 mgr.y (mgr.14532) 630 : cluster [DBG] pgmap v1055: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:08:04.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:04 smithi136 bash[24812]: audit 2024-09-17T09:08:03.326371+0000 mon.a (mon.0) 3441 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:04.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:04 smithi136 bash[24812]: cluster 2024-09-17T09:08:03.326673+0000 mon.a (mon.0) 3442 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2024-09-17T09:08:04.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:04 smithi136 bash[24812]: audit 2024-09-17T09:08:03.343777+0000 mon.a (mon.0) 3443 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:08:05.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:05 smithi078 bash[32124]: audit 2024-09-17T09:08:04.324378+0000 mon.a (mon.0) 3444 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:05 smithi078 bash[32124]: cluster 2024-09-17T09:08:04.324547+0000 mon.a (mon.0) 3445 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2024-09-17T09:08:05.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:05 smithi078 bash[32124]: cluster 2024-09-17T09:08:05.331190+0000 mon.a (mon.0) 3446 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2024-09-17T09:08:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:05 smithi078 bash[22670]: audit 2024-09-17T09:08:04.324378+0000 mon.a (mon.0) 3444 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:05 smithi078 bash[22670]: cluster 2024-09-17T09:08:04.324547+0000 mon.a (mon.0) 3445 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2024-09-17T09:08:05.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:05 smithi078 bash[22670]: cluster 2024-09-17T09:08:05.331190+0000 mon.a (mon.0) 3446 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2024-09-17T09:08:05.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:05 smithi136 bash[24812]: audit 2024-09-17T09:08:04.324378+0000 mon.a (mon.0) 3444 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:05.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:05 smithi136 bash[24812]: cluster 2024-09-17T09:08:04.324547+0000 mon.a (mon.0) 3445 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2024-09-17T09:08:05.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:05 smithi136 bash[24812]: cluster 2024-09-17T09:08:05.331190+0000 mon.a (mon.0) 3446 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2024-09-17T09:08:06.602 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:06 smithi078 bash[32124]: cluster 2024-09-17T09:08:05.192136+0000 mgr.y (mgr.14532) 631 : cluster [DBG] pgmap v1058: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:08:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:06 smithi078 bash[32124]: audit 2024-09-17T09:08:05.394107+0000 mon.a (mon.0) 3447 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:06 smithi078 bash[22670]: cluster 2024-09-17T09:08:05.192136+0000 mgr.y (mgr.14532) 631 : cluster [DBG] pgmap v1058: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:08:06.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:06 smithi078 bash[22670]: audit 2024-09-17T09:08:05.394107+0000 mon.a (mon.0) 3447 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:06.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:06 smithi136 bash[24812]: cluster 2024-09-17T09:08:05.192136+0000 mgr.y (mgr.14532) 631 : cluster [DBG] pgmap v1058: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-17T09:08:06.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:06 smithi136 bash[24812]: audit 2024-09-17T09:08:05.394107+0000 mon.a (mon.0) 3447 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:07.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:07 smithi136 bash[24812]: audit 2024-09-17T09:08:06.367826+0000 mon.a (mon.0) 3448 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:07.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:07 smithi136 bash[24812]: cluster 2024-09-17T09:08:06.367987+0000 mon.a (mon.0) 3449 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2024-09-17T09:08:07.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:07 smithi136 bash[24812]: audit 2024-09-17T09:08:06.369256+0000 mon.a (mon.0) 3450 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:08:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:07 smithi078 bash[22670]: audit 2024-09-17T09:08:06.367826+0000 mon.a (mon.0) 3448 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:07 smithi078 bash[22670]: cluster 2024-09-17T09:08:06.367987+0000 mon.a (mon.0) 3449 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2024-09-17T09:08:07.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:07 smithi078 bash[22670]: audit 2024-09-17T09:08:06.369256+0000 mon.a (mon.0) 3450 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:08:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:07 smithi078 bash[32124]: audit 2024-09-17T09:08:06.367826+0000 mon.a (mon.0) 3448 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:07 smithi078 bash[32124]: cluster 2024-09-17T09:08:06.367987+0000 mon.a (mon.0) 3449 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2024-09-17T09:08:07.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:07 smithi078 bash[32124]: audit 2024-09-17T09:08:06.369256+0000 mon.a (mon.0) 3450 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132"}]: dispatch 2024-09-17T09:08:08.352 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:08:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:08:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:08:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[22670]: cluster 2024-09-17T09:08:07.192918+0000 mgr.y (mgr.14532) 632 : cluster [DBG] pgmap v1061: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[22670]: cluster 2024-09-17T09:08:07.362221+0000 mon.a (mon.0) 3451 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[22670]: audit 2024-09-17T09:08:07.382937+0000 mon.a (mon.0) 3452 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[22670]: cluster 2024-09-17T09:08:07.383109+0000 mon.a (mon.0) 3453 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2024-09-17T09:08:09.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[32124]: cluster 2024-09-17T09:08:07.192918+0000 mgr.y (mgr.14532) 632 : cluster [DBG] pgmap v1061: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:09.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[32124]: cluster 2024-09-17T09:08:07.362221+0000 mon.a (mon.0) 3451 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:09.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[32124]: audit 2024-09-17T09:08:07.382937+0000 mon.a (mon.0) 3452 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:08 smithi078 bash[32124]: cluster 2024-09-17T09:08:07.383109+0000 mon.a (mon.0) 3453 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2024-09-17T09:08:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:08 smithi136 bash[24812]: cluster 2024-09-17T09:08:07.192918+0000 mgr.y (mgr.14532) 632 : cluster [DBG] pgmap v1061: 204 pgs: 204 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:08 smithi136 bash[24812]: cluster 2024-09-17T09:08:07.362221+0000 mon.a (mon.0) 3451 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:08 smithi136 bash[24812]: audit 2024-09-17T09:08:07.382937+0000 mon.a (mon.0) 3452 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-132"}]': finished 2024-09-17T09:08:09.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:08 smithi136 bash[24812]: cluster 2024-09-17T09:08:07.383109+0000 mon.a (mon.0) 3453 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2024-09-17T09:08:10.102 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:09 smithi078 bash[22670]: cluster 2024-09-17T09:08:08.384581+0000 mon.a (mon.0) 3454 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2024-09-17T09:08:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:09 smithi078 bash[22670]: cluster 2024-09-17T09:08:09.385745+0000 mon.a (mon.0) 3455 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2024-09-17T09:08:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:09 smithi078 bash[22670]: audit 2024-09-17T09:08:09.391353+0000 mon.a (mon.0) 3456 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:10.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:09 smithi078 bash[32124]: cluster 2024-09-17T09:08:08.384581+0000 mon.a (mon.0) 3454 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2024-09-17T09:08:10.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:09 smithi078 bash[32124]: cluster 2024-09-17T09:08:09.385745+0000 mon.a (mon.0) 3455 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2024-09-17T09:08:10.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:09 smithi078 bash[32124]: audit 2024-09-17T09:08:09.391353+0000 mon.a (mon.0) 3456 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:10.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:08:10 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:08:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:09 smithi136 bash[24812]: cluster 2024-09-17T09:08:08.384581+0000 mon.a (mon.0) 3454 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2024-09-17T09:08:10.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:09 smithi136 bash[24812]: cluster 2024-09-17T09:08:09.385745+0000 mon.a (mon.0) 3455 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2024-09-17T09:08:10.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:09 smithi136 bash[24812]: audit 2024-09-17T09:08:09.391353+0000 mon.a (mon.0) 3456 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[22670]: cluster 2024-09-17T09:08:09.193701+0000 mgr.y (mgr.14532) 633 : cluster [DBG] pgmap v1064: 172 pgs: 172 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[22670]: audit 2024-09-17T09:08:10.032300+0000 mgr.y (mgr.14532) 634 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[22670]: audit 2024-09-17T09:08:10.389915+0000 mon.a (mon.0) 3457 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[22670]: cluster 2024-09-17T09:08:10.390556+0000 mon.a (mon.0) 3458 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2024-09-17T09:08:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[22670]: audit 2024-09-17T09:08:10.398257+0000 mon.a (mon.0) 3459 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:11.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[32124]: cluster 2024-09-17T09:08:09.193701+0000 mgr.y (mgr.14532) 633 : cluster [DBG] pgmap v1064: 172 pgs: 172 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[32124]: audit 2024-09-17T09:08:10.032300+0000 mgr.y (mgr.14532) 634 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[32124]: audit 2024-09-17T09:08:10.389915+0000 mon.a (mon.0) 3457 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[32124]: cluster 2024-09-17T09:08:10.390556+0000 mon.a (mon.0) 3458 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2024-09-17T09:08:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:10 smithi078 bash[32124]: audit 2024-09-17T09:08:10.398257+0000 mon.a (mon.0) 3459 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:11.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:10 smithi136 bash[24812]: cluster 2024-09-17T09:08:09.193701+0000 mgr.y (mgr.14532) 633 : cluster [DBG] pgmap v1064: 172 pgs: 172 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:10 smithi136 bash[24812]: audit 2024-09-17T09:08:10.032300+0000 mgr.y (mgr.14532) 634 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:10 smithi136 bash[24812]: audit 2024-09-17T09:08:10.389915+0000 mon.a (mon.0) 3457 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:10 smithi136 bash[24812]: cluster 2024-09-17T09:08:10.390556+0000 mon.a (mon.0) 3458 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2024-09-17T09:08:11.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:10 smithi136 bash[24812]: audit 2024-09-17T09:08:10.398257+0000 mon.a (mon.0) 3459 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:12.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:12 smithi136 bash[24812]: cluster 2024-09-17T09:08:11.194491+0000 mgr.y (mgr.14532) 635 : cluster [DBG] pgmap v1067: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:12.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:12 smithi136 bash[24812]: audit 2024-09-17T09:08:11.391269+0000 mon.a (mon.0) 3460 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:12.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:12 smithi136 bash[24812]: cluster 2024-09-17T09:08:11.391390+0000 mon.a (mon.0) 3461 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2024-09-17T09:08:12.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:12 smithi136 bash[24812]: audit 2024-09-17T09:08:11.392409+0000 mon.a (mon.0) 3462 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-134"}]: dispatch 2024-09-17T09:08:12.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:12 smithi136 bash[24812]: audit 2024-09-17T09:08:11.607705+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:12.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[22670]: cluster 2024-09-17T09:08:11.194491+0000 mgr.y (mgr.14532) 635 : cluster [DBG] pgmap v1067: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:12.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[22670]: audit 2024-09-17T09:08:11.391269+0000 mon.a (mon.0) 3460 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:12.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[22670]: cluster 2024-09-17T09:08:11.391390+0000 mon.a (mon.0) 3461 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2024-09-17T09:08:12.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[22670]: audit 2024-09-17T09:08:11.392409+0000 mon.a (mon.0) 3462 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-134"}]: dispatch 2024-09-17T09:08:12.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[22670]: audit 2024-09-17T09:08:11.607705+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:12.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[32124]: cluster 2024-09-17T09:08:11.194491+0000 mgr.y (mgr.14532) 635 : cluster [DBG] pgmap v1067: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:12.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[32124]: audit 2024-09-17T09:08:11.391269+0000 mon.a (mon.0) 3460 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:12.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[32124]: cluster 2024-09-17T09:08:11.391390+0000 mon.a (mon.0) 3461 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2024-09-17T09:08:12.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[32124]: audit 2024-09-17T09:08:11.392409+0000 mon.a (mon.0) 3462 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-134"}]: dispatch 2024-09-17T09:08:12.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:12 smithi078 bash[32124]: audit 2024-09-17T09:08:11.607705+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:13.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:13 smithi136 bash[24812]: audit 2024-09-17T09:08:12.395503+0000 mon.a (mon.0) 3464 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-134"}]': finished 2024-09-17T09:08:13.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:13 smithi136 bash[24812]: cluster 2024-09-17T09:08:12.395646+0000 mon.a (mon.0) 3465 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2024-09-17T09:08:13.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:13 smithi136 bash[24812]: audit 2024-09-17T09:08:12.397110+0000 mon.a (mon.0) 3466 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-134", "mode": "writeback"}]: dispatch 2024-09-17T09:08:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:13 smithi136 bash[24812]: cluster 2024-09-17T09:08:12.857272+0000 mon.a (mon.0) 3467 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:13 smithi136 bash[24812]: audit 2024-09-17T09:08:12.866886+0000 mon.a (mon.0) 3468 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-134", "mode": "writeback"}]': finished 2024-09-17T09:08:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:13 smithi136 bash[24812]: cluster 2024-09-17T09:08:12.867315+0000 mon.a (mon.0) 3469 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2024-09-17T09:08:13.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:13 smithi136 bash[24812]: audit 2024-09-17T09:08:12.960039+0000 mon.a (mon.0) 3470 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[22670]: audit 2024-09-17T09:08:12.395503+0000 mon.a (mon.0) 3464 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-134"}]': finished 2024-09-17T09:08:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[22670]: cluster 2024-09-17T09:08:12.395646+0000 mon.a (mon.0) 3465 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2024-09-17T09:08:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[22670]: audit 2024-09-17T09:08:12.397110+0000 mon.a (mon.0) 3466 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-134", "mode": "writeback"}]: dispatch 2024-09-17T09:08:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[22670]: cluster 2024-09-17T09:08:12.857272+0000 mon.a (mon.0) 3467 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[22670]: audit 2024-09-17T09:08:12.866886+0000 mon.a (mon.0) 3468 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-134", "mode": "writeback"}]': finished 2024-09-17T09:08:13.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[22670]: cluster 2024-09-17T09:08:12.867315+0000 mon.a (mon.0) 3469 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[22670]: audit 2024-09-17T09:08:12.960039+0000 mon.a (mon.0) 3470 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[32124]: audit 2024-09-17T09:08:12.395503+0000 mon.a (mon.0) 3464 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-134"}]': finished 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[32124]: cluster 2024-09-17T09:08:12.395646+0000 mon.a (mon.0) 3465 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[32124]: audit 2024-09-17T09:08:12.397110+0000 mon.a (mon.0) 3466 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-134", "mode": "writeback"}]: dispatch 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[32124]: cluster 2024-09-17T09:08:12.857272+0000 mon.a (mon.0) 3467 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[32124]: audit 2024-09-17T09:08:12.866886+0000 mon.a (mon.0) 3468 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-134", "mode": "writeback"}]': finished 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[32124]: cluster 2024-09-17T09:08:12.867315+0000 mon.a (mon.0) 3469 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2024-09-17T09:08:13.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:13 smithi078 bash[32124]: audit 2024-09-17T09:08:12.960039+0000 mon.a (mon.0) 3470 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:15.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:14 smithi136 bash[24812]: cluster 2024-09-17T09:08:13.196467+0000 mgr.y (mgr.14532) 636 : cluster [DBG] pgmap v1071: 204 pgs: 204 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-17T09:08:15.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:14 smithi136 bash[24812]: audit 2024-09-17T09:08:13.869807+0000 mon.a (mon.0) 3471 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:15.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:14 smithi136 bash[24812]: cluster 2024-09-17T09:08:13.869965+0000 mon.a (mon.0) 3472 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2024-09-17T09:08:15.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:14 smithi136 bash[24812]: audit 2024-09-17T09:08:13.879801+0000 mon.a (mon.0) 3473 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134"}]: dispatch 2024-09-17T09:08:15.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[22670]: cluster 2024-09-17T09:08:13.196467+0000 mgr.y (mgr.14532) 636 : cluster [DBG] pgmap v1071: 204 pgs: 204 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-17T09:08:15.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[22670]: audit 2024-09-17T09:08:13.869807+0000 mon.a (mon.0) 3471 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:15.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[22670]: cluster 2024-09-17T09:08:13.869965+0000 mon.a (mon.0) 3472 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2024-09-17T09:08:15.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[22670]: audit 2024-09-17T09:08:13.879801+0000 mon.a (mon.0) 3473 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134"}]: dispatch 2024-09-17T09:08:15.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[32124]: cluster 2024-09-17T09:08:13.196467+0000 mgr.y (mgr.14532) 636 : cluster [DBG] pgmap v1071: 204 pgs: 204 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-17T09:08:15.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[32124]: audit 2024-09-17T09:08:13.869807+0000 mon.a (mon.0) 3471 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:15.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[32124]: cluster 2024-09-17T09:08:13.869965+0000 mon.a (mon.0) 3472 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2024-09-17T09:08:15.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:14 smithi078 bash[32124]: audit 2024-09-17T09:08:13.879801+0000 mon.a (mon.0) 3473 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134"}]: dispatch 2024-09-17T09:08:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:15 smithi136 bash[24812]: cluster 2024-09-17T09:08:14.874856+0000 mon.a (mon.0) 3474 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:15 smithi136 bash[24812]: audit 2024-09-17T09:08:14.883817+0000 mon.a (mon.0) 3475 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134"}]': finished 2024-09-17T09:08:16.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:15 smithi136 bash[24812]: cluster 2024-09-17T09:08:14.884002+0000 mon.a (mon.0) 3476 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2024-09-17T09:08:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:15 smithi078 bash[22670]: cluster 2024-09-17T09:08:14.874856+0000 mon.a (mon.0) 3474 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:15 smithi078 bash[22670]: audit 2024-09-17T09:08:14.883817+0000 mon.a (mon.0) 3475 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134"}]': finished 2024-09-17T09:08:16.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:15 smithi078 bash[22670]: cluster 2024-09-17T09:08:14.884002+0000 mon.a (mon.0) 3476 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2024-09-17T09:08:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:15 smithi078 bash[32124]: cluster 2024-09-17T09:08:14.874856+0000 mon.a (mon.0) 3474 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:15 smithi078 bash[32124]: audit 2024-09-17T09:08:14.883817+0000 mon.a (mon.0) 3475 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-134"}]': finished 2024-09-17T09:08:16.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:15 smithi078 bash[32124]: cluster 2024-09-17T09:08:14.884002+0000 mon.a (mon.0) 3476 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2024-09-17T09:08:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:16 smithi136 bash[24812]: cluster 2024-09-17T09:08:15.197269+0000 mgr.y (mgr.14532) 637 : cluster [DBG] pgmap v1074: 204 pgs: 204 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-17T09:08:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:16 smithi136 bash[24812]: cluster 2024-09-17T09:08:15.891622+0000 mon.a (mon.0) 3477 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:17.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:16 smithi136 bash[24812]: cluster 2024-09-17T09:08:15.901980+0000 mon.a (mon.0) 3478 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2024-09-17T09:08:17.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:16 smithi078 bash[32124]: cluster 2024-09-17T09:08:15.197269+0000 mgr.y (mgr.14532) 637 : cluster [DBG] pgmap v1074: 204 pgs: 204 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-17T09:08:17.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:16 smithi078 bash[32124]: cluster 2024-09-17T09:08:15.891622+0000 mon.a (mon.0) 3477 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:17.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:16 smithi078 bash[32124]: cluster 2024-09-17T09:08:15.901980+0000 mon.a (mon.0) 3478 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2024-09-17T09:08:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:16 smithi078 bash[22670]: cluster 2024-09-17T09:08:15.197269+0000 mgr.y (mgr.14532) 637 : cluster [DBG] pgmap v1074: 204 pgs: 204 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-17T09:08:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:16 smithi078 bash[22670]: cluster 2024-09-17T09:08:15.891622+0000 mon.a (mon.0) 3477 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:17.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:16 smithi078 bash[22670]: cluster 2024-09-17T09:08:15.901980+0000 mon.a (mon.0) 3478 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2024-09-17T09:08:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:17 smithi136 bash[24812]: cluster 2024-09-17T09:08:16.933624+0000 mon.a (mon.0) 3479 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2024-09-17T09:08:18.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:17 smithi136 bash[24812]: audit 2024-09-17T09:08:16.936675+0000 mon.a (mon.0) 3480 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:18.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:08:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:08:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:08:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:17 smithi078 bash[22670]: cluster 2024-09-17T09:08:16.933624+0000 mon.a (mon.0) 3479 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2024-09-17T09:08:18.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:17 smithi078 bash[22670]: audit 2024-09-17T09:08:16.936675+0000 mon.a (mon.0) 3480 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:18.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:17 smithi078 bash[32124]: cluster 2024-09-17T09:08:16.933624+0000 mon.a (mon.0) 3479 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2024-09-17T09:08:18.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:17 smithi078 bash[32124]: audit 2024-09-17T09:08:16.936675+0000 mon.a (mon.0) 3480 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:19.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:18 smithi136 bash[24812]: cluster 2024-09-17T09:08:17.198055+0000 mgr.y (mgr.14532) 638 : cluster [DBG] pgmap v1077: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:19.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:18 smithi136 bash[24812]: audit 2024-09-17T09:08:17.947323+0000 mon.a (mon.0) 3481 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:19.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:18 smithi136 bash[24812]: cluster 2024-09-17T09:08:17.947898+0000 mon.a (mon.0) 3482 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2024-09-17T09:08:19.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:18 smithi136 bash[24812]: audit 2024-09-17T09:08:17.957362+0000 mon.a (mon.0) 3483 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:19.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[32124]: cluster 2024-09-17T09:08:17.198055+0000 mgr.y (mgr.14532) 638 : cluster [DBG] pgmap v1077: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:19.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[32124]: audit 2024-09-17T09:08:17.947323+0000 mon.a (mon.0) 3481 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:19.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[32124]: cluster 2024-09-17T09:08:17.947898+0000 mon.a (mon.0) 3482 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2024-09-17T09:08:19.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[32124]: audit 2024-09-17T09:08:17.957362+0000 mon.a (mon.0) 3483 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:19.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[22670]: cluster 2024-09-17T09:08:17.198055+0000 mgr.y (mgr.14532) 638 : cluster [DBG] pgmap v1077: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:19.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[22670]: audit 2024-09-17T09:08:17.947323+0000 mon.a (mon.0) 3481 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:19.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[22670]: cluster 2024-09-17T09:08:17.947898+0000 mon.a (mon.0) 3482 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2024-09-17T09:08:19.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:18 smithi078 bash[22670]: audit 2024-09-17T09:08:17.957362+0000 mon.a (mon.0) 3483 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:20.290 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:08:20 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:08:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:19 smithi136 bash[24812]: audit 2024-09-17T09:08:18.949177+0000 mon.a (mon.0) 3484 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:19 smithi136 bash[24812]: cluster 2024-09-17T09:08:18.949363+0000 mon.a (mon.0) 3485 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2024-09-17T09:08:20.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:19 smithi136 bash[24812]: audit 2024-09-17T09:08:18.951182+0000 mon.a (mon.0) 3486 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-136"}]: dispatch 2024-09-17T09:08:20.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:19 smithi136 bash[24812]: audit 2024-09-17T09:08:19.951129+0000 mon.a (mon.0) 3487 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-136"}]': finished 2024-09-17T09:08:20.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:19 smithi136 bash[24812]: cluster 2024-09-17T09:08:19.951375+0000 mon.a (mon.0) 3488 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2024-09-17T09:08:20.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:19 smithi136 bash[24812]: audit 2024-09-17T09:08:19.953170+0000 mon.a (mon.0) 3489 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-136", "mode": "writeback"}]: dispatch 2024-09-17T09:08:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[22670]: audit 2024-09-17T09:08:18.949177+0000 mon.a (mon.0) 3484 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[22670]: cluster 2024-09-17T09:08:18.949363+0000 mon.a (mon.0) 3485 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2024-09-17T09:08:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[22670]: audit 2024-09-17T09:08:18.951182+0000 mon.a (mon.0) 3486 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-136"}]: dispatch 2024-09-17T09:08:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[22670]: audit 2024-09-17T09:08:19.951129+0000 mon.a (mon.0) 3487 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-136"}]': finished 2024-09-17T09:08:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[22670]: cluster 2024-09-17T09:08:19.951375+0000 mon.a (mon.0) 3488 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2024-09-17T09:08:20.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[22670]: audit 2024-09-17T09:08:19.953170+0000 mon.a (mon.0) 3489 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-136", "mode": "writeback"}]: dispatch 2024-09-17T09:08:20.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[32124]: audit 2024-09-17T09:08:18.949177+0000 mon.a (mon.0) 3484 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:20.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[32124]: cluster 2024-09-17T09:08:18.949363+0000 mon.a (mon.0) 3485 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2024-09-17T09:08:20.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[32124]: audit 2024-09-17T09:08:18.951182+0000 mon.a (mon.0) 3486 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-136"}]: dispatch 2024-09-17T09:08:20.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[32124]: audit 2024-09-17T09:08:19.951129+0000 mon.a (mon.0) 3487 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-136"}]': finished 2024-09-17T09:08:20.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[32124]: cluster 2024-09-17T09:08:19.951375+0000 mon.a (mon.0) 3488 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2024-09-17T09:08:20.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:19 smithi078 bash[32124]: audit 2024-09-17T09:08:19.953170+0000 mon.a (mon.0) 3489 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-136", "mode": "writeback"}]: dispatch 2024-09-17T09:08:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:20 smithi136 bash[24812]: cluster 2024-09-17T09:08:19.198872+0000 mgr.y (mgr.14532) 639 : cluster [DBG] pgmap v1080: 204 pgs: 1 active, 10 creating+activating, 7 creating+peering, 186 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:20 smithi136 bash[24812]: audit 2024-09-17T09:08:20.041464+0000 mgr.y (mgr.14532) 640 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:20 smithi136 bash[24812]: cluster 2024-09-17T09:08:20.944391+0000 mon.a (mon.0) 3490 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:20 smithi136 bash[24812]: audit 2024-09-17T09:08:20.956517+0000 mon.a (mon.0) 3491 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-136", "mode": "writeback"}]': finished 2024-09-17T09:08:21.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:20 smithi136 bash[24812]: cluster 2024-09-17T09:08:20.956684+0000 mon.a (mon.0) 3492 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2024-09-17T09:08:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[22670]: cluster 2024-09-17T09:08:19.198872+0000 mgr.y (mgr.14532) 639 : cluster [DBG] pgmap v1080: 204 pgs: 1 active, 10 creating+activating, 7 creating+peering, 186 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[22670]: audit 2024-09-17T09:08:20.041464+0000 mgr.y (mgr.14532) 640 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[22670]: cluster 2024-09-17T09:08:20.944391+0000 mon.a (mon.0) 3490 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[22670]: audit 2024-09-17T09:08:20.956517+0000 mon.a (mon.0) 3491 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-136", "mode": "writeback"}]': finished 2024-09-17T09:08:21.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[22670]: cluster 2024-09-17T09:08:20.956684+0000 mon.a (mon.0) 3492 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2024-09-17T09:08:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[32124]: cluster 2024-09-17T09:08:19.198872+0000 mgr.y (mgr.14532) 639 : cluster [DBG] pgmap v1080: 204 pgs: 1 active, 10 creating+activating, 7 creating+peering, 186 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:21.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[32124]: audit 2024-09-17T09:08:20.041464+0000 mgr.y (mgr.14532) 640 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:21.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[32124]: cluster 2024-09-17T09:08:20.944391+0000 mon.a (mon.0) 3490 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:08:21.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[32124]: audit 2024-09-17T09:08:20.956517+0000 mon.a (mon.0) 3491 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-136", "mode": "writeback"}]': finished 2024-09-17T09:08:21.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:20 smithi078 bash[32124]: cluster 2024-09-17T09:08:20.956684+0000 mon.a (mon.0) 3492 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2024-09-17T09:08:22.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:21 smithi136 bash[24812]: audit 2024-09-17T09:08:21.096719+0000 mon.a (mon.0) 3493 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:22.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:21 smithi078 bash[22670]: audit 2024-09-17T09:08:21.096719+0000 mon.a (mon.0) 3493 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:22.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:21 smithi078 bash[32124]: audit 2024-09-17T09:08:21.096719+0000 mon.a (mon.0) 3493 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:23.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:23 smithi136 bash[24812]: cluster 2024-09-17T09:08:21.199636+0000 mgr.y (mgr.14532) 641 : cluster [DBG] pgmap v1083: 204 pgs: 1 active, 10 creating+activating, 7 creating+peering, 186 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:23.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:23 smithi136 bash[24812]: audit 2024-09-17T09:08:21.989239+0000 mon.a (mon.0) 3494 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:23.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:23 smithi136 bash[24812]: cluster 2024-09-17T09:08:21.989404+0000 mon.a (mon.0) 3495 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2024-09-17T09:08:23.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:23 smithi136 bash[24812]: audit 2024-09-17T09:08:21.991104+0000 mon.a (mon.0) 3496 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136"}]: dispatch 2024-09-17T09:08:23.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:23 smithi136 bash[24812]: cluster 2024-09-17T09:08:22.860315+0000 mon.a (mon.0) 3497 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[32124]: cluster 2024-09-17T09:08:21.199636+0000 mgr.y (mgr.14532) 641 : cluster [DBG] pgmap v1083: 204 pgs: 1 active, 10 creating+activating, 7 creating+peering, 186 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[32124]: audit 2024-09-17T09:08:21.989239+0000 mon.a (mon.0) 3494 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[32124]: cluster 2024-09-17T09:08:21.989404+0000 mon.a (mon.0) 3495 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2024-09-17T09:08:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[32124]: audit 2024-09-17T09:08:21.991104+0000 mon.a (mon.0) 3496 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136"}]: dispatch 2024-09-17T09:08:23.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[32124]: cluster 2024-09-17T09:08:22.860315+0000 mon.a (mon.0) 3497 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[22670]: cluster 2024-09-17T09:08:21.199636+0000 mgr.y (mgr.14532) 641 : cluster [DBG] pgmap v1083: 204 pgs: 1 active, 10 creating+activating, 7 creating+peering, 186 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:23.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[22670]: audit 2024-09-17T09:08:21.989239+0000 mon.a (mon.0) 3494 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:08:23.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[22670]: cluster 2024-09-17T09:08:21.989404+0000 mon.a (mon.0) 3495 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2024-09-17T09:08:23.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[22670]: audit 2024-09-17T09:08:21.991104+0000 mon.a (mon.0) 3496 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136"}]: dispatch 2024-09-17T09:08:23.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:23 smithi078 bash[22670]: cluster 2024-09-17T09:08:22.860315+0000 mon.a (mon.0) 3497 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:24.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:24 smithi136 bash[24812]: cluster 2024-09-17T09:08:22.983229+0000 mon.a (mon.0) 3498 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:24.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:24 smithi136 bash[24812]: audit 2024-09-17T09:08:22.997182+0000 mon.a (mon.0) 3499 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136"}]': finished 2024-09-17T09:08:24.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:24 smithi136 bash[24812]: cluster 2024-09-17T09:08:22.997371+0000 mon.a (mon.0) 3500 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2024-09-17T09:08:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:24 smithi078 bash[22670]: cluster 2024-09-17T09:08:22.983229+0000 mon.a (mon.0) 3498 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:24 smithi078 bash[22670]: audit 2024-09-17T09:08:22.997182+0000 mon.a (mon.0) 3499 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136"}]': finished 2024-09-17T09:08:24.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:24 smithi078 bash[22670]: cluster 2024-09-17T09:08:22.997371+0000 mon.a (mon.0) 3500 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2024-09-17T09:08:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:24 smithi078 bash[32124]: cluster 2024-09-17T09:08:22.983229+0000 mon.a (mon.0) 3498 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:08:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:24 smithi078 bash[32124]: audit 2024-09-17T09:08:22.997182+0000 mon.a (mon.0) 3499 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-136"}]': finished 2024-09-17T09:08:24.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:24 smithi078 bash[32124]: cluster 2024-09-17T09:08:22.997371+0000 mon.a (mon.0) 3500 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2024-09-17T09:08:25.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:25 smithi136 bash[24812]: cluster 2024-09-17T09:08:23.200665+0000 mgr.y (mgr.14532) 642 : cluster [DBG] pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-09-17T09:08:25.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:25 smithi136 bash[24812]: cluster 2024-09-17T09:08:24.025862+0000 mon.a (mon.0) 3501 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2024-09-17T09:08:25.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:25 smithi078 bash[22670]: cluster 2024-09-17T09:08:23.200665+0000 mgr.y (mgr.14532) 642 : cluster [DBG] pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-09-17T09:08:25.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:25 smithi078 bash[22670]: cluster 2024-09-17T09:08:24.025862+0000 mon.a (mon.0) 3501 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2024-09-17T09:08:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:25 smithi078 bash[32124]: cluster 2024-09-17T09:08:23.200665+0000 mgr.y (mgr.14532) 642 : cluster [DBG] pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-09-17T09:08:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:25 smithi078 bash[32124]: cluster 2024-09-17T09:08:24.025862+0000 mon.a (mon.0) 3501 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2024-09-17T09:08:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[32124]: cluster 2024-09-17T09:08:25.027710+0000 mon.a (mon.0) 3502 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2024-09-17T09:08:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[32124]: audit 2024-09-17T09:08:25.032064+0000 mon.a (mon.0) 3503 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[32124]: audit 2024-09-17T09:08:26.026872+0000 mon.a (mon.0) 3504 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[32124]: cluster 2024-09-17T09:08:26.027408+0000 mon.a (mon.0) 3505 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2024-09-17T09:08:26.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[32124]: audit 2024-09-17T09:08:26.034835+0000 mon.a (mon.0) 3506 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:26.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[22670]: cluster 2024-09-17T09:08:25.027710+0000 mon.a (mon.0) 3502 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2024-09-17T09:08:26.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[22670]: audit 2024-09-17T09:08:25.032064+0000 mon.a (mon.0) 3503 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:26.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[22670]: audit 2024-09-17T09:08:26.026872+0000 mon.a (mon.0) 3504 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:26.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[22670]: cluster 2024-09-17T09:08:26.027408+0000 mon.a (mon.0) 3505 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2024-09-17T09:08:26.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:26 smithi078 bash[22670]: audit 2024-09-17T09:08:26.034835+0000 mon.a (mon.0) 3506 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:26 smithi136 bash[24812]: cluster 2024-09-17T09:08:25.027710+0000 mon.a (mon.0) 3502 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2024-09-17T09:08:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:26 smithi136 bash[24812]: audit 2024-09-17T09:08:25.032064+0000 mon.a (mon.0) 3503 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:26 smithi136 bash[24812]: audit 2024-09-17T09:08:26.026872+0000 mon.a (mon.0) 3504 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:26 smithi136 bash[24812]: cluster 2024-09-17T09:08:26.027408+0000 mon.a (mon.0) 3505 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2024-09-17T09:08:26.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:26 smithi136 bash[24812]: audit 2024-09-17T09:08:26.034835+0000 mon.a (mon.0) 3506 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:27.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[32124]: cluster 2024-09-17T09:08:25.201434+0000 mgr.y (mgr.14532) 643 : cluster [DBG] pgmap v1089: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T09:08:27.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[32124]: audit 2024-09-17T09:08:26.635902+0000 mon.a (mon.0) 3507 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:27.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[32124]: audit 2024-09-17T09:08:27.031294+0000 mon.a (mon.0) 3508 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:27.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[32124]: cluster 2024-09-17T09:08:27.031755+0000 mon.a (mon.0) 3509 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2024-09-17T09:08:27.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[32124]: audit 2024-09-17T09:08:27.033615+0000 mon.a (mon.0) 3510 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:08:27.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[22670]: cluster 2024-09-17T09:08:25.201434+0000 mgr.y (mgr.14532) 643 : cluster [DBG] pgmap v1089: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T09:08:27.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[22670]: audit 2024-09-17T09:08:26.635902+0000 mon.a (mon.0) 3507 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:27.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[22670]: audit 2024-09-17T09:08:27.031294+0000 mon.a (mon.0) 3508 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:27.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[22670]: cluster 2024-09-17T09:08:27.031755+0000 mon.a (mon.0) 3509 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2024-09-17T09:08:27.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[22670]: audit 2024-09-17T09:08:27.033615+0000 mon.a (mon.0) 3510 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:08:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:27 smithi136 bash[24812]: cluster 2024-09-17T09:08:25.201434+0000 mgr.y (mgr.14532) 643 : cluster [DBG] pgmap v1089: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-17T09:08:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:27 smithi136 bash[24812]: audit 2024-09-17T09:08:26.635902+0000 mon.a (mon.0) 3507 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:27 smithi136 bash[24812]: audit 2024-09-17T09:08:27.031294+0000 mon.a (mon.0) 3508 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:27.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:27 smithi136 bash[24812]: cluster 2024-09-17T09:08:27.031755+0000 mon.a (mon.0) 3509 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2024-09-17T09:08:27.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:27 smithi136 bash[24812]: audit 2024-09-17T09:08:27.033615+0000 mon.a (mon.0) 3510 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:08:28.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:08:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:08:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:08:28.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[22670]: cluster 2024-09-17T09:08:27.870805+0000 mon.a (mon.0) 3511 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:28.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[22670]: audit 2024-09-17T09:08:28.033740+0000 mon.a (mon.0) 3512 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:08:28.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[22670]: cluster 2024-09-17T09:08:28.033923+0000 mon.a (mon.0) 3513 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2024-09-17T09:08:28.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[22670]: audit 2024-09-17T09:08:28.035007+0000 mon.a (mon.0) 3514 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:08:28.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[32124]: cluster 2024-09-17T09:08:27.870805+0000 mon.a (mon.0) 3511 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:28.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[32124]: audit 2024-09-17T09:08:28.033740+0000 mon.a (mon.0) 3512 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:08:28.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[32124]: cluster 2024-09-17T09:08:28.033923+0000 mon.a (mon.0) 3513 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2024-09-17T09:08:28.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:28 smithi078 bash[32124]: audit 2024-09-17T09:08:28.035007+0000 mon.a (mon.0) 3514 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:08:28.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:28 smithi136 bash[24812]: cluster 2024-09-17T09:08:27.870805+0000 mon.a (mon.0) 3511 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:28.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:28 smithi136 bash[24812]: audit 2024-09-17T09:08:28.033740+0000 mon.a (mon.0) 3512 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:08:28.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:28 smithi136 bash[24812]: cluster 2024-09-17T09:08:28.033923+0000 mon.a (mon.0) 3513 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2024-09-17T09:08:28.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:28 smithi136 bash[24812]: audit 2024-09-17T09:08:28.035007+0000 mon.a (mon.0) 3514 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:08:29.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[22670]: cluster 2024-09-17T09:08:27.202325+0000 mgr.y (mgr.14532) 644 : cluster [DBG] pgmap v1092: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:29.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[22670]: audit 2024-09-17T09:08:29.036950+0000 mon.a (mon.0) 3515 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:08:29.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[22670]: cluster 2024-09-17T09:08:29.037113+0000 mon.a (mon.0) 3516 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2024-09-17T09:08:29.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[22670]: audit 2024-09-17T09:08:29.039780+0000 mon.a (mon.0) 3517 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:08:29.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[32124]: cluster 2024-09-17T09:08:27.202325+0000 mgr.y (mgr.14532) 644 : cluster [DBG] pgmap v1092: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:29.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[32124]: audit 2024-09-17T09:08:29.036950+0000 mon.a (mon.0) 3515 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:08:29.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[32124]: cluster 2024-09-17T09:08:29.037113+0000 mon.a (mon.0) 3516 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2024-09-17T09:08:29.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:29 smithi078 bash[32124]: audit 2024-09-17T09:08:29.039780+0000 mon.a (mon.0) 3517 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:08:29.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:29 smithi136 bash[24812]: cluster 2024-09-17T09:08:27.202325+0000 mgr.y (mgr.14532) 644 : cluster [DBG] pgmap v1092: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:29.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:29 smithi136 bash[24812]: audit 2024-09-17T09:08:29.036950+0000 mon.a (mon.0) 3515 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:08:29.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:29 smithi136 bash[24812]: cluster 2024-09-17T09:08:29.037113+0000 mon.a (mon.0) 3516 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2024-09-17T09:08:29.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:29 smithi136 bash[24812]: audit 2024-09-17T09:08:29.039780+0000 mon.a (mon.0) 3517 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-17T09:08:30.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:08:30 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:08:31.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:31 smithi136 bash[24812]: cluster 2024-09-17T09:08:29.203190+0000 mgr.y (mgr.14532) 645 : cluster [DBG] pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:31.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:31 smithi136 bash[24812]: audit 2024-09-17T09:08:30.038880+0000 mon.a (mon.0) 3518 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:08:31.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:31 smithi136 bash[24812]: cluster 2024-09-17T09:08:30.039093+0000 mon.a (mon.0) 3519 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2024-09-17T09:08:31.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:31 smithi136 bash[24812]: audit 2024-09-17T09:08:30.052903+0000 mgr.y (mgr.14532) 646 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[22670]: cluster 2024-09-17T09:08:29.203190+0000 mgr.y (mgr.14532) 645 : cluster [DBG] pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[22670]: audit 2024-09-17T09:08:30.038880+0000 mon.a (mon.0) 3518 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:08:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[22670]: cluster 2024-09-17T09:08:30.039093+0000 mon.a (mon.0) 3519 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2024-09-17T09:08:31.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[22670]: audit 2024-09-17T09:08:30.052903+0000 mgr.y (mgr.14532) 646 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[32124]: cluster 2024-09-17T09:08:29.203190+0000 mgr.y (mgr.14532) 645 : cluster [DBG] pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[32124]: audit 2024-09-17T09:08:30.038880+0000 mon.a (mon.0) 3518 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-17T09:08:31.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[32124]: cluster 2024-09-17T09:08:30.039093+0000 mon.a (mon.0) 3519 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2024-09-17T09:08:31.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:31 smithi078 bash[32124]: audit 2024-09-17T09:08:30.052903+0000 mgr.y (mgr.14532) 646 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:32.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:32 smithi078 bash[22670]: audit 2024-09-17T09:08:31.077335+0000 mon.a (mon.0) 3520 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:32.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:32 smithi078 bash[22670]: audit 2024-09-17T09:08:31.078159+0000 mon.a (mon.0) 3521 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138"}]: dispatch 2024-09-17T09:08:32.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:32 smithi078 bash[32124]: audit 2024-09-17T09:08:31.077335+0000 mon.a (mon.0) 3520 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:32.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:32 smithi078 bash[32124]: audit 2024-09-17T09:08:31.078159+0000 mon.a (mon.0) 3521 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138"}]: dispatch 2024-09-17T09:08:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:32 smithi136 bash[24812]: audit 2024-09-17T09:08:31.077335+0000 mon.a (mon.0) 3520 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:32.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:32 smithi136 bash[24812]: audit 2024-09-17T09:08:31.078159+0000 mon.a (mon.0) 3521 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138"}]: dispatch 2024-09-17T09:08:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:33 smithi136 bash[24812]: cluster 2024-09-17T09:08:31.203974+0000 mgr.y (mgr.14532) 647 : cluster [DBG] pgmap v1097: 204 pgs: 204 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:33 smithi136 bash[24812]: audit 2024-09-17T09:08:32.057766+0000 mon.a (mon.0) 3522 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138"}]': finished 2024-09-17T09:08:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:33 smithi136 bash[24812]: cluster 2024-09-17T09:08:32.057936+0000 mon.a (mon.0) 3523 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2024-09-17T09:08:33.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:33 smithi136 bash[24812]: cluster 2024-09-17T09:08:32.872444+0000 mon.a (mon.0) 3524 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[32124]: cluster 2024-09-17T09:08:31.203974+0000 mgr.y (mgr.14532) 647 : cluster [DBG] pgmap v1097: 204 pgs: 204 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[32124]: audit 2024-09-17T09:08:32.057766+0000 mon.a (mon.0) 3522 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138"}]': finished 2024-09-17T09:08:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[32124]: cluster 2024-09-17T09:08:32.057936+0000 mon.a (mon.0) 3523 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2024-09-17T09:08:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[32124]: cluster 2024-09-17T09:08:32.872444+0000 mon.a (mon.0) 3524 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[22670]: cluster 2024-09-17T09:08:31.203974+0000 mgr.y (mgr.14532) 647 : cluster [DBG] pgmap v1097: 204 pgs: 204 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[22670]: audit 2024-09-17T09:08:32.057766+0000 mon.a (mon.0) 3522 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-138"}]': finished 2024-09-17T09:08:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[22670]: cluster 2024-09-17T09:08:32.057936+0000 mon.a (mon.0) 3523 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2024-09-17T09:08:33.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:33 smithi078 bash[22670]: cluster 2024-09-17T09:08:32.872444+0000 mon.a (mon.0) 3524 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:34.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:34 smithi136 bash[24812]: cluster 2024-09-17T09:08:33.057981+0000 mon.a (mon.0) 3525 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2024-09-17T09:08:34.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:34 smithi136 bash[24812]: cluster 2024-09-17T09:08:33.204689+0000 mgr.y (mgr.14532) 648 : cluster [DBG] pgmap v1100: 172 pgs: 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:34.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:34 smithi136 bash[24812]: cluster 2024-09-17T09:08:34.066051+0000 mon.a (mon.0) 3526 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2024-09-17T09:08:34.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:34 smithi136 bash[24812]: audit 2024-09-17T09:08:34.076124+0000 mon.a (mon.0) 3527 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:34.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:34 smithi136 bash[24812]: audit 2024-09-17T09:08:34.286625+0000 mon.a (mon.0) 3528 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:34.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[32124]: cluster 2024-09-17T09:08:33.057981+0000 mon.a (mon.0) 3525 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2024-09-17T09:08:34.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[32124]: cluster 2024-09-17T09:08:33.204689+0000 mgr.y (mgr.14532) 648 : cluster [DBG] pgmap v1100: 172 pgs: 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:34.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[32124]: cluster 2024-09-17T09:08:34.066051+0000 mon.a (mon.0) 3526 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2024-09-17T09:08:34.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[32124]: audit 2024-09-17T09:08:34.076124+0000 mon.a (mon.0) 3527 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:34.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[32124]: audit 2024-09-17T09:08:34.286625+0000 mon.a (mon.0) 3528 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[22670]: cluster 2024-09-17T09:08:33.057981+0000 mon.a (mon.0) 3525 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2024-09-17T09:08:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[22670]: cluster 2024-09-17T09:08:33.204689+0000 mgr.y (mgr.14532) 648 : cluster [DBG] pgmap v1100: 172 pgs: 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:34.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[22670]: cluster 2024-09-17T09:08:34.066051+0000 mon.a (mon.0) 3526 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2024-09-17T09:08:34.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[22670]: audit 2024-09-17T09:08:34.076124+0000 mon.a (mon.0) 3527 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:34.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:34 smithi078 bash[22670]: audit 2024-09-17T09:08:34.286625+0000 mon.a (mon.0) 3528 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:35.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:35 smithi136 bash[24812]: audit 2024-09-17T09:08:34.832830+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:08:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:35 smithi136 bash[24812]: audit 2024-09-17T09:08:34.834044+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:08:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:35 smithi136 bash[24812]: audit 2024-09-17T09:08:34.844831+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:08:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:35 smithi136 bash[24812]: audit 2024-09-17T09:08:35.071666+0000 mon.a (mon.0) 3532 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:35 smithi136 bash[24812]: cluster 2024-09-17T09:08:35.071966+0000 mon.a (mon.0) 3533 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2024-09-17T09:08:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:35 smithi136 bash[24812]: audit 2024-09-17T09:08:35.078449+0000 mon.a (mon.0) 3534 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:35.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[22670]: audit 2024-09-17T09:08:34.832830+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:08:35.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[22670]: audit 2024-09-17T09:08:34.834044+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:08:35.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[22670]: audit 2024-09-17T09:08:34.844831+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:08:35.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[22670]: audit 2024-09-17T09:08:35.071666+0000 mon.a (mon.0) 3532 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[22670]: cluster 2024-09-17T09:08:35.071966+0000 mon.a (mon.0) 3533 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[22670]: audit 2024-09-17T09:08:35.078449+0000 mon.a (mon.0) 3534 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[32124]: audit 2024-09-17T09:08:34.832830+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[32124]: audit 2024-09-17T09:08:34.834044+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[32124]: audit 2024-09-17T09:08:34.844831+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[32124]: audit 2024-09-17T09:08:35.071666+0000 mon.a (mon.0) 3532 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[32124]: cluster 2024-09-17T09:08:35.071966+0000 mon.a (mon.0) 3533 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2024-09-17T09:08:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:35 smithi078 bash[32124]: audit 2024-09-17T09:08:35.078449+0000 mon.a (mon.0) 3534 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[32124]: cluster 2024-09-17T09:08:35.205478+0000 mgr.y (mgr.14532) 649 : cluster [DBG] pgmap v1103: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[32124]: audit 2024-09-17T09:08:36.079005+0000 mon.a (mon.0) 3535 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[32124]: cluster 2024-09-17T09:08:36.079221+0000 mon.a (mon.0) 3536 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2024-09-17T09:08:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[32124]: audit 2024-09-17T09:08:36.081801+0000 mon.a (mon.0) 3537 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-17T09:08:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[22670]: cluster 2024-09-17T09:08:35.205478+0000 mgr.y (mgr.14532) 649 : cluster [DBG] pgmap v1103: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[22670]: audit 2024-09-17T09:08:36.079005+0000 mon.a (mon.0) 3535 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[22670]: cluster 2024-09-17T09:08:36.079221+0000 mon.a (mon.0) 3536 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2024-09-17T09:08:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[22670]: audit 2024-09-17T09:08:36.081801+0000 mon.a (mon.0) 3537 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-17T09:08:37.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:37 smithi136 bash[24812]: cluster 2024-09-17T09:08:35.205478+0000 mgr.y (mgr.14532) 649 : cluster [DBG] pgmap v1103: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:37.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:37 smithi136 bash[24812]: audit 2024-09-17T09:08:36.079005+0000 mon.a (mon.0) 3535 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:37.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:37 smithi136 bash[24812]: cluster 2024-09-17T09:08:36.079221+0000 mon.a (mon.0) 3536 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2024-09-17T09:08:37.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:37 smithi136 bash[24812]: audit 2024-09-17T09:08:36.081801+0000 mon.a (mon.0) 3537 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-17T09:08:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:08:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:08:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:08:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:38 smithi078 bash[32124]: audit 2024-09-17T09:08:37.080806+0000 mon.a (mon.0) 3538 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_count","val": "3"}]': finished 2024-09-17T09:08:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:38 smithi078 bash[32124]: cluster 2024-09-17T09:08:37.080983+0000 mon.a (mon.0) 3539 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2024-09-17T09:08:38.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:38 smithi078 bash[32124]: audit 2024-09-17T09:08:37.082946+0000 mon.a (mon.0) 3540 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-17T09:08:38.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:38 smithi078 bash[22670]: audit 2024-09-17T09:08:37.080806+0000 mon.a (mon.0) 3538 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_count","val": "3"}]': finished 2024-09-17T09:08:38.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:38 smithi078 bash[22670]: cluster 2024-09-17T09:08:37.080983+0000 mon.a (mon.0) 3539 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2024-09-17T09:08:38.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:38 smithi078 bash[22670]: audit 2024-09-17T09:08:37.082946+0000 mon.a (mon.0) 3540 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-17T09:08:38.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:38 smithi136 bash[24812]: audit 2024-09-17T09:08:37.080806+0000 mon.a (mon.0) 3538 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_count","val": "3"}]': finished 2024-09-17T09:08:38.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:38 smithi136 bash[24812]: cluster 2024-09-17T09:08:37.080983+0000 mon.a (mon.0) 3539 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2024-09-17T09:08:38.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:38 smithi136 bash[24812]: audit 2024-09-17T09:08:37.082946+0000 mon.a (mon.0) 3540 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-17T09:08:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: cluster 2024-09-17T09:08:37.206266+0000 mgr.y (mgr.14532) 650 : cluster [DBG] pgmap v1106: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: audit 2024-09-17T09:08:38.083541+0000 mon.a (mon.0) 3541 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_period","val": "3"}]': finished 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: cluster 2024-09-17T09:08:38.083730+0000 mon.a (mon.0) 3542 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: audit 2024-09-17T09:08:38.087570+0000 mon.a (mon.0) 3543 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: audit 2024-09-17T09:08:38.100995+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "257.4", "id": [3, 4]}]: dispatch 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: audit 2024-09-17T09:08:39.086014+0000 mon.a (mon.0) 3545 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: audit 2024-09-17T09:08:39.086282+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "257.4", "id": [3, 4]}]': finished 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: cluster 2024-09-17T09:08:39.086440+0000 mon.a (mon.0) 3547 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[22670]: audit 2024-09-17T09:08:39.088122+0000 mon.a (mon.0) 3548 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: cluster 2024-09-17T09:08:37.206266+0000 mgr.y (mgr.14532) 650 : cluster [DBG] pgmap v1106: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: audit 2024-09-17T09:08:38.083541+0000 mon.a (mon.0) 3541 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_period","val": "3"}]': finished 2024-09-17T09:08:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: cluster 2024-09-17T09:08:38.083730+0000 mon.a (mon.0) 3542 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2024-09-17T09:08:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: audit 2024-09-17T09:08:38.087570+0000 mon.a (mon.0) 3543 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:08:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: audit 2024-09-17T09:08:38.100995+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "257.4", "id": [3, 4]}]: dispatch 2024-09-17T09:08:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: audit 2024-09-17T09:08:39.086014+0000 mon.a (mon.0) 3545 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:08:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: audit 2024-09-17T09:08:39.086282+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "257.4", "id": [3, 4]}]': finished 2024-09-17T09:08:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: cluster 2024-09-17T09:08:39.086440+0000 mon.a (mon.0) 3547 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2024-09-17T09:08:39.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:39 smithi078 bash[32124]: audit 2024-09-17T09:08:39.088122+0000 mon.a (mon.0) 3548 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: cluster 2024-09-17T09:08:37.206266+0000 mgr.y (mgr.14532) 650 : cluster [DBG] pgmap v1106: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: audit 2024-09-17T09:08:38.083541+0000 mon.a (mon.0) 3541 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_period","val": "3"}]': finished 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: cluster 2024-09-17T09:08:38.083730+0000 mon.a (mon.0) 3542 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: audit 2024-09-17T09:08:38.087570+0000 mon.a (mon.0) 3543 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: audit 2024-09-17T09:08:38.100995+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "257.4", "id": [3, 4]}]: dispatch 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: audit 2024-09-17T09:08:39.086014+0000 mon.a (mon.0) 3545 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: audit 2024-09-17T09:08:39.086282+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "257.4", "id": [3, 4]}]': finished 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: cluster 2024-09-17T09:08:39.086440+0000 mon.a (mon.0) 3547 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2024-09-17T09:08:39.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:39 smithi136 bash[24812]: audit 2024-09-17T09:08:39.088122+0000 mon.a (mon.0) 3548 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-17T09:08:40.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:08:40 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:08:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[32124]: cluster 2024-09-17T09:08:39.207035+0000 mgr.y (mgr.14532) 651 : cluster [DBG] pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[32124]: audit 2024-09-17T09:08:40.061352+0000 mgr.y (mgr.14532) 652 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[32124]: audit 2024-09-17T09:08:40.088941+0000 mon.a (mon.0) 3549 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-17T09:08:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[32124]: cluster 2024-09-17T09:08:40.089156+0000 mon.a (mon.0) 3550 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2024-09-17T09:08:41.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[22670]: cluster 2024-09-17T09:08:39.207035+0000 mgr.y (mgr.14532) 651 : cluster [DBG] pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[22670]: audit 2024-09-17T09:08:40.061352+0000 mgr.y (mgr.14532) 652 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[22670]: audit 2024-09-17T09:08:40.088941+0000 mon.a (mon.0) 3549 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-17T09:08:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:41 smithi078 bash[22670]: cluster 2024-09-17T09:08:40.089156+0000 mon.a (mon.0) 3550 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2024-09-17T09:08:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:41 smithi136 bash[24812]: cluster 2024-09-17T09:08:39.207035+0000 mgr.y (mgr.14532) 651 : cluster [DBG] pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:41 smithi136 bash[24812]: audit 2024-09-17T09:08:40.061352+0000 mgr.y (mgr.14532) 652 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:41 smithi136 bash[24812]: audit 2024-09-17T09:08:40.088941+0000 mon.a (mon.0) 3549 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-17T09:08:41.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:41 smithi136 bash[24812]: cluster 2024-09-17T09:08:40.089156+0000 mon.a (mon.0) 3550 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2024-09-17T09:08:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:42 smithi078 bash[32124]: audit 2024-09-17T09:08:41.664204+0000 mon.a (mon.0) 3551 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:42 smithi078 bash[22670]: audit 2024-09-17T09:08:41.664204+0000 mon.a (mon.0) 3551 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:42.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:42 smithi136 bash[24812]: audit 2024-09-17T09:08:41.664204+0000 mon.a (mon.0) 3551 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:43.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:43 smithi078 bash[22670]: cluster 2024-09-17T09:08:41.207749+0000 mgr.y (mgr.14532) 653 : cluster [DBG] pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:43 smithi078 bash[32124]: cluster 2024-09-17T09:08:41.207749+0000 mgr.y (mgr.14532) 653 : cluster [DBG] pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:43.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:43 smithi136 bash[24812]: cluster 2024-09-17T09:08:41.207749+0000 mgr.y (mgr.14532) 653 : cluster [DBG] pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:08:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:45 smithi078 bash[22670]: cluster 2024-09-17T09:08:43.209757+0000 mgr.y (mgr.14532) 654 : cluster [DBG] pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2024-09-17T09:08:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:45 smithi078 bash[32124]: cluster 2024-09-17T09:08:43.209757+0000 mgr.y (mgr.14532) 654 : cluster [DBG] pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2024-09-17T09:08:45.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:45 smithi136 bash[24812]: cluster 2024-09-17T09:08:43.209757+0000 mgr.y (mgr.14532) 654 : cluster [DBG] pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2024-09-17T09:08:47.540 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:08:47 smithi136 bash[52309]: logger=sqlstore.transactions t=2024-09-17T09:08:47.200870272Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-17T09:08:47.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:47 smithi136 bash[24812]: cluster 2024-09-17T09:08:45.210481+0000 mgr.y (mgr.14532) 655 : cluster [DBG] pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 717 B/s rd, 3.4 KiB/s wr, 1 op/s 2024-09-17T09:08:47.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:47 smithi078 bash[22670]: cluster 2024-09-17T09:08:45.210481+0000 mgr.y (mgr.14532) 655 : cluster [DBG] pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 717 B/s rd, 3.4 KiB/s wr, 1 op/s 2024-09-17T09:08:47.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:47 smithi078 bash[32124]: cluster 2024-09-17T09:08:45.210481+0000 mgr.y (mgr.14532) 655 : cluster [DBG] pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 717 B/s rd, 3.4 KiB/s wr, 1 op/s 2024-09-17T09:08:48.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:08:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:08:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:08:49.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:49 smithi136 bash[24812]: cluster 2024-09-17T09:08:47.211221+0000 mgr.y (mgr.14532) 656 : cluster [DBG] pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-09-17T09:08:49.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:49 smithi078 bash[22670]: cluster 2024-09-17T09:08:47.211221+0000 mgr.y (mgr.14532) 656 : cluster [DBG] pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-09-17T09:08:49.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:49 smithi078 bash[32124]: cluster 2024-09-17T09:08:47.211221+0000 mgr.y (mgr.14532) 656 : cluster [DBG] pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-09-17T09:08:50.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:08:50 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:08:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:51 smithi136 bash[24812]: cluster 2024-09-17T09:08:49.213224+0000 mgr.y (mgr.14532) 657 : cluster [DBG] pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.6 KiB/s wr, 1 op/s 2024-09-17T09:08:51.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:51 smithi136 bash[24812]: audit 2024-09-17T09:08:50.072792+0000 mgr.y (mgr.14532) 658 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:51 smithi078 bash[32124]: cluster 2024-09-17T09:08:49.213224+0000 mgr.y (mgr.14532) 657 : cluster [DBG] pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.6 KiB/s wr, 1 op/s 2024-09-17T09:08:51.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:51 smithi078 bash[32124]: audit 2024-09-17T09:08:50.072792+0000 mgr.y (mgr.14532) 658 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:51.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:51 smithi078 bash[22670]: cluster 2024-09-17T09:08:49.213224+0000 mgr.y (mgr.14532) 657 : cluster [DBG] pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.6 KiB/s wr, 1 op/s 2024-09-17T09:08:51.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:51 smithi078 bash[22670]: audit 2024-09-17T09:08:50.072792+0000 mgr.y (mgr.14532) 658 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:08:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:53 smithi136 bash[24812]: cluster 2024-09-17T09:08:51.214025+0000 mgr.y (mgr.14532) 659 : cluster [DBG] pgmap v1116: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 5.9 KiB/s wr, 1 op/s 2024-09-17T09:08:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:53 smithi136 bash[24812]: audit 2024-09-17T09:08:52.179807+0000 mon.a (mon.0) 3552 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:53.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:53 smithi136 bash[24812]: audit 2024-09-17T09:08:52.180633+0000 mon.a (mon.0) 3553 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140"}]: dispatch 2024-09-17T09:08:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:53 smithi078 bash[32124]: cluster 2024-09-17T09:08:51.214025+0000 mgr.y (mgr.14532) 659 : cluster [DBG] pgmap v1116: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 5.9 KiB/s wr, 1 op/s 2024-09-17T09:08:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:53 smithi078 bash[32124]: audit 2024-09-17T09:08:52.179807+0000 mon.a (mon.0) 3552 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:53.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:53 smithi078 bash[32124]: audit 2024-09-17T09:08:52.180633+0000 mon.a (mon.0) 3553 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140"}]: dispatch 2024-09-17T09:08:53.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:53 smithi078 bash[22670]: cluster 2024-09-17T09:08:51.214025+0000 mgr.y (mgr.14532) 659 : cluster [DBG] pgmap v1116: 204 pgs: 204 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 5.9 KiB/s wr, 1 op/s 2024-09-17T09:08:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:53 smithi078 bash[22670]: audit 2024-09-17T09:08:52.179807+0000 mon.a (mon.0) 3552 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:08:53.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:53 smithi078 bash[22670]: audit 2024-09-17T09:08:52.180633+0000 mon.a (mon.0) 3553 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140"}]: dispatch 2024-09-17T09:08:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:54 smithi136 bash[24812]: audit 2024-09-17T09:08:53.125635+0000 mon.a (mon.0) 3554 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140"}]': finished 2024-09-17T09:08:54.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:54 smithi136 bash[24812]: cluster 2024-09-17T09:08:53.126255+0000 mon.a (mon.0) 3555 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2024-09-17T09:08:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:54 smithi078 bash[32124]: audit 2024-09-17T09:08:53.125635+0000 mon.a (mon.0) 3554 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140"}]': finished 2024-09-17T09:08:54.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:54 smithi078 bash[32124]: cluster 2024-09-17T09:08:53.126255+0000 mon.a (mon.0) 3555 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2024-09-17T09:08:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:54 smithi078 bash[22670]: audit 2024-09-17T09:08:53.125635+0000 mon.a (mon.0) 3554 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-140"}]': finished 2024-09-17T09:08:54.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:54 smithi078 bash[22670]: cluster 2024-09-17T09:08:53.126255+0000 mon.a (mon.0) 3555 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2024-09-17T09:08:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:55 smithi136 bash[24812]: cluster 2024-09-17T09:08:53.214820+0000 mgr.y (mgr.14532) 660 : cluster [DBG] pgmap v1118: 204 pgs: 204 active+clean; 4.5 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 2 op/s 2024-09-17T09:08:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:55 smithi136 bash[24812]: cluster 2024-09-17T09:08:54.129930+0000 mon.a (mon.0) 3556 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:55.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:55 smithi136 bash[24812]: cluster 2024-09-17T09:08:54.147607+0000 mon.a (mon.0) 3557 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2024-09-17T09:08:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:55 smithi078 bash[32124]: cluster 2024-09-17T09:08:53.214820+0000 mgr.y (mgr.14532) 660 : cluster [DBG] pgmap v1118: 204 pgs: 204 active+clean; 4.5 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 2 op/s 2024-09-17T09:08:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:55 smithi078 bash[32124]: cluster 2024-09-17T09:08:54.129930+0000 mon.a (mon.0) 3556 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:55.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:55 smithi078 bash[32124]: cluster 2024-09-17T09:08:54.147607+0000 mon.a (mon.0) 3557 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2024-09-17T09:08:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:55 smithi078 bash[22670]: cluster 2024-09-17T09:08:53.214820+0000 mgr.y (mgr.14532) 660 : cluster [DBG] pgmap v1118: 204 pgs: 204 active+clean; 4.5 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 2 op/s 2024-09-17T09:08:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:55 smithi078 bash[22670]: cluster 2024-09-17T09:08:54.129930+0000 mon.a (mon.0) 3556 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:08:55.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:55 smithi078 bash[22670]: cluster 2024-09-17T09:08:54.147607+0000 mon.a (mon.0) 3557 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2024-09-17T09:08:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:56 smithi136 bash[24812]: cluster 2024-09-17T09:08:55.161944+0000 mon.a (mon.0) 3558 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2024-09-17T09:08:56.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:56 smithi136 bash[24812]: audit 2024-09-17T09:08:55.174323+0000 mon.a (mon.0) 3559 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:56 smithi078 bash[32124]: cluster 2024-09-17T09:08:55.161944+0000 mon.a (mon.0) 3558 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2024-09-17T09:08:56.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:56 smithi078 bash[32124]: audit 2024-09-17T09:08:55.174323+0000 mon.a (mon.0) 3559 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:56 smithi078 bash[22670]: cluster 2024-09-17T09:08:55.161944+0000 mon.a (mon.0) 3558 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2024-09-17T09:08:56.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:56 smithi078 bash[22670]: audit 2024-09-17T09:08:55.174323+0000 mon.a (mon.0) 3559 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:08:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:57 smithi136 bash[24812]: cluster 2024-09-17T09:08:55.215566+0000 mgr.y (mgr.14532) 661 : cluster [DBG] pgmap v1121: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:08:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:57 smithi136 bash[24812]: audit 2024-09-17T09:08:56.172450+0000 mon.a (mon.0) 3560 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:57.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:57 smithi136 bash[24812]: cluster 2024-09-17T09:08:56.172848+0000 mon.a (mon.0) 3561 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2024-09-17T09:08:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:57 smithi136 bash[24812]: audit 2024-09-17T09:08:56.267761+0000 mon.a (mon.0) 3562 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:57.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:57 smithi136 bash[24812]: audit 2024-09-17T09:08:56.693778+0000 mon.a (mon.0) 3563 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[22670]: cluster 2024-09-17T09:08:55.215566+0000 mgr.y (mgr.14532) 661 : cluster [DBG] pgmap v1121: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:08:57.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[22670]: audit 2024-09-17T09:08:56.172450+0000 mon.a (mon.0) 3560 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[22670]: cluster 2024-09-17T09:08:56.172848+0000 mon.a (mon.0) 3561 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[22670]: audit 2024-09-17T09:08:56.267761+0000 mon.a (mon.0) 3562 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[22670]: audit 2024-09-17T09:08:56.693778+0000 mon.a (mon.0) 3563 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[32124]: cluster 2024-09-17T09:08:55.215566+0000 mgr.y (mgr.14532) 661 : cluster [DBG] pgmap v1121: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[32124]: audit 2024-09-17T09:08:56.172450+0000 mon.a (mon.0) 3560 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[32124]: cluster 2024-09-17T09:08:56.172848+0000 mon.a (mon.0) 3561 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[32124]: audit 2024-09-17T09:08:56.267761+0000 mon.a (mon.0) 3562 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:08:57.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[32124]: audit 2024-09-17T09:08:56.693778+0000 mon.a (mon.0) 3563 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:08:58.184 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:08:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:08:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:08:58.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:58 smithi136 bash[24812]: audit 2024-09-17T09:08:57.182868+0000 mon.a (mon.0) 3564 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:58.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:58 smithi136 bash[24812]: cluster 2024-09-17T09:08:57.183036+0000 mon.a (mon.0) 3565 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2024-09-17T09:08:58.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:58 smithi136 bash[24812]: audit 2024-09-17T09:08:57.185501+0000 mon.a (mon.0) 3566 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:08:58.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:58 smithi078 bash[22670]: audit 2024-09-17T09:08:57.182868+0000 mon.a (mon.0) 3564 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:58.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:58 smithi078 bash[22670]: cluster 2024-09-17T09:08:57.183036+0000 mon.a (mon.0) 3565 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2024-09-17T09:08:58.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:58 smithi078 bash[22670]: audit 2024-09-17T09:08:57.185501+0000 mon.a (mon.0) 3566 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:08:58.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:58 smithi078 bash[32124]: audit 2024-09-17T09:08:57.182868+0000 mon.a (mon.0) 3564 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:08:58.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:58 smithi078 bash[32124]: cluster 2024-09-17T09:08:57.183036+0000 mon.a (mon.0) 3565 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2024-09-17T09:08:58.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:58 smithi078 bash[32124]: audit 2024-09-17T09:08:57.185501+0000 mon.a (mon.0) 3566 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:08:59.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:59 smithi136 bash[24812]: cluster 2024-09-17T09:08:57.216353+0000 mgr.y (mgr.14532) 662 : cluster [DBG] pgmap v1124: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:59.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:59 smithi136 bash[24812]: audit 2024-09-17T09:08:58.192999+0000 mon.a (mon.0) 3567 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-142"}]': finished 2024-09-17T09:08:59.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:59 smithi136 bash[24812]: cluster 2024-09-17T09:08:58.193183+0000 mon.a (mon.0) 3568 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2024-09-17T09:08:59.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:08:59 smithi136 bash[24812]: audit 2024-09-17T09:08:58.194657+0000 mon.a (mon.0) 3569 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-142", "mode": "writeback"}]: dispatch 2024-09-17T09:08:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[22670]: cluster 2024-09-17T09:08:57.216353+0000 mgr.y (mgr.14532) 662 : cluster [DBG] pgmap v1124: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[22670]: audit 2024-09-17T09:08:58.192999+0000 mon.a (mon.0) 3567 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-142"}]': finished 2024-09-17T09:08:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[22670]: cluster 2024-09-17T09:08:58.193183+0000 mon.a (mon.0) 3568 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2024-09-17T09:08:59.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[22670]: audit 2024-09-17T09:08:58.194657+0000 mon.a (mon.0) 3569 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-142", "mode": "writeback"}]: dispatch 2024-09-17T09:08:59.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[32124]: cluster 2024-09-17T09:08:57.216353+0000 mgr.y (mgr.14532) 662 : cluster [DBG] pgmap v1124: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:08:59.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[32124]: audit 2024-09-17T09:08:58.192999+0000 mon.a (mon.0) 3567 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-142"}]': finished 2024-09-17T09:08:59.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[32124]: cluster 2024-09-17T09:08:58.193183+0000 mon.a (mon.0) 3568 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2024-09-17T09:08:59.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:08:59 smithi078 bash[32124]: audit 2024-09-17T09:08:58.194657+0000 mon.a (mon.0) 3569 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-142", "mode": "writeback"}]: dispatch 2024-09-17T09:09:00.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:09:00 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:09:00.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:00 smithi136 bash[24812]: cluster 2024-09-17T09:08:59.186163+0000 mon.a (mon.0) 3570 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:00.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:00 smithi136 bash[24812]: audit 2024-09-17T09:08:59.202174+0000 mon.a (mon.0) 3571 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-142", "mode": "writeback"}]': finished 2024-09-17T09:09:00.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:00 smithi136 bash[24812]: cluster 2024-09-17T09:08:59.202421+0000 mon.a (mon.0) 3572 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2024-09-17T09:09:00.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:00 smithi136 bash[24812]: audit 2024-09-17T09:08:59.204497+0000 mon.a (mon.0) 3573 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:09:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[22670]: cluster 2024-09-17T09:08:59.186163+0000 mon.a (mon.0) 3570 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[22670]: audit 2024-09-17T09:08:59.202174+0000 mon.a (mon.0) 3571 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-142", "mode": "writeback"}]': finished 2024-09-17T09:09:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[22670]: cluster 2024-09-17T09:08:59.202421+0000 mon.a (mon.0) 3572 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2024-09-17T09:09:00.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[22670]: audit 2024-09-17T09:08:59.204497+0000 mon.a (mon.0) 3573 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:09:00.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[32124]: cluster 2024-09-17T09:08:59.186163+0000 mon.a (mon.0) 3570 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:00.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[32124]: audit 2024-09-17T09:08:59.202174+0000 mon.a (mon.0) 3571 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-142", "mode": "writeback"}]': finished 2024-09-17T09:09:00.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[32124]: cluster 2024-09-17T09:08:59.202421+0000 mon.a (mon.0) 3572 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2024-09-17T09:09:00.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:00 smithi078 bash[32124]: audit 2024-09-17T09:08:59.204497+0000 mon.a (mon.0) 3573 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:09:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:01 smithi136 bash[24812]: cluster 2024-09-17T09:08:59.217244+0000 mgr.y (mgr.14532) 663 : cluster [DBG] pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:09:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:01 smithi136 bash[24812]: audit 2024-09-17T09:09:00.082799+0000 mgr.y (mgr.14532) 664 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:01 smithi136 bash[24812]: audit 2024-09-17T09:09:00.214306+0000 mon.a (mon.0) 3574 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:09:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:01 smithi136 bash[24812]: cluster 2024-09-17T09:09:00.214421+0000 mon.a (mon.0) 3575 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2024-09-17T09:09:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:01 smithi136 bash[24812]: audit 2024-09-17T09:09:00.215877+0000 mon.a (mon.0) 3576 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:09:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[22670]: cluster 2024-09-17T09:08:59.217244+0000 mgr.y (mgr.14532) 663 : cluster [DBG] pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:09:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[22670]: audit 2024-09-17T09:09:00.082799+0000 mgr.y (mgr.14532) 664 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[22670]: audit 2024-09-17T09:09:00.214306+0000 mon.a (mon.0) 3574 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:09:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[22670]: cluster 2024-09-17T09:09:00.214421+0000 mon.a (mon.0) 3575 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2024-09-17T09:09:01.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[22670]: audit 2024-09-17T09:09:00.215877+0000 mon.a (mon.0) 3576 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:09:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[32124]: cluster 2024-09-17T09:08:59.217244+0000 mgr.y (mgr.14532) 663 : cluster [DBG] pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:09:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[32124]: audit 2024-09-17T09:09:00.082799+0000 mgr.y (mgr.14532) 664 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[32124]: audit 2024-09-17T09:09:00.214306+0000 mon.a (mon.0) 3574 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:09:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[32124]: cluster 2024-09-17T09:09:00.214421+0000 mon.a (mon.0) 3575 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2024-09-17T09:09:01.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:01 smithi078 bash[32124]: audit 2024-09-17T09:09:00.215877+0000 mon.a (mon.0) 3576 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:09:02.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:02 smithi136 bash[24812]: audit 2024-09-17T09:09:01.215090+0000 mon.a (mon.0) 3577 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:09:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:02 smithi136 bash[24812]: cluster 2024-09-17T09:09:01.215425+0000 mon.a (mon.0) 3578 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2024-09-17T09:09:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:02 smithi136 bash[24812]: cluster 2024-09-17T09:09:01.218504+0000 mgr.y (mgr.14532) 665 : cluster [DBG] pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:09:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:02 smithi136 bash[24812]: audit 2024-09-17T09:09:01.219325+0000 mon.a (mon.0) 3579 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:09:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[22670]: audit 2024-09-17T09:09:01.215090+0000 mon.a (mon.0) 3577 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:09:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[22670]: cluster 2024-09-17T09:09:01.215425+0000 mon.a (mon.0) 3578 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2024-09-17T09:09:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[22670]: cluster 2024-09-17T09:09:01.218504+0000 mgr.y (mgr.14532) 665 : cluster [DBG] pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:09:02.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[22670]: audit 2024-09-17T09:09:01.219325+0000 mon.a (mon.0) 3579 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:09:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[32124]: audit 2024-09-17T09:09:01.215090+0000 mon.a (mon.0) 3577 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:09:02.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[32124]: cluster 2024-09-17T09:09:01.215425+0000 mon.a (mon.0) 3578 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2024-09-17T09:09:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[32124]: cluster 2024-09-17T09:09:01.218504+0000 mgr.y (mgr.14532) 665 : cluster [DBG] pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-17T09:09:02.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:02 smithi078 bash[32124]: audit 2024-09-17T09:09:01.219325+0000 mon.a (mon.0) 3579 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:09:03.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:03 smithi136 bash[24812]: cluster 2024-09-17T09:09:02.208429+0000 mon.a (mon.0) 3580 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:03.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:03 smithi136 bash[24812]: audit 2024-09-17T09:09:02.227301+0000 mon.a (mon.0) 3581 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:09:03.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:03 smithi136 bash[24812]: cluster 2024-09-17T09:09:02.227586+0000 mon.a (mon.0) 3582 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2024-09-17T09:09:03.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:03 smithi136 bash[24812]: audit 2024-09-17T09:09:02.228896+0000 mon.a (mon.0) 3583 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:09:03.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:03 smithi136 bash[24812]: cluster 2024-09-17T09:09:02.879072+0000 mon.a (mon.0) 3584 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:09:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[32124]: cluster 2024-09-17T09:09:02.208429+0000 mon.a (mon.0) 3580 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[32124]: audit 2024-09-17T09:09:02.227301+0000 mon.a (mon.0) 3581 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:09:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[32124]: cluster 2024-09-17T09:09:02.227586+0000 mon.a (mon.0) 3582 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2024-09-17T09:09:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[32124]: audit 2024-09-17T09:09:02.228896+0000 mon.a (mon.0) 3583 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:09:03.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[32124]: cluster 2024-09-17T09:09:02.879072+0000 mon.a (mon.0) 3584 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:09:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[22670]: cluster 2024-09-17T09:09:02.208429+0000 mon.a (mon.0) 3580 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:03.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[22670]: audit 2024-09-17T09:09:02.227301+0000 mon.a (mon.0) 3581 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:09:03.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[22670]: cluster 2024-09-17T09:09:02.227586+0000 mon.a (mon.0) 3582 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2024-09-17T09:09:03.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[22670]: audit 2024-09-17T09:09:02.228896+0000 mon.a (mon.0) 3583 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:09:03.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:03 smithi078 bash[22670]: cluster 2024-09-17T09:09:02.879072+0000 mon.a (mon.0) 3584 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:09:04.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:04 smithi136 bash[24812]: cluster 2024-09-17T09:09:03.221261+0000 mgr.y (mgr.14532) 666 : cluster [DBG] pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:04.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:04 smithi136 bash[24812]: audit 2024-09-17T09:09:03.226971+0000 mon.a (mon.0) 3585 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:09:04.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:04 smithi136 bash[24812]: cluster 2024-09-17T09:09:03.227140+0000 mon.a (mon.0) 3586 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2024-09-17T09:09:04.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:04 smithi136 bash[24812]: audit 2024-09-17T09:09:03.232416+0000 mon.a (mon.0) 3587 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-17T09:09:04.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:04 smithi136 bash[24812]: audit 2024-09-17T09:09:04.229002+0000 mon.a (mon.0) 3588 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-17T09:09:04.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:04 smithi136 bash[24812]: cluster 2024-09-17T09:09:04.229181+0000 mon.a (mon.0) 3589 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2024-09-17T09:09:04.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:04 smithi136 bash[24812]: audit 2024-09-17T09:09:04.232600+0000 mon.a (mon.0) 3590 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-17T09:09:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[22670]: cluster 2024-09-17T09:09:03.221261+0000 mgr.y (mgr.14532) 666 : cluster [DBG] pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[22670]: audit 2024-09-17T09:09:03.226971+0000 mon.a (mon.0) 3585 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:09:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[22670]: cluster 2024-09-17T09:09:03.227140+0000 mon.a (mon.0) 3586 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2024-09-17T09:09:04.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[22670]: audit 2024-09-17T09:09:03.232416+0000 mon.a (mon.0) 3587 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[22670]: audit 2024-09-17T09:09:04.229002+0000 mon.a (mon.0) 3588 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[22670]: cluster 2024-09-17T09:09:04.229181+0000 mon.a (mon.0) 3589 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[22670]: audit 2024-09-17T09:09:04.232600+0000 mon.a (mon.0) 3590 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[32124]: cluster 2024-09-17T09:09:03.221261+0000 mgr.y (mgr.14532) 666 : cluster [DBG] pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[32124]: audit 2024-09-17T09:09:03.226971+0000 mon.a (mon.0) 3585 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[32124]: cluster 2024-09-17T09:09:03.227140+0000 mon.a (mon.0) 3586 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[32124]: audit 2024-09-17T09:09:03.232416+0000 mon.a (mon.0) 3587 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[32124]: audit 2024-09-17T09:09:04.229002+0000 mon.a (mon.0) 3588 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[32124]: cluster 2024-09-17T09:09:04.229181+0000 mon.a (mon.0) 3589 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2024-09-17T09:09:04.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:04 smithi078 bash[32124]: audit 2024-09-17T09:09:04.232600+0000 mon.a (mon.0) 3590 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-17T09:09:06.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:06 smithi136 bash[24812]: cluster 2024-09-17T09:09:05.222255+0000 mgr.y (mgr.14532) 667 : cluster [DBG] pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:06 smithi136 bash[24812]: audit 2024-09-17T09:09:05.231836+0000 mon.a (mon.0) 3591 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-17T09:09:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:06 smithi136 bash[24812]: cluster 2024-09-17T09:09:05.232024+0000 mon.a (mon.0) 3592 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2024-09-17T09:09:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:06 smithi136 bash[24812]: audit 2024-09-17T09:09:05.323143+0000 mon.a (mon.0) 3593 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[32124]: cluster 2024-09-17T09:09:05.222255+0000 mgr.y (mgr.14532) 667 : cluster [DBG] pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[32124]: audit 2024-09-17T09:09:05.231836+0000 mon.a (mon.0) 3591 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-17T09:09:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[32124]: cluster 2024-09-17T09:09:05.232024+0000 mon.a (mon.0) 3592 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2024-09-17T09:09:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[32124]: audit 2024-09-17T09:09:05.323143+0000 mon.a (mon.0) 3593 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:06.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[22670]: cluster 2024-09-17T09:09:05.222255+0000 mgr.y (mgr.14532) 667 : cluster [DBG] pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:06.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[22670]: audit 2024-09-17T09:09:05.231836+0000 mon.a (mon.0) 3591 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-17T09:09:06.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[22670]: cluster 2024-09-17T09:09:05.232024+0000 mon.a (mon.0) 3592 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2024-09-17T09:09:06.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:06 smithi078 bash[22670]: audit 2024-09-17T09:09:05.323143+0000 mon.a (mon.0) 3593 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:07.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:07 smithi136 bash[24812]: audit 2024-09-17T09:09:06.255732+0000 mon.a (mon.0) 3594 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:07 smithi136 bash[24812]: cluster 2024-09-17T09:09:06.256024+0000 mon.a (mon.0) 3595 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2024-09-17T09:09:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:07 smithi136 bash[24812]: audit 2024-09-17T09:09:06.257224+0000 mon.a (mon.0) 3596 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:09:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:07 smithi078 bash[32124]: audit 2024-09-17T09:09:06.255732+0000 mon.a (mon.0) 3594 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:07 smithi078 bash[32124]: cluster 2024-09-17T09:09:06.256024+0000 mon.a (mon.0) 3595 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2024-09-17T09:09:07.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:07 smithi078 bash[32124]: audit 2024-09-17T09:09:06.257224+0000 mon.a (mon.0) 3596 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:09:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:07 smithi078 bash[22670]: audit 2024-09-17T09:09:06.255732+0000 mon.a (mon.0) 3594 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:07 smithi078 bash[22670]: cluster 2024-09-17T09:09:06.256024+0000 mon.a (mon.0) 3595 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2024-09-17T09:09:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:07 smithi078 bash[22670]: audit 2024-09-17T09:09:06.257224+0000 mon.a (mon.0) 3596 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:09:08.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:09:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:09:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:09:09.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:08 smithi136 bash[24812]: cluster 2024-09-17T09:09:07.223038+0000 mgr.y (mgr.14532) 668 : cluster [DBG] pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:08 smithi136 bash[24812]: audit 2024-09-17T09:09:07.266181+0000 mon.a (mon.0) 3597 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]': finished 2024-09-17T09:09:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:08 smithi136 bash[24812]: cluster 2024-09-17T09:09:07.266407+0000 mon.a (mon.0) 3598 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2024-09-17T09:09:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:08 smithi136 bash[24812]: audit 2024-09-17T09:09:07.326096+0000 mon.a (mon.0) 3599 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:09.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:08 smithi136 bash[24812]: audit 2024-09-17T09:09:07.326973+0000 mon.a (mon.0) 3600 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:09:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[22670]: cluster 2024-09-17T09:09:07.223038+0000 mgr.y (mgr.14532) 668 : cluster [DBG] pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[22670]: audit 2024-09-17T09:09:07.266181+0000 mon.a (mon.0) 3597 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]': finished 2024-09-17T09:09:09.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[22670]: cluster 2024-09-17T09:09:07.266407+0000 mon.a (mon.0) 3598 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2024-09-17T09:09:09.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[22670]: audit 2024-09-17T09:09:07.326096+0000 mon.a (mon.0) 3599 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:09.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[22670]: audit 2024-09-17T09:09:07.326973+0000 mon.a (mon.0) 3600 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:09:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[32124]: cluster 2024-09-17T09:09:07.223038+0000 mgr.y (mgr.14532) 668 : cluster [DBG] pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[32124]: audit 2024-09-17T09:09:07.266181+0000 mon.a (mon.0) 3597 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]': finished 2024-09-17T09:09:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[32124]: cluster 2024-09-17T09:09:07.266407+0000 mon.a (mon.0) 3598 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2024-09-17T09:09:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[32124]: audit 2024-09-17T09:09:07.326096+0000 mon.a (mon.0) 3599 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:09.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:08 smithi078 bash[32124]: audit 2024-09-17T09:09:07.326973+0000 mon.a (mon.0) 3600 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-142"}]: dispatch 2024-09-17T09:09:10.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:09 smithi136 bash[24812]: cluster 2024-09-17T09:09:08.269081+0000 mon.a (mon.0) 3601 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2024-09-17T09:09:10.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:09 smithi136 bash[24812]: cluster 2024-09-17T09:09:09.272605+0000 mon.a (mon.0) 3602 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2024-09-17T09:09:10.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:09 smithi136 bash[24812]: audit 2024-09-17T09:09:09.277624+0000 mon.a (mon.0) 3603 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:09 smithi078 bash[22670]: cluster 2024-09-17T09:09:08.269081+0000 mon.a (mon.0) 3601 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2024-09-17T09:09:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:09 smithi078 bash[22670]: cluster 2024-09-17T09:09:09.272605+0000 mon.a (mon.0) 3602 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2024-09-17T09:09:10.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:09 smithi078 bash[22670]: audit 2024-09-17T09:09:09.277624+0000 mon.a (mon.0) 3603 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:10.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:09 smithi078 bash[32124]: cluster 2024-09-17T09:09:08.269081+0000 mon.a (mon.0) 3601 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2024-09-17T09:09:10.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:09 smithi078 bash[32124]: cluster 2024-09-17T09:09:09.272605+0000 mon.a (mon.0) 3602 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2024-09-17T09:09:10.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:09 smithi078 bash[32124]: audit 2024-09-17T09:09:09.277624+0000 mon.a (mon.0) 3603 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:10.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:09:10 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:09:11.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:10 smithi136 bash[24812]: cluster 2024-09-17T09:09:09.223840+0000 mgr.y (mgr.14532) 669 : cluster [DBG] pgmap v1141: 172 pgs: 172 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:09:11.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:10 smithi136 bash[24812]: audit 2024-09-17T09:09:10.093570+0000 mgr.y (mgr.14532) 670 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:11.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:10 smithi136 bash[24812]: audit 2024-09-17T09:09:10.274635+0000 mon.a (mon.0) 3604 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:11.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:10 smithi136 bash[24812]: cluster 2024-09-17T09:09:10.275057+0000 mon.a (mon.0) 3605 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2024-09-17T09:09:11.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:10 smithi136 bash[24812]: audit 2024-09-17T09:09:10.325518+0000 mon.a (mon.0) 3606 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[22670]: cluster 2024-09-17T09:09:09.223840+0000 mgr.y (mgr.14532) 669 : cluster [DBG] pgmap v1141: 172 pgs: 172 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:09:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[22670]: audit 2024-09-17T09:09:10.093570+0000 mgr.y (mgr.14532) 670 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[22670]: audit 2024-09-17T09:09:10.274635+0000 mon.a (mon.0) 3604 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[22670]: cluster 2024-09-17T09:09:10.275057+0000 mon.a (mon.0) 3605 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2024-09-17T09:09:11.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[22670]: audit 2024-09-17T09:09:10.325518+0000 mon.a (mon.0) 3606 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[32124]: cluster 2024-09-17T09:09:09.223840+0000 mgr.y (mgr.14532) 669 : cluster [DBG] pgmap v1141: 172 pgs: 172 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:09:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[32124]: audit 2024-09-17T09:09:10.093570+0000 mgr.y (mgr.14532) 670 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[32124]: audit 2024-09-17T09:09:10.274635+0000 mon.a (mon.0) 3604 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[32124]: cluster 2024-09-17T09:09:10.275057+0000 mon.a (mon.0) 3605 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2024-09-17T09:09:11.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:10 smithi078 bash[32124]: audit 2024-09-17T09:09:10.325518+0000 mon.a (mon.0) 3606 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:12.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:12 smithi136 bash[24812]: cluster 2024-09-17T09:09:11.224618+0000 mgr.y (mgr.14532) 671 : cluster [DBG] pgmap v1144: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:09:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:12 smithi136 bash[24812]: audit 2024-09-17T09:09:11.278440+0000 mon.a (mon.0) 3607 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:12 smithi136 bash[24812]: cluster 2024-09-17T09:09:11.278643+0000 mon.a (mon.0) 3608 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2024-09-17T09:09:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:12 smithi136 bash[24812]: audit 2024-09-17T09:09:11.279976+0000 mon.a (mon.0) 3609 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:12 smithi136 bash[24812]: audit 2024-09-17T09:09:11.721991+0000 mon.a (mon.0) 3610 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[22670]: cluster 2024-09-17T09:09:11.224618+0000 mgr.y (mgr.14532) 671 : cluster [DBG] pgmap v1144: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:09:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[22670]: audit 2024-09-17T09:09:11.278440+0000 mon.a (mon.0) 3607 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[22670]: cluster 2024-09-17T09:09:11.278643+0000 mon.a (mon.0) 3608 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2024-09-17T09:09:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[22670]: audit 2024-09-17T09:09:11.279976+0000 mon.a (mon.0) 3609 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:12.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[22670]: audit 2024-09-17T09:09:11.721991+0000 mon.a (mon.0) 3610 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[32124]: cluster 2024-09-17T09:09:11.224618+0000 mgr.y (mgr.14532) 671 : cluster [DBG] pgmap v1144: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T09:09:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[32124]: audit 2024-09-17T09:09:11.278440+0000 mon.a (mon.0) 3607 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[32124]: cluster 2024-09-17T09:09:11.278643+0000 mon.a (mon.0) 3608 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2024-09-17T09:09:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[32124]: audit 2024-09-17T09:09:11.279976+0000 mon.a (mon.0) 3609 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:12 smithi078 bash[32124]: audit 2024-09-17T09:09:11.721991+0000 mon.a (mon.0) 3610 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[22670]: audit 2024-09-17T09:09:12.280222+0000 mon.a (mon.0) 3611 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-144"}]': finished 2024-09-17T09:09:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[22670]: cluster 2024-09-17T09:09:12.280429+0000 mon.a (mon.0) 3612 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2024-09-17T09:09:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[22670]: audit 2024-09-17T09:09:12.282833+0000 mon.a (mon.0) 3613 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-144", "mode": "readproxy"}]: dispatch 2024-09-17T09:09:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[22670]: cluster 2024-09-17T09:09:13.273666+0000 mon.a (mon.0) 3614 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:13.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[32124]: audit 2024-09-17T09:09:12.280222+0000 mon.a (mon.0) 3611 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-144"}]': finished 2024-09-17T09:09:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[32124]: cluster 2024-09-17T09:09:12.280429+0000 mon.a (mon.0) 3612 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2024-09-17T09:09:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[32124]: audit 2024-09-17T09:09:12.282833+0000 mon.a (mon.0) 3613 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-144", "mode": "readproxy"}]: dispatch 2024-09-17T09:09:13.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:13 smithi078 bash[32124]: cluster 2024-09-17T09:09:13.273666+0000 mon.a (mon.0) 3614 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:13.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:13 smithi136 bash[24812]: audit 2024-09-17T09:09:12.280222+0000 mon.a (mon.0) 3611 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-144"}]': finished 2024-09-17T09:09:13.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:13 smithi136 bash[24812]: cluster 2024-09-17T09:09:12.280429+0000 mon.a (mon.0) 3612 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2024-09-17T09:09:13.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:13 smithi136 bash[24812]: audit 2024-09-17T09:09:12.282833+0000 mon.a (mon.0) 3613 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-144", "mode": "readproxy"}]: dispatch 2024-09-17T09:09:13.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:13 smithi136 bash[24812]: cluster 2024-09-17T09:09:13.273666+0000 mon.a (mon.0) 3614 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:14.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:14 smithi078 bash[32124]: cluster 2024-09-17T09:09:13.226498+0000 mgr.y (mgr.14532) 672 : cluster [DBG] pgmap v1147: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:09:14.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:14 smithi078 bash[32124]: audit 2024-09-17T09:09:13.283376+0000 mon.a (mon.0) 3615 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-144", "mode": "readproxy"}]': finished 2024-09-17T09:09:14.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:14 smithi078 bash[32124]: cluster 2024-09-17T09:09:13.283598+0000 mon.a (mon.0) 3616 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2024-09-17T09:09:14.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:14 smithi078 bash[22670]: cluster 2024-09-17T09:09:13.226498+0000 mgr.y (mgr.14532) 672 : cluster [DBG] pgmap v1147: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:09:14.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:14 smithi078 bash[22670]: audit 2024-09-17T09:09:13.283376+0000 mon.a (mon.0) 3615 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-144", "mode": "readproxy"}]': finished 2024-09-17T09:09:14.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:14 smithi078 bash[22670]: cluster 2024-09-17T09:09:13.283598+0000 mon.a (mon.0) 3616 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2024-09-17T09:09:14.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:14 smithi136 bash[24812]: cluster 2024-09-17T09:09:13.226498+0000 mgr.y (mgr.14532) 672 : cluster [DBG] pgmap v1147: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T09:09:14.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:14 smithi136 bash[24812]: audit 2024-09-17T09:09:13.283376+0000 mon.a (mon.0) 3615 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-144", "mode": "readproxy"}]': finished 2024-09-17T09:09:14.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:14 smithi136 bash[24812]: cluster 2024-09-17T09:09:13.283598+0000 mon.a (mon.0) 3616 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2024-09-17T09:09:16.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:16 smithi078 bash[22670]: cluster 2024-09-17T09:09:15.227345+0000 mgr.y (mgr.14532) 673 : cluster [DBG] pgmap v1149: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 206 B/s wr, 1 op/s 2024-09-17T09:09:16.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:16 smithi078 bash[32124]: cluster 2024-09-17T09:09:15.227345+0000 mgr.y (mgr.14532) 673 : cluster [DBG] pgmap v1149: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 206 B/s wr, 1 op/s 2024-09-17T09:09:16.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:16 smithi136 bash[24812]: cluster 2024-09-17T09:09:15.227345+0000 mgr.y (mgr.14532) 673 : cluster [DBG] pgmap v1149: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 206 B/s wr, 1 op/s 2024-09-17T09:09:18.306 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:09:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:09:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:09:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:18 smithi078 bash[22670]: cluster 2024-09-17T09:09:17.228143+0000 mgr.y (mgr.14532) 674 : cluster [DBG] pgmap v1150: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 0 op/s 2024-09-17T09:09:18.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:18 smithi078 bash[32124]: cluster 2024-09-17T09:09:17.228143+0000 mgr.y (mgr.14532) 674 : cluster [DBG] pgmap v1150: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 0 op/s 2024-09-17T09:09:18.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:18 smithi136 bash[24812]: cluster 2024-09-17T09:09:17.228143+0000 mgr.y (mgr.14532) 674 : cluster [DBG] pgmap v1150: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 0 op/s 2024-09-17T09:09:20.540 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:09:20 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:09:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:20 smithi136 bash[24812]: cluster 2024-09-17T09:09:19.230123+0000 mgr.y (mgr.14532) 675 : cluster [DBG] pgmap v1151: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 128 B/s wr, 1 op/s 2024-09-17T09:09:20.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:20 smithi136 bash[24812]: audit 2024-09-17T09:09:20.097795+0000 mgr.y (mgr.14532) 676 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:20 smithi078 bash[32124]: cluster 2024-09-17T09:09:19.230123+0000 mgr.y (mgr.14532) 675 : cluster [DBG] pgmap v1151: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 128 B/s wr, 1 op/s 2024-09-17T09:09:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:20 smithi078 bash[32124]: audit 2024-09-17T09:09:20.097795+0000 mgr.y (mgr.14532) 676 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:20 smithi078 bash[22670]: cluster 2024-09-17T09:09:19.230123+0000 mgr.y (mgr.14532) 675 : cluster [DBG] pgmap v1151: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 128 B/s wr, 1 op/s 2024-09-17T09:09:20.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:20 smithi078 bash[22670]: audit 2024-09-17T09:09:20.097795+0000 mgr.y (mgr.14532) 676 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:22 smithi078 bash[32124]: cluster 2024-09-17T09:09:21.230952+0000 mgr.y (mgr.14532) 677 : cluster [DBG] pgmap v1152: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 114 B/s wr, 1 op/s 2024-09-17T09:09:22.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:22 smithi078 bash[22670]: cluster 2024-09-17T09:09:21.230952+0000 mgr.y (mgr.14532) 677 : cluster [DBG] pgmap v1152: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 114 B/s wr, 1 op/s 2024-09-17T09:09:22.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:22 smithi136 bash[24812]: cluster 2024-09-17T09:09:21.230952+0000 mgr.y (mgr.14532) 677 : cluster [DBG] pgmap v1152: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 114 B/s wr, 1 op/s 2024-09-17T09:09:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:24 smithi078 bash[22670]: cluster 2024-09-17T09:09:23.233023+0000 mgr.y (mgr.14532) 678 : cluster [DBG] pgmap v1153: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:09:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:24 smithi078 bash[22670]: audit 2024-09-17T09:09:23.575763+0000 mon.a (mon.0) 3617 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:24.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:24 smithi078 bash[32124]: cluster 2024-09-17T09:09:23.233023+0000 mgr.y (mgr.14532) 678 : cluster [DBG] pgmap v1153: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:09:24.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:24 smithi078 bash[32124]: audit 2024-09-17T09:09:23.575763+0000 mon.a (mon.0) 3617 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:24 smithi136 bash[24812]: cluster 2024-09-17T09:09:23.233023+0000 mgr.y (mgr.14532) 678 : cluster [DBG] pgmap v1153: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:09:24.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:24 smithi136 bash[24812]: audit 2024-09-17T09:09:23.575763+0000 mon.a (mon.0) 3617 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:25 smithi078 bash[22670]: audit 2024-09-17T09:09:24.335354+0000 mon.a (mon.0) 3618 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:25 smithi078 bash[22670]: cluster 2024-09-17T09:09:24.335522+0000 mon.a (mon.0) 3619 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2024-09-17T09:09:25.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:25 smithi078 bash[22670]: audit 2024-09-17T09:09:24.337599+0000 mon.a (mon.0) 3620 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:25.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:25 smithi078 bash[32124]: audit 2024-09-17T09:09:24.335354+0000 mon.a (mon.0) 3618 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:25 smithi078 bash[32124]: cluster 2024-09-17T09:09:24.335522+0000 mon.a (mon.0) 3619 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2024-09-17T09:09:25.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:25 smithi078 bash[32124]: audit 2024-09-17T09:09:24.337599+0000 mon.a (mon.0) 3620 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:25 smithi136 bash[24812]: audit 2024-09-17T09:09:24.335354+0000 mon.a (mon.0) 3618 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:25 smithi136 bash[24812]: cluster 2024-09-17T09:09:24.335522+0000 mon.a (mon.0) 3619 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2024-09-17T09:09:25.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:25 smithi136 bash[24812]: audit 2024-09-17T09:09:24.337599+0000 mon.a (mon.0) 3620 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:27.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[22670]: cluster 2024-09-17T09:09:25.233844+0000 mgr.y (mgr.14532) 679 : cluster [DBG] pgmap v1155: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:09:27.103 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[22670]: cluster 2024-09-17T09:09:25.329286+0000 mon.a (mon.0) 3621 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[22670]: audit 2024-09-17T09:09:25.344991+0000 mon.a (mon.0) 3622 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]': finished 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[22670]: cluster 2024-09-17T09:09:25.345689+0000 mon.a (mon.0) 3623 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[22670]: audit 2024-09-17T09:09:25.400361+0000 mon.a (mon.0) 3624 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[22670]: audit 2024-09-17T09:09:25.401207+0000 mon.a (mon.0) 3625 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[32124]: cluster 2024-09-17T09:09:25.233844+0000 mgr.y (mgr.14532) 679 : cluster [DBG] pgmap v1155: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[32124]: cluster 2024-09-17T09:09:25.329286+0000 mon.a (mon.0) 3621 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[32124]: audit 2024-09-17T09:09:25.344991+0000 mon.a (mon.0) 3622 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]': finished 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[32124]: cluster 2024-09-17T09:09:25.345689+0000 mon.a (mon.0) 3623 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[32124]: audit 2024-09-17T09:09:25.400361+0000 mon.a (mon.0) 3624 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:27.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:26 smithi078 bash[32124]: audit 2024-09-17T09:09:25.401207+0000 mon.a (mon.0) 3625 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:27.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:26 smithi136 bash[24812]: cluster 2024-09-17T09:09:25.233844+0000 mgr.y (mgr.14532) 679 : cluster [DBG] pgmap v1155: 204 pgs: 204 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:09:27.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:26 smithi136 bash[24812]: cluster 2024-09-17T09:09:25.329286+0000 mon.a (mon.0) 3621 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:27.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:26 smithi136 bash[24812]: audit 2024-09-17T09:09:25.344991+0000 mon.a (mon.0) 3622 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]': finished 2024-09-17T09:09:27.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:26 smithi136 bash[24812]: cluster 2024-09-17T09:09:25.345689+0000 mon.a (mon.0) 3623 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2024-09-17T09:09:27.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:26 smithi136 bash[24812]: audit 2024-09-17T09:09:25.400361+0000 mon.a (mon.0) 3624 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:27.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:26 smithi136 bash[24812]: audit 2024-09-17T09:09:25.401207+0000 mon.a (mon.0) 3625 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-144"}]: dispatch 2024-09-17T09:09:28.103 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:09:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:09:28.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[32124]: cluster 2024-09-17T09:09:26.346499+0000 mon.a (mon.0) 3626 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2024-09-17T09:09:28.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[32124]: audit 2024-09-17T09:09:26.794047+0000 mon.a (mon.0) 3627 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:28.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[32124]: cluster 2024-09-17T09:09:27.349562+0000 mon.a (mon.0) 3628 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2024-09-17T09:09:28.104 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[32124]: audit 2024-09-17T09:09:27.354698+0000 mon.a (mon.0) 3629 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:28.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[22670]: cluster 2024-09-17T09:09:26.346499+0000 mon.a (mon.0) 3626 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2024-09-17T09:09:28.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[22670]: audit 2024-09-17T09:09:26.794047+0000 mon.a (mon.0) 3627 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:28.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[22670]: cluster 2024-09-17T09:09:27.349562+0000 mon.a (mon.0) 3628 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2024-09-17T09:09:28.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:27 smithi078 bash[22670]: audit 2024-09-17T09:09:27.354698+0000 mon.a (mon.0) 3629 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:28.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:27 smithi136 bash[24812]: cluster 2024-09-17T09:09:26.346499+0000 mon.a (mon.0) 3626 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2024-09-17T09:09:28.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:27 smithi136 bash[24812]: audit 2024-09-17T09:09:26.794047+0000 mon.a (mon.0) 3627 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:28.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:27 smithi136 bash[24812]: cluster 2024-09-17T09:09:27.349562+0000 mon.a (mon.0) 3628 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2024-09-17T09:09:28.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:27 smithi136 bash[24812]: audit 2024-09-17T09:09:27.354698+0000 mon.a (mon.0) 3629 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[32124]: cluster 2024-09-17T09:09:27.234648+0000 mgr.y (mgr.14532) 680 : cluster [DBG] pgmap v1158: 172 pgs: 172 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:09:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[32124]: audit 2024-09-17T09:09:28.353314+0000 mon.a (mon.0) 3630 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[32124]: cluster 2024-09-17T09:09:28.353735+0000 mon.a (mon.0) 3631 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2024-09-17T09:09:29.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[32124]: audit 2024-09-17T09:09:28.409793+0000 mon.a (mon.0) 3632 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:29.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[22670]: cluster 2024-09-17T09:09:27.234648+0000 mgr.y (mgr.14532) 680 : cluster [DBG] pgmap v1158: 172 pgs: 172 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:09:29.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[22670]: audit 2024-09-17T09:09:28.353314+0000 mon.a (mon.0) 3630 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:29.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[22670]: cluster 2024-09-17T09:09:28.353735+0000 mon.a (mon.0) 3631 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2024-09-17T09:09:29.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:28 smithi078 bash[22670]: audit 2024-09-17T09:09:28.409793+0000 mon.a (mon.0) 3632 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:29.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:28 smithi136 bash[24812]: cluster 2024-09-17T09:09:27.234648+0000 mgr.y (mgr.14532) 680 : cluster [DBG] pgmap v1158: 172 pgs: 172 active+clean; 4.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:09:29.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:28 smithi136 bash[24812]: audit 2024-09-17T09:09:28.353314+0000 mon.a (mon.0) 3630 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:29.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:28 smithi136 bash[24812]: cluster 2024-09-17T09:09:28.353735+0000 mon.a (mon.0) 3631 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2024-09-17T09:09:29.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:28 smithi136 bash[24812]: audit 2024-09-17T09:09:28.409793+0000 mon.a (mon.0) 3632 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:30.369 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:09:30 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:09:30.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:30 smithi136 bash[24812]: cluster 2024-09-17T09:09:29.235477+0000 mgr.y (mgr.14532) 681 : cluster [DBG] pgmap v1161: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:30.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:30 smithi136 bash[24812]: audit 2024-09-17T09:09:29.356439+0000 mon.a (mon.0) 3633 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:30.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:30 smithi136 bash[24812]: cluster 2024-09-17T09:09:29.356622+0000 mon.a (mon.0) 3634 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2024-09-17T09:09:30.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:30 smithi136 bash[24812]: audit 2024-09-17T09:09:29.358307+0000 mon.a (mon.0) 3635 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:30.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:30 smithi136 bash[24812]: audit 2024-09-17T09:09:30.109391+0000 mgr.y (mgr.14532) 682 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:30.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[22670]: cluster 2024-09-17T09:09:29.235477+0000 mgr.y (mgr.14532) 681 : cluster [DBG] pgmap v1161: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:30.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[22670]: audit 2024-09-17T09:09:29.356439+0000 mon.a (mon.0) 3633 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:30.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[22670]: cluster 2024-09-17T09:09:29.356622+0000 mon.a (mon.0) 3634 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2024-09-17T09:09:30.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[22670]: audit 2024-09-17T09:09:29.358307+0000 mon.a (mon.0) 3635 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:30.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[22670]: audit 2024-09-17T09:09:30.109391+0000 mgr.y (mgr.14532) 682 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:30.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[32124]: cluster 2024-09-17T09:09:29.235477+0000 mgr.y (mgr.14532) 681 : cluster [DBG] pgmap v1161: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:30.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[32124]: audit 2024-09-17T09:09:29.356439+0000 mon.a (mon.0) 3633 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:30.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[32124]: cluster 2024-09-17T09:09:29.356622+0000 mon.a (mon.0) 3634 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2024-09-17T09:09:30.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[32124]: audit 2024-09-17T09:09:29.358307+0000 mon.a (mon.0) 3635 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:30.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:30 smithi078 bash[32124]: audit 2024-09-17T09:09:30.109391+0000 mgr.y (mgr.14532) 682 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:31.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:31 smithi136 bash[24812]: audit 2024-09-17T09:09:30.364799+0000 mon.a (mon.0) 3636 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-146"}]': finished 2024-09-17T09:09:31.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:31 smithi136 bash[24812]: cluster 2024-09-17T09:09:30.365052+0000 mon.a (mon.0) 3637 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2024-09-17T09:09:31.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:31 smithi136 bash[24812]: audit 2024-09-17T09:09:30.368593+0000 mon.a (mon.0) 3638 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-146", "mode": "writeback"}]: dispatch 2024-09-17T09:09:31.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:31 smithi136 bash[24812]: cluster 2024-09-17T09:09:31.353465+0000 mon.a (mon.0) 3639 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:31.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:31 smithi136 bash[24812]: audit 2024-09-17T09:09:31.365513+0000 mon.a (mon.0) 3640 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-146", "mode": "writeback"}]': finished 2024-09-17T09:09:31.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:31 smithi136 bash[24812]: cluster 2024-09-17T09:09:31.365681+0000 mon.a (mon.0) 3641 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2024-09-17T09:09:31.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[22670]: audit 2024-09-17T09:09:30.364799+0000 mon.a (mon.0) 3636 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-146"}]': finished 2024-09-17T09:09:31.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[22670]: cluster 2024-09-17T09:09:30.365052+0000 mon.a (mon.0) 3637 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2024-09-17T09:09:31.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[22670]: audit 2024-09-17T09:09:30.368593+0000 mon.a (mon.0) 3638 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-146", "mode": "writeback"}]: dispatch 2024-09-17T09:09:31.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[22670]: cluster 2024-09-17T09:09:31.353465+0000 mon.a (mon.0) 3639 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:31.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[22670]: audit 2024-09-17T09:09:31.365513+0000 mon.a (mon.0) 3640 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-146", "mode": "writeback"}]': finished 2024-09-17T09:09:31.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[22670]: cluster 2024-09-17T09:09:31.365681+0000 mon.a (mon.0) 3641 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2024-09-17T09:09:31.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[32124]: audit 2024-09-17T09:09:30.364799+0000 mon.a (mon.0) 3636 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi078-64852-111", "overlaypool": "test-rados-api-smithi078-64852-146"}]': finished 2024-09-17T09:09:31.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[32124]: cluster 2024-09-17T09:09:30.365052+0000 mon.a (mon.0) 3637 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2024-09-17T09:09:31.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[32124]: audit 2024-09-17T09:09:30.368593+0000 mon.a (mon.0) 3638 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-146", "mode": "writeback"}]: dispatch 2024-09-17T09:09:31.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[32124]: cluster 2024-09-17T09:09:31.353465+0000 mon.a (mon.0) 3639 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-17T09:09:31.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[32124]: audit 2024-09-17T09:09:31.365513+0000 mon.a (mon.0) 3640 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi078-64852-146", "mode": "writeback"}]': finished 2024-09-17T09:09:31.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:31 smithi078 bash[32124]: cluster 2024-09-17T09:09:31.365681+0000 mon.a (mon.0) 3641 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2024-09-17T09:09:32.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:32 smithi136 bash[24812]: cluster 2024-09-17T09:09:31.236331+0000 mgr.y (mgr.14532) 683 : cluster [DBG] pgmap v1164: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:32.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:32 smithi136 bash[24812]: audit 2024-09-17T09:09:31.457100+0000 mon.a (mon.0) 3642 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:09:32.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:32 smithi078 bash[22670]: cluster 2024-09-17T09:09:31.236331+0000 mgr.y (mgr.14532) 683 : cluster [DBG] pgmap v1164: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:32.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:32 smithi078 bash[22670]: audit 2024-09-17T09:09:31.457100+0000 mon.a (mon.0) 3642 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:09:32.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:32 smithi078 bash[32124]: cluster 2024-09-17T09:09:31.236331+0000 mgr.y (mgr.14532) 683 : cluster [DBG] pgmap v1164: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:09:32.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:32 smithi078 bash[32124]: audit 2024-09-17T09:09:31.457100+0000 mon.a (mon.0) 3642 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-17T09:09:33.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:33 smithi136 bash[24812]: audit 2024-09-17T09:09:32.396696+0000 mon.a (mon.0) 3643 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:09:33.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:33 smithi136 bash[24812]: cluster 2024-09-17T09:09:32.397093+0000 mon.a (mon.0) 3644 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2024-09-17T09:09:33.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:33 smithi136 bash[24812]: audit 2024-09-17T09:09:32.399984+0000 mon.a (mon.0) 3645 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:09:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:33 smithi078 bash[22670]: audit 2024-09-17T09:09:32.396696+0000 mon.a (mon.0) 3643 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:09:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:33 smithi078 bash[22670]: cluster 2024-09-17T09:09:32.397093+0000 mon.a (mon.0) 3644 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2024-09-17T09:09:33.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:33 smithi078 bash[22670]: audit 2024-09-17T09:09:32.399984+0000 mon.a (mon.0) 3645 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:09:33.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:33 smithi078 bash[32124]: audit 2024-09-17T09:09:32.396696+0000 mon.a (mon.0) 3643 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_count","val": "2"}]': finished 2024-09-17T09:09:33.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:33 smithi078 bash[32124]: cluster 2024-09-17T09:09:32.397093+0000 mon.a (mon.0) 3644 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2024-09-17T09:09:33.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:33 smithi078 bash[32124]: audit 2024-09-17T09:09:32.399984+0000 mon.a (mon.0) 3645 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-17T09:09:34.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:34 smithi136 bash[24812]: cluster 2024-09-17T09:09:33.238406+0000 mgr.y (mgr.14532) 684 : cluster [DBG] pgmap v1167: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:09:34.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:34 smithi136 bash[24812]: audit 2024-09-17T09:09:33.404134+0000 mon.a (mon.0) 3646 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:09:34.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:34 smithi136 bash[24812]: cluster 2024-09-17T09:09:33.404307+0000 mon.a (mon.0) 3647 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2024-09-17T09:09:34.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:34 smithi136 bash[24812]: audit 2024-09-17T09:09:33.406215+0000 mon.a (mon.0) 3648 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:09:34.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:34 smithi136 bash[24812]: cluster 2024-09-17T09:09:34.393687+0000 mon.a (mon.0) 3649 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[22670]: cluster 2024-09-17T09:09:33.238406+0000 mgr.y (mgr.14532) 684 : cluster [DBG] pgmap v1167: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:09:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[22670]: audit 2024-09-17T09:09:33.404134+0000 mon.a (mon.0) 3646 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:09:34.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[22670]: cluster 2024-09-17T09:09:33.404307+0000 mon.a (mon.0) 3647 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2024-09-17T09:09:34.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[22670]: audit 2024-09-17T09:09:33.406215+0000 mon.a (mon.0) 3648 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:09:34.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[22670]: cluster 2024-09-17T09:09:34.393687+0000 mon.a (mon.0) 3649 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:34.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[32124]: cluster 2024-09-17T09:09:33.238406+0000 mgr.y (mgr.14532) 684 : cluster [DBG] pgmap v1167: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:09:34.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[32124]: audit 2024-09-17T09:09:33.404134+0000 mon.a (mon.0) 3646 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_period","val": "600"}]': finished 2024-09-17T09:09:34.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[32124]: cluster 2024-09-17T09:09:33.404307+0000 mon.a (mon.0) 3647 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2024-09-17T09:09:34.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[32124]: audit 2024-09-17T09:09:33.406215+0000 mon.a (mon.0) 3648 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-17T09:09:34.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:34 smithi078 bash[32124]: cluster 2024-09-17T09:09:34.393687+0000 mon.a (mon.0) 3649 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-17T09:09:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:35 smithi136 bash[24812]: audit 2024-09-17T09:09:34.406668+0000 mon.a (mon.0) 3650 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:09:35.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:35 smithi136 bash[24812]: cluster 2024-09-17T09:09:34.406823+0000 mon.a (mon.0) 3651 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2024-09-17T09:09:35.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:35 smithi136 bash[24812]: audit 2024-09-17T09:09:34.408842+0000 mon.a (mon.0) 3652 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:09:35.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:35 smithi136 bash[24812]: audit 2024-09-17T09:09:34.975481+0000 mon.a (mon.0) 3653 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:35.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:35 smithi136 bash[24812]: audit 2024-09-17T09:09:35.409812+0000 mon.a (mon.0) 3654 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:09:35.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:35 smithi136 bash[24812]: cluster 2024-09-17T09:09:35.409975+0000 mon.a (mon.0) 3655 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2024-09-17T09:09:35.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:35 smithi136 bash[24812]: audit 2024-09-17T09:09:35.410818+0000 mon.a (mon.0) 3656 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-17T09:09:35.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[22670]: audit 2024-09-17T09:09:34.406668+0000 mon.a (mon.0) 3650 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[22670]: cluster 2024-09-17T09:09:34.406823+0000 mon.a (mon.0) 3651 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[22670]: audit 2024-09-17T09:09:34.408842+0000 mon.a (mon.0) 3652 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[22670]: audit 2024-09-17T09:09:34.975481+0000 mon.a (mon.0) 3653 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[22670]: audit 2024-09-17T09:09:35.409812+0000 mon.a (mon.0) 3654 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[22670]: cluster 2024-09-17T09:09:35.409975+0000 mon.a (mon.0) 3655 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[22670]: audit 2024-09-17T09:09:35.410818+0000 mon.a (mon.0) 3656 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[32124]: audit 2024-09-17T09:09:34.406668+0000 mon.a (mon.0) 3650 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-17T09:09:35.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[32124]: cluster 2024-09-17T09:09:34.406823+0000 mon.a (mon.0) 3651 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2024-09-17T09:09:35.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[32124]: audit 2024-09-17T09:09:34.408842+0000 mon.a (mon.0) 3652 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-17T09:09:35.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[32124]: audit 2024-09-17T09:09:34.975481+0000 mon.a (mon.0) 3653 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:35.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[32124]: audit 2024-09-17T09:09:35.409812+0000 mon.a (mon.0) 3654 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-17T09:09:35.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[32124]: cluster 2024-09-17T09:09:35.409975+0000 mon.a (mon.0) 3655 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2024-09-17T09:09:35.855 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:35 smithi078 bash[32124]: audit 2024-09-17T09:09:35.410818+0000 mon.a (mon.0) 3656 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-17T09:09:36.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:36 smithi136 bash[24812]: cluster 2024-09-17T09:09:35.239154+0000 mgr.y (mgr.14532) 685 : cluster [DBG] pgmap v1170: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:09:36.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:36 smithi136 bash[24812]: audit 2024-09-17T09:09:35.504373+0000 mon.a (mon.0) 3657 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:36.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:36 smithi136 bash[24812]: audit 2024-09-17T09:09:35.505783+0000 mon.a (mon.0) 3658 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:36.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:36 smithi136 bash[24812]: audit 2024-09-17T09:09:35.514897+0000 mon.a (mon.0) 3659 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:36 smithi136 bash[24812]: audit 2024-09-17T09:09:36.409297+0000 mon.a (mon.0) 3660 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "target_max_objects","val": "1"}]': finished 2024-09-17T09:09:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:36 smithi136 bash[24812]: cluster 2024-09-17T09:09:36.409433+0000 mon.a (mon.0) 3661 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2024-09-17T09:09:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[22670]: cluster 2024-09-17T09:09:35.239154+0000 mgr.y (mgr.14532) 685 : cluster [DBG] pgmap v1170: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:09:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[22670]: audit 2024-09-17T09:09:35.504373+0000 mon.a (mon.0) 3657 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[22670]: audit 2024-09-17T09:09:35.505783+0000 mon.a (mon.0) 3658 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[22670]: audit 2024-09-17T09:09:35.514897+0000 mon.a (mon.0) 3659 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[22670]: audit 2024-09-17T09:09:36.409297+0000 mon.a (mon.0) 3660 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "target_max_objects","val": "1"}]': finished 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[22670]: cluster 2024-09-17T09:09:36.409433+0000 mon.a (mon.0) 3661 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[32124]: cluster 2024-09-17T09:09:35.239154+0000 mgr.y (mgr.14532) 685 : cluster [DBG] pgmap v1170: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[32124]: audit 2024-09-17T09:09:35.504373+0000 mon.a (mon.0) 3657 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[32124]: audit 2024-09-17T09:09:35.505783+0000 mon.a (mon.0) 3658 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[32124]: audit 2024-09-17T09:09:35.514897+0000 mon.a (mon.0) 3659 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[32124]: audit 2024-09-17T09:09:36.409297+0000 mon.a (mon.0) 3660 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-146","var": "target_max_objects","val": "1"}]': finished 2024-09-17T09:09:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:36 smithi078 bash[32124]: cluster 2024-09-17T09:09:36.409433+0000 mon.a (mon.0) 3661 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2024-09-17T09:09:37.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:37 smithi136 bash[24812]: cluster 2024-09-17T09:09:37.429050+0000 mon.a (mon.0) 3662 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-17T09:09:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:37 smithi078 bash[22670]: cluster 2024-09-17T09:09:37.429050+0000 mon.a (mon.0) 3662 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-17T09:09:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:37 smithi078 bash[32124]: cluster 2024-09-17T09:09:37.429050+0000 mon.a (mon.0) 3662 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-17T09:09:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:09:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:09:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:09:38.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:38 smithi136 bash[24812]: cluster 2024-09-17T09:09:37.239957+0000 mgr.y (mgr.14532) 686 : cluster [DBG] pgmap v1173: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:38.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:38 smithi078 bash[22670]: cluster 2024-09-17T09:09:37.239957+0000 mgr.y (mgr.14532) 686 : cluster [DBG] pgmap v1173: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:38.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:38 smithi078 bash[32124]: cluster 2024-09-17T09:09:37.239957+0000 mgr.y (mgr.14532) 686 : cluster [DBG] pgmap v1173: 204 pgs: 204 active+clean; 4.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:39.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:39 smithi136 bash[24812]: audit 2024-09-17T09:09:39.098296+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1", "id": [7, 3]}]: dispatch 2024-09-17T09:09:39.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:39 smithi136 bash[24812]: audit 2024-09-17T09:09:39.098810+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.3", "id": [6, 2]}]: dispatch 2024-09-17T09:09:39.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:39 smithi136 bash[24812]: audit 2024-09-17T09:09:39.099263+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.14", "id": [6, 5, 7, 2]}]: dispatch 2024-09-17T09:09:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:39 smithi136 bash[24812]: audit 2024-09-17T09:09:39.099673+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.15", "id": [6, 3]}]: dispatch 2024-09-17T09:09:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:39 smithi136 bash[24812]: audit 2024-09-17T09:09:39.100027+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1c", "id": [6, 3]}]: dispatch 2024-09-17T09:09:39.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:39 smithi136 bash[24812]: audit 2024-09-17T09:09:39.100400+0000 mon.a (mon.0) 3668 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1f", "id": [6, 5]}]: dispatch 2024-09-17T09:09:39.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[22670]: audit 2024-09-17T09:09:39.098296+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1", "id": [7, 3]}]: dispatch 2024-09-17T09:09:39.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[22670]: audit 2024-09-17T09:09:39.098810+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.3", "id": [6, 2]}]: dispatch 2024-09-17T09:09:39.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[22670]: audit 2024-09-17T09:09:39.099263+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.14", "id": [6, 5, 7, 2]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[22670]: audit 2024-09-17T09:09:39.099673+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.15", "id": [6, 3]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[22670]: audit 2024-09-17T09:09:39.100027+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1c", "id": [6, 3]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[22670]: audit 2024-09-17T09:09:39.100400+0000 mon.a (mon.0) 3668 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1f", "id": [6, 5]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[32124]: audit 2024-09-17T09:09:39.098296+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1", "id": [7, 3]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[32124]: audit 2024-09-17T09:09:39.098810+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.3", "id": [6, 2]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[32124]: audit 2024-09-17T09:09:39.099263+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.14", "id": [6, 5, 7, 2]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[32124]: audit 2024-09-17T09:09:39.099673+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.15", "id": [6, 3]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[32124]: audit 2024-09-17T09:09:39.100027+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1c", "id": [6, 3]}]: dispatch 2024-09-17T09:09:39.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:39 smithi078 bash[32124]: audit 2024-09-17T09:09:39.100400+0000 mon.a (mon.0) 3668 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1f", "id": [6, 5]}]: dispatch 2024-09-17T09:09:40.522 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:09:40.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: cluster 2024-09-17T09:09:39.242011+0000 mgr.y (mgr.14532) 687 : cluster [DBG] pgmap v1174: 204 pgs: 204 active+clean; 4.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:09:40.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: audit 2024-09-17T09:09:39.513790+0000 mon.a (mon.0) 3669 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1", "id": [7, 3]}]': finished 2024-09-17T09:09:40.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: audit 2024-09-17T09:09:39.513970+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.3", "id": [6, 2]}]': finished 2024-09-17T09:09:40.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: audit 2024-09-17T09:09:39.514122+0000 mon.a (mon.0) 3671 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.14", "id": [6, 5, 7, 2]}]': finished 2024-09-17T09:09:40.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: audit 2024-09-17T09:09:39.514298+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.15", "id": [6, 3]}]': finished 2024-09-17T09:09:40.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: audit 2024-09-17T09:09:39.514465+0000 mon.a (mon.0) 3673 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1c", "id": [6, 3]}]': finished 2024-09-17T09:09:40.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: audit 2024-09-17T09:09:39.514662+0000 mon.a (mon.0) 3674 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1f", "id": [6, 5]}]': finished 2024-09-17T09:09:40.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: cluster 2024-09-17T09:09:39.514808+0000 mon.a (mon.0) 3675 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2024-09-17T09:09:40.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:40 smithi136 bash[24812]: audit 2024-09-17T09:09:40.118056+0000 mgr.y (mgr.14532) 688 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:40.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: cluster 2024-09-17T09:09:39.242011+0000 mgr.y (mgr.14532) 687 : cluster [DBG] pgmap v1174: 204 pgs: 204 active+clean; 4.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:09:40.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: audit 2024-09-17T09:09:39.513790+0000 mon.a (mon.0) 3669 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1", "id": [7, 3]}]': finished 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: audit 2024-09-17T09:09:39.513970+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.3", "id": [6, 2]}]': finished 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: audit 2024-09-17T09:09:39.514122+0000 mon.a (mon.0) 3671 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.14", "id": [6, 5, 7, 2]}]': finished 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: audit 2024-09-17T09:09:39.514298+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.15", "id": [6, 3]}]': finished 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: audit 2024-09-17T09:09:39.514465+0000 mon.a (mon.0) 3673 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1c", "id": [6, 3]}]': finished 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: audit 2024-09-17T09:09:39.514662+0000 mon.a (mon.0) 3674 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1f", "id": [6, 5]}]': finished 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: cluster 2024-09-17T09:09:39.514808+0000 mon.a (mon.0) 3675 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[32124]: audit 2024-09-17T09:09:40.118056+0000 mgr.y (mgr.14532) 688 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: cluster 2024-09-17T09:09:39.242011+0000 mgr.y (mgr.14532) 687 : cluster [DBG] pgmap v1174: 204 pgs: 204 active+clean; 4.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: audit 2024-09-17T09:09:39.513790+0000 mon.a (mon.0) 3669 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1", "id": [7, 3]}]': finished 2024-09-17T09:09:40.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: audit 2024-09-17T09:09:39.513970+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.3", "id": [6, 2]}]': finished 2024-09-17T09:09:40.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: audit 2024-09-17T09:09:39.514122+0000 mon.a (mon.0) 3671 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.14", "id": [6, 5, 7, 2]}]': finished 2024-09-17T09:09:40.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: audit 2024-09-17T09:09:39.514298+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.15", "id": [6, 3]}]': finished 2024-09-17T09:09:40.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: audit 2024-09-17T09:09:39.514465+0000 mon.a (mon.0) 3673 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1c", "id": [6, 3]}]': finished 2024-09-17T09:09:40.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: audit 2024-09-17T09:09:39.514662+0000 mon.a (mon.0) 3674 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "260.1f", "id": [6, 5]}]': finished 2024-09-17T09:09:40.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: cluster 2024-09-17T09:09:39.514808+0000 mon.a (mon.0) 3675 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2024-09-17T09:09:40.855 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:40 smithi078 bash[22670]: audit 2024-09-17T09:09:40.118056+0000 mgr.y (mgr.14532) 688 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:41.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:41 smithi136 bash[24812]: cluster 2024-09-17T09:09:40.511994+0000 mon.a (mon.0) 3676 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2024-09-17T09:09:41.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:41 smithi078 bash[32124]: cluster 2024-09-17T09:09:40.511994+0000 mon.a (mon.0) 3676 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2024-09-17T09:09:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:41 smithi078 bash[22670]: cluster 2024-09-17T09:09:40.511994+0000 mon.a (mon.0) 3676 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2024-09-17T09:09:43.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:42 smithi078 bash[32124]: cluster 2024-09-17T09:09:41.242862+0000 mgr.y (mgr.14532) 689 : cluster [DBG] pgmap v1177: 204 pgs: 204 active+clean; 4.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:09:43.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:42 smithi078 bash[32124]: audit 2024-09-17T09:09:41.835451+0000 mon.a (mon.0) 3677 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:43.103 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:42 smithi078 bash[32124]: audit 2024-09-17T09:09:41.837562+0000 mon.a (mon.0) 3678 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:43.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:42 smithi078 bash[22670]: cluster 2024-09-17T09:09:41.242862+0000 mgr.y (mgr.14532) 689 : cluster [DBG] pgmap v1177: 204 pgs: 204 active+clean; 4.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:09:43.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:42 smithi078 bash[22670]: audit 2024-09-17T09:09:41.835451+0000 mon.a (mon.0) 3677 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:43.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:42 smithi078 bash[22670]: audit 2024-09-17T09:09:41.837562+0000 mon.a (mon.0) 3678 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:42 smithi136 bash[24812]: cluster 2024-09-17T09:09:41.242862+0000 mgr.y (mgr.14532) 689 : cluster [DBG] pgmap v1177: 204 pgs: 204 active+clean; 4.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 B/s wr, 1 op/s 2024-09-17T09:09:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:42 smithi136 bash[24812]: audit 2024-09-17T09:09:41.835451+0000 mon.a (mon.0) 3677 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:43.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:42 smithi136 bash[24812]: audit 2024-09-17T09:09:41.837562+0000 mon.a (mon.0) 3678 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:45.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:44 smithi136 bash[24812]: cluster 2024-09-17T09:09:43.244866+0000 mgr.y (mgr.14532) 690 : cluster [DBG] pgmap v1178: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-17T09:09:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:44 smithi078 bash[32124]: cluster 2024-09-17T09:09:43.244866+0000 mgr.y (mgr.14532) 690 : cluster [DBG] pgmap v1178: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-17T09:09:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:44 smithi078 bash[22670]: cluster 2024-09-17T09:09:43.244866+0000 mgr.y (mgr.14532) 690 : cluster [DBG] pgmap v1178: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-17T09:09:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:46 smithi136 bash[24812]: cluster 2024-09-17T09:09:45.245719+0000 mgr.y (mgr.14532) 691 : cluster [DBG] pgmap v1179: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T09:09:47.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:46 smithi136 bash[24812]: audit 2024-09-17T09:09:46.437815+0000 mon.a (mon.0) 3679 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:46 smithi078 bash[22670]: cluster 2024-09-17T09:09:45.245719+0000 mgr.y (mgr.14532) 691 : cluster [DBG] pgmap v1179: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T09:09:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:46 smithi078 bash[22670]: audit 2024-09-17T09:09:46.437815+0000 mon.a (mon.0) 3679 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:46 smithi078 bash[32124]: cluster 2024-09-17T09:09:45.245719+0000 mgr.y (mgr.14532) 691 : cluster [DBG] pgmap v1179: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T09:09:47.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:46 smithi078 bash[32124]: audit 2024-09-17T09:09:46.437815+0000 mon.a (mon.0) 3679 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:47 smithi136 bash[24812]: audit 2024-09-17T09:09:46.919934+0000 mon.a (mon.0) 3680 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:47 smithi136 bash[24812]: cluster 2024-09-17T09:09:46.920091+0000 mon.a (mon.0) 3681 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2024-09-17T09:09:48.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:47 smithi136 bash[24812]: audit 2024-09-17T09:09:46.921540+0000 mon.a (mon.0) 3682 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:48.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:09:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:09:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:09:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:47 smithi078 bash[22670]: audit 2024-09-17T09:09:46.919934+0000 mon.a (mon.0) 3680 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:48.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:47 smithi078 bash[22670]: cluster 2024-09-17T09:09:46.920091+0000 mon.a (mon.0) 3681 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2024-09-17T09:09:48.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:47 smithi078 bash[22670]: audit 2024-09-17T09:09:46.921540+0000 mon.a (mon.0) 3682 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:47 smithi078 bash[32124]: audit 2024-09-17T09:09:46.919934+0000 mon.a (mon.0) 3680 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:09:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:47 smithi078 bash[32124]: cluster 2024-09-17T09:09:46.920091+0000 mon.a (mon.0) 3681 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2024-09-17T09:09:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:47 smithi078 bash[32124]: audit 2024-09-17T09:09:46.921540+0000 mon.a (mon.0) 3682 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:49.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:49 smithi136 bash[24812]: cluster 2024-09-17T09:09:47.246594+0000 mgr.y (mgr.14532) 692 : cluster [DBG] pgmap v1181: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 661 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-17T09:09:49.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:49 smithi136 bash[24812]: audit 2024-09-17T09:09:47.932267+0000 mon.a (mon.0) 3683 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]': finished 2024-09-17T09:09:49.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:49 smithi136 bash[24812]: cluster 2024-09-17T09:09:47.932442+0000 mon.a (mon.0) 3684 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2024-09-17T09:09:49.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:49 smithi136 bash[24812]: audit 2024-09-17T09:09:47.989620+0000 mon.a (mon.0) 3685 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:49.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:49 smithi136 bash[24812]: audit 2024-09-17T09:09:47.990500+0000 mon.a (mon.0) 3686 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:49.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[32124]: cluster 2024-09-17T09:09:47.246594+0000 mgr.y (mgr.14532) 692 : cluster [DBG] pgmap v1181: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 661 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-17T09:09:49.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[32124]: audit 2024-09-17T09:09:47.932267+0000 mon.a (mon.0) 3683 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]': finished 2024-09-17T09:09:49.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[32124]: cluster 2024-09-17T09:09:47.932442+0000 mon.a (mon.0) 3684 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2024-09-17T09:09:49.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[32124]: audit 2024-09-17T09:09:47.989620+0000 mon.a (mon.0) 3685 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:49.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[32124]: audit 2024-09-17T09:09:47.990500+0000 mon.a (mon.0) 3686 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:49.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[22670]: cluster 2024-09-17T09:09:47.246594+0000 mgr.y (mgr.14532) 692 : cluster [DBG] pgmap v1181: 204 pgs: 204 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 661 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-17T09:09:49.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[22670]: audit 2024-09-17T09:09:47.932267+0000 mon.a (mon.0) 3683 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]': finished 2024-09-17T09:09:49.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[22670]: cluster 2024-09-17T09:09:47.932442+0000 mon.a (mon.0) 3684 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2024-09-17T09:09:49.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[22670]: audit 2024-09-17T09:09:47.989620+0000 mon.a (mon.0) 3685 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:49.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:49 smithi078 bash[22670]: audit 2024-09-17T09:09:47.990500+0000 mon.a (mon.0) 3686 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-146"}]: dispatch 2024-09-17T09:09:50.384 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:09:50 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:09:50.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:50 smithi136 bash[24812]: cluster 2024-09-17T09:09:48.932096+0000 mon.a (mon.0) 3687 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2024-09-17T09:09:50.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:50 smithi136 bash[24812]: cluster 2024-09-17T09:09:49.247314+0000 mgr.y (mgr.14532) 693 : cluster [DBG] pgmap v1184: 172 pgs: 172 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T09:09:50.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:50 smithi136 bash[24812]: cluster 2024-09-17T09:09:49.926323+0000 mon.a (mon.0) 3688 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-17T09:09:50.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:50 smithi136 bash[24812]: cluster 2024-09-17T09:09:49.943031+0000 mon.a (mon.0) 3689 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2024-09-17T09:09:50.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:50 smithi136 bash[24812]: audit 2024-09-17T09:09:49.946643+0000 mon.a (mon.0) 3690 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:50.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:50 smithi136 bash[24812]: audit 2024-09-17T09:09:50.124275+0000 mgr.y (mgr.14532) 694 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:50.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[32124]: cluster 2024-09-17T09:09:48.932096+0000 mon.a (mon.0) 3687 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2024-09-17T09:09:50.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[32124]: cluster 2024-09-17T09:09:49.247314+0000 mgr.y (mgr.14532) 693 : cluster [DBG] pgmap v1184: 172 pgs: 172 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T09:09:50.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[32124]: cluster 2024-09-17T09:09:49.926323+0000 mon.a (mon.0) 3688 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-17T09:09:50.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[32124]: cluster 2024-09-17T09:09:49.943031+0000 mon.a (mon.0) 3689 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[32124]: audit 2024-09-17T09:09:49.946643+0000 mon.a (mon.0) 3690 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[32124]: audit 2024-09-17T09:09:50.124275+0000 mgr.y (mgr.14532) 694 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[22670]: cluster 2024-09-17T09:09:48.932096+0000 mon.a (mon.0) 3687 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[22670]: cluster 2024-09-17T09:09:49.247314+0000 mgr.y (mgr.14532) 693 : cluster [DBG] pgmap v1184: 172 pgs: 172 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[22670]: cluster 2024-09-17T09:09:49.926323+0000 mon.a (mon.0) 3688 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[22670]: cluster 2024-09-17T09:09:49.943031+0000 mon.a (mon.0) 3689 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[22670]: audit 2024-09-17T09:09:49.946643+0000 mon.a (mon.0) 3690 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:50.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:50 smithi078 bash[22670]: audit 2024-09-17T09:09:50.124275+0000 mgr.y (mgr.14532) 694 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:09:52.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:51 smithi136 bash[24812]: audit 2024-09-17T09:09:50.949356+0000 mon.a (mon.0) 3691 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:52.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:51 smithi136 bash[24812]: cluster 2024-09-17T09:09:50.949920+0000 mon.a (mon.0) 3692 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2024-09-17T09:09:52.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:51 smithi136 bash[24812]: audit 2024-09-17T09:09:50.998272+0000 mon.a (mon.0) 3693 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:52.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:51 smithi078 bash[32124]: audit 2024-09-17T09:09:50.949356+0000 mon.a (mon.0) 3691 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:52.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:51 smithi078 bash[32124]: cluster 2024-09-17T09:09:50.949920+0000 mon.a (mon.0) 3692 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2024-09-17T09:09:52.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:51 smithi078 bash[32124]: audit 2024-09-17T09:09:50.998272+0000 mon.a (mon.0) 3693 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:52.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:51 smithi078 bash[22670]: audit 2024-09-17T09:09:50.949356+0000 mon.a (mon.0) 3691 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:52.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:51 smithi078 bash[22670]: cluster 2024-09-17T09:09:50.949920+0000 mon.a (mon.0) 3692 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2024-09-17T09:09:52.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:51 smithi078 bash[22670]: audit 2024-09-17T09:09:50.998272+0000 mon.a (mon.0) 3693 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-17T09:09:53.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:52 smithi136 bash[24812]: cluster 2024-09-17T09:09:51.248208+0000 mgr.y (mgr.14532) 695 : cluster [DBG] pgmap v1187: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T09:09:53.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:52 smithi136 bash[24812]: audit 2024-09-17T09:09:51.961884+0000 mon.a (mon.0) 3694 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:53.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:52 smithi136 bash[24812]: cluster 2024-09-17T09:09:51.962060+0000 mon.a (mon.0) 3695 : cluster [DBG] osdmap e743: 8 total, 8 up, 8 in 2024-09-17T09:09:53.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:52 smithi136 bash[24812]: audit 2024-09-17T09:09:51.981475+0000 mon.a (mon.0) 3696 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]: dispatch 2024-09-17T09:09:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[22670]: cluster 2024-09-17T09:09:51.248208+0000 mgr.y (mgr.14532) 695 : cluster [DBG] pgmap v1187: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T09:09:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[22670]: audit 2024-09-17T09:09:51.961884+0000 mon.a (mon.0) 3694 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[22670]: cluster 2024-09-17T09:09:51.962060+0000 mon.a (mon.0) 3695 : cluster [DBG] osdmap e743: 8 total, 8 up, 8 in 2024-09-17T09:09:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[22670]: audit 2024-09-17T09:09:51.981475+0000 mon.a (mon.0) 3696 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]: dispatch 2024-09-17T09:09:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[32124]: cluster 2024-09-17T09:09:51.248208+0000 mgr.y (mgr.14532) 695 : cluster [DBG] pgmap v1187: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T09:09:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[32124]: audit 2024-09-17T09:09:51.961884+0000 mon.a (mon.0) 3694 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-17T09:09:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[32124]: cluster 2024-09-17T09:09:51.962060+0000 mon.a (mon.0) 3695 : cluster [DBG] osdmap e743: 8 total, 8 up, 8 in 2024-09-17T09:09:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:52 smithi078 bash[32124]: audit 2024-09-17T09:09:51.981475+0000 mon.a (mon.0) 3696 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]: dispatch 2024-09-17T09:09:54.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:54 smithi136 bash[24812]: audit 2024-09-17T09:09:52.968525+0000 mon.a (mon.0) 3697 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]': finished 2024-09-17T09:09:54.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:54 smithi136 bash[24812]: cluster 2024-09-17T09:09:52.968920+0000 mon.a (mon.0) 3698 : cluster [DBG] osdmap e744: 8 total, 8 up, 8 in 2024-09-17T09:09:54.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:54 smithi136 bash[24812]: audit 2024-09-17T09:09:53.033753+0000 mon.a (mon.0) 3699 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:54.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:54 smithi136 bash[24812]: audit 2024-09-17T09:09:53.034711+0000 mon.a (mon.0) 3700 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]: dispatch 2024-09-17T09:09:54.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[22670]: audit 2024-09-17T09:09:52.968525+0000 mon.a (mon.0) 3697 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]': finished 2024-09-17T09:09:54.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[22670]: cluster 2024-09-17T09:09:52.968920+0000 mon.a (mon.0) 3698 : cluster [DBG] osdmap e744: 8 total, 8 up, 8 in 2024-09-17T09:09:54.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[22670]: audit 2024-09-17T09:09:53.033753+0000 mon.a (mon.0) 3699 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:54.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[22670]: audit 2024-09-17T09:09:53.034711+0000 mon.a (mon.0) 3700 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]: dispatch 2024-09-17T09:09:54.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[32124]: audit 2024-09-17T09:09:52.968525+0000 mon.a (mon.0) 3697 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]': finished 2024-09-17T09:09:54.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[32124]: cluster 2024-09-17T09:09:52.968920+0000 mon.a (mon.0) 3698 : cluster [DBG] osdmap e744: 8 total, 8 up, 8 in 2024-09-17T09:09:54.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[32124]: audit 2024-09-17T09:09:53.033753+0000 mon.a (mon.0) 3699 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:54.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:54 smithi078 bash[32124]: audit 2024-09-17T09:09:53.034711+0000 mon.a (mon.0) 3700 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-148"}]: dispatch 2024-09-17T09:09:55.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:55 smithi136 bash[24812]: cluster 2024-09-17T09:09:53.250177+0000 mgr.y (mgr.14532) 696 : cluster [DBG] pgmap v1190: 204 pgs: 204 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:09:55.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:55 smithi136 bash[24812]: cluster 2024-09-17T09:09:53.975182+0000 mon.a (mon.0) 3701 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:09:55.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:55 smithi136 bash[24812]: cluster 2024-09-17T09:09:53.984782+0000 mon.a (mon.0) 3702 : cluster [DBG] osdmap e745: 8 total, 8 up, 8 in 2024-09-17T09:09:55.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:55 smithi136 bash[24812]: cluster 2024-09-17T09:09:54.990550+0000 mon.a (mon.0) 3703 : cluster [DBG] osdmap e746: 8 total, 8 up, 8 in 2024-09-17T09:09:55.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:55 smithi136 bash[24812]: audit 2024-09-17T09:09:54.995719+0000 mon.a (mon.0) 3704 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[22670]: cluster 2024-09-17T09:09:53.250177+0000 mgr.y (mgr.14532) 696 : cluster [DBG] pgmap v1190: 204 pgs: 204 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:09:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[22670]: cluster 2024-09-17T09:09:53.975182+0000 mon.a (mon.0) 3701 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:09:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[22670]: cluster 2024-09-17T09:09:53.984782+0000 mon.a (mon.0) 3702 : cluster [DBG] osdmap e745: 8 total, 8 up, 8 in 2024-09-17T09:09:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[22670]: cluster 2024-09-17T09:09:54.990550+0000 mon.a (mon.0) 3703 : cluster [DBG] osdmap e746: 8 total, 8 up, 8 in 2024-09-17T09:09:55.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[22670]: audit 2024-09-17T09:09:54.995719+0000 mon.a (mon.0) 3704 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:55.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[32124]: cluster 2024-09-17T09:09:53.250177+0000 mgr.y (mgr.14532) 696 : cluster [DBG] pgmap v1190: 204 pgs: 204 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T09:09:55.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[32124]: cluster 2024-09-17T09:09:53.975182+0000 mon.a (mon.0) 3701 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:09:55.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[32124]: cluster 2024-09-17T09:09:53.984782+0000 mon.a (mon.0) 3702 : cluster [DBG] osdmap e745: 8 total, 8 up, 8 in 2024-09-17T09:09:55.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[32124]: cluster 2024-09-17T09:09:54.990550+0000 mon.a (mon.0) 3703 : cluster [DBG] osdmap e746: 8 total, 8 up, 8 in 2024-09-17T09:09:55.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:55 smithi078 bash[32124]: audit 2024-09-17T09:09:54.995719+0000 mon.a (mon.0) 3704 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:57.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:57 smithi136 bash[24812]: cluster 2024-09-17T09:09:55.250995+0000 mgr.y (mgr.14532) 697 : cluster [DBG] pgmap v1193: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:09:57.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:57 smithi136 bash[24812]: audit 2024-09-17T09:09:56.001103+0000 mon.a (mon.0) 3705 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:57.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:57 smithi136 bash[24812]: cluster 2024-09-17T09:09:56.001573+0000 mon.a (mon.0) 3706 : cluster [DBG] osdmap e747: 8 total, 8 up, 8 in 2024-09-17T09:09:57.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:57 smithi136 bash[24812]: audit 2024-09-17T09:09:56.087574+0000 mon.a (mon.0) 3707 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:57.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:57 smithi136 bash[24812]: audit 2024-09-17T09:09:56.088171+0000 mon.a (mon.0) 3708 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-150"}]: dispatch 2024-09-17T09:09:57.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:57 smithi136 bash[24812]: audit 2024-09-17T09:09:56.875180+0000 mon.a (mon.0) 3709 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:57.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:57 smithi136 bash[24812]: audit 2024-09-17T09:09:56.877342+0000 mon.a (mon.0) 3710 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:57.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[22670]: cluster 2024-09-17T09:09:55.250995+0000 mgr.y (mgr.14532) 697 : cluster [DBG] pgmap v1193: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:09:57.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[22670]: audit 2024-09-17T09:09:56.001103+0000 mon.a (mon.0) 3705 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:57.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[22670]: cluster 2024-09-17T09:09:56.001573+0000 mon.a (mon.0) 3706 : cluster [DBG] osdmap e747: 8 total, 8 up, 8 in 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[22670]: audit 2024-09-17T09:09:56.087574+0000 mon.a (mon.0) 3707 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[22670]: audit 2024-09-17T09:09:56.088171+0000 mon.a (mon.0) 3708 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-150"}]: dispatch 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[22670]: audit 2024-09-17T09:09:56.875180+0000 mon.a (mon.0) 3709 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[22670]: audit 2024-09-17T09:09:56.877342+0000 mon.a (mon.0) 3710 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[32124]: cluster 2024-09-17T09:09:55.250995+0000 mgr.y (mgr.14532) 697 : cluster [DBG] pgmap v1193: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[32124]: audit 2024-09-17T09:09:56.001103+0000 mon.a (mon.0) 3705 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[32124]: cluster 2024-09-17T09:09:56.001573+0000 mon.a (mon.0) 3706 : cluster [DBG] osdmap e747: 8 total, 8 up, 8 in 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[32124]: audit 2024-09-17T09:09:56.087574+0000 mon.a (mon.0) 3707 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[32124]: audit 2024-09-17T09:09:56.088171+0000 mon.a (mon.0) 3708 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-150"}]: dispatch 2024-09-17T09:09:57.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[32124]: audit 2024-09-17T09:09:56.875180+0000 mon.a (mon.0) 3709 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:09:57.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:56 smithi078 bash[32124]: audit 2024-09-17T09:09:56.877342+0000 mon.a (mon.0) 3710 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:09:58.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:58 smithi136 bash[24812]: cluster 2024-09-17T09:09:57.014777+0000 mon.a (mon.0) 3711 : cluster [DBG] osdmap e748: 8 total, 8 up, 8 in 2024-09-17T09:09:58.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:58 smithi078 bash[22670]: cluster 2024-09-17T09:09:57.014777+0000 mon.a (mon.0) 3711 : cluster [DBG] osdmap e748: 8 total, 8 up, 8 in 2024-09-17T09:09:58.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:09:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:09:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:09:58.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:58 smithi078 bash[32124]: cluster 2024-09-17T09:09:57.014777+0000 mon.a (mon.0) 3711 : cluster [DBG] osdmap e748: 8 total, 8 up, 8 in 2024-09-17T09:09:59.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:59 smithi136 bash[24812]: cluster 2024-09-17T09:09:57.251707+0000 mgr.y (mgr.14532) 698 : cluster [DBG] pgmap v1196: 172 pgs: 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:59.291 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:59 smithi136 bash[24812]: cluster 2024-09-17T09:09:58.029135+0000 mon.a (mon.0) 3712 : cluster [DBG] osdmap e749: 8 total, 8 up, 8 in 2024-09-17T09:09:59.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:09:59 smithi136 bash[24812]: audit 2024-09-17T09:09:58.036583+0000 mon.a (mon.0) 3713 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:59.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:59 smithi078 bash[32124]: cluster 2024-09-17T09:09:57.251707+0000 mgr.y (mgr.14532) 698 : cluster [DBG] pgmap v1196: 172 pgs: 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:59.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:59 smithi078 bash[32124]: cluster 2024-09-17T09:09:58.029135+0000 mon.a (mon.0) 3712 : cluster [DBG] osdmap e749: 8 total, 8 up, 8 in 2024-09-17T09:09:59.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:09:59 smithi078 bash[32124]: audit 2024-09-17T09:09:58.036583+0000 mon.a (mon.0) 3713 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:09:59.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:59 smithi078 bash[22670]: cluster 2024-09-17T09:09:57.251707+0000 mgr.y (mgr.14532) 698 : cluster [DBG] pgmap v1196: 172 pgs: 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:09:59.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:59 smithi078 bash[22670]: cluster 2024-09-17T09:09:58.029135+0000 mon.a (mon.0) 3712 : cluster [DBG] osdmap e749: 8 total, 8 up, 8 in 2024-09-17T09:09:59.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:09:59 smithi078 bash[22670]: audit 2024-09-17T09:09:58.036583+0000 mon.a (mon.0) 3713 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:10:00.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: audit 2024-09-17T09:09:59.029429+0000 mon.a (mon.0) 3714 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:10:00.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: cluster 2024-09-17T09:09:59.030461+0000 mon.a (mon.0) 3715 : cluster [DBG] osdmap e750: 8 total, 8 up, 8 in 2024-09-17T09:10:00.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: audit 2024-09-17T09:09:59.129239+0000 mon.a (mon.0) 3716 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: audit 2024-09-17T09:09:59.130049+0000 mon.a (mon.0) 3717 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-152"}]: dispatch 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: cluster 2024-09-17T09:10:00.000172+0000 mon.a (mon.0) 3718 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: cluster 2024-09-17T09:10:00.000215+0000 mon.a (mon.0) 3719 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: cluster 2024-09-17T09:10:00.000269+0000 mon.a (mon.0) 3720 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: cluster 2024-09-17T09:10:00.000306+0000 mon.a (mon.0) 3721 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi078-64852-111' 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[32124]: cluster 2024-09-17T09:10:00.000374+0000 mon.a (mon.0) 3722 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: audit 2024-09-17T09:09:59.029429+0000 mon.a (mon.0) 3714 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:10:00.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: cluster 2024-09-17T09:09:59.030461+0000 mon.a (mon.0) 3715 : cluster [DBG] osdmap e750: 8 total, 8 up, 8 in 2024-09-17T09:10:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: audit 2024-09-17T09:09:59.129239+0000 mon.a (mon.0) 3716 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: audit 2024-09-17T09:09:59.130049+0000 mon.a (mon.0) 3717 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-152"}]: dispatch 2024-09-17T09:10:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: cluster 2024-09-17T09:10:00.000172+0000 mon.a (mon.0) 3718 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-17T09:10:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: cluster 2024-09-17T09:10:00.000215+0000 mon.a (mon.0) 3719 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-17T09:10:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: cluster 2024-09-17T09:10:00.000269+0000 mon.a (mon.0) 3720 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-17T09:10:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: cluster 2024-09-17T09:10:00.000306+0000 mon.a (mon.0) 3721 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi078-64852-111' 2024-09-17T09:10:00.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:00 smithi078 bash[22670]: cluster 2024-09-17T09:10:00.000374+0000 mon.a (mon.0) 3722 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-17T09:10:00.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:10:00.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: audit 2024-09-17T09:09:59.029429+0000 mon.a (mon.0) 3714 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: cluster 2024-09-17T09:09:59.030461+0000 mon.a (mon.0) 3715 : cluster [DBG] osdmap e750: 8 total, 8 up, 8 in 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: audit 2024-09-17T09:09:59.129239+0000 mon.a (mon.0) 3716 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: audit 2024-09-17T09:09:59.130049+0000 mon.a (mon.0) 3717 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-152"}]: dispatch 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: cluster 2024-09-17T09:10:00.000172+0000 mon.a (mon.0) 3718 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: cluster 2024-09-17T09:10:00.000215+0000 mon.a (mon.0) 3719 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: cluster 2024-09-17T09:10:00.000269+0000 mon.a (mon.0) 3720 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: cluster 2024-09-17T09:10:00.000306+0000 mon.a (mon.0) 3721 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi078-64852-111' 2024-09-17T09:10:00.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:00 smithi136 bash[24812]: cluster 2024-09-17T09:10:00.000374+0000 mon.a (mon.0) 3722 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-17T09:10:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:01 smithi078 bash[22670]: cluster 2024-09-17T09:09:59.252533+0000 mgr.y (mgr.14532) 699 : cluster [DBG] pgmap v1199: 204 pgs: 3 creating+peering, 29 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:10:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:01 smithi078 bash[22670]: cluster 2024-09-17T09:10:00.061281+0000 mon.a (mon.0) 3723 : cluster [DBG] osdmap e751: 8 total, 8 up, 8 in 2024-09-17T09:10:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:01 smithi078 bash[22670]: audit 2024-09-17T09:10:00.135788+0000 mgr.y (mgr.14532) 700 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:01.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:01 smithi078 bash[32124]: cluster 2024-09-17T09:09:59.252533+0000 mgr.y (mgr.14532) 699 : cluster [DBG] pgmap v1199: 204 pgs: 3 creating+peering, 29 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:10:01.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:01 smithi078 bash[32124]: cluster 2024-09-17T09:10:00.061281+0000 mon.a (mon.0) 3723 : cluster [DBG] osdmap e751: 8 total, 8 up, 8 in 2024-09-17T09:10:01.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:01 smithi078 bash[32124]: audit 2024-09-17T09:10:00.135788+0000 mgr.y (mgr.14532) 700 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:01 smithi136 bash[24812]: cluster 2024-09-17T09:09:59.252533+0000 mgr.y (mgr.14532) 699 : cluster [DBG] pgmap v1199: 204 pgs: 3 creating+peering, 29 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:10:01.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:01 smithi136 bash[24812]: cluster 2024-09-17T09:10:00.061281+0000 mon.a (mon.0) 3723 : cluster [DBG] osdmap e751: 8 total, 8 up, 8 in 2024-09-17T09:10:01.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:01 smithi136 bash[24812]: audit 2024-09-17T09:10:00.135788+0000 mgr.y (mgr.14532) 700 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:02.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[32124]: cluster 2024-09-17T09:10:01.063788+0000 mon.a (mon.0) 3724 : cluster [DBG] osdmap e752: 8 total, 8 up, 8 in 2024-09-17T09:10:02.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[32124]: audit 2024-09-17T09:10:01.083377+0000 mon.a (mon.0) 3725 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:10:02.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[32124]: audit 2024-09-17T09:10:02.063854+0000 mon.a (mon.0) 3726 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:10:02.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[32124]: cluster 2024-09-17T09:10:02.064216+0000 mon.a (mon.0) 3727 : cluster [DBG] osdmap e753: 8 total, 8 up, 8 in 2024-09-17T09:10:02.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[22670]: cluster 2024-09-17T09:10:01.063788+0000 mon.a (mon.0) 3724 : cluster [DBG] osdmap e752: 8 total, 8 up, 8 in 2024-09-17T09:10:02.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[22670]: audit 2024-09-17T09:10:01.083377+0000 mon.a (mon.0) 3725 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:10:02.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[22670]: audit 2024-09-17T09:10:02.063854+0000 mon.a (mon.0) 3726 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:10:02.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:02 smithi078 bash[22670]: cluster 2024-09-17T09:10:02.064216+0000 mon.a (mon.0) 3727 : cluster [DBG] osdmap e753: 8 total, 8 up, 8 in 2024-09-17T09:10:02.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:02 smithi136 bash[24812]: cluster 2024-09-17T09:10:01.063788+0000 mon.a (mon.0) 3724 : cluster [DBG] osdmap e752: 8 total, 8 up, 8 in 2024-09-17T09:10:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:02 smithi136 bash[24812]: audit 2024-09-17T09:10:01.083377+0000 mon.a (mon.0) 3725 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:10:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:02 smithi136 bash[24812]: audit 2024-09-17T09:10:02.063854+0000 mon.a (mon.0) 3726 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi078-64852-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-17T09:10:02.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:02 smithi136 bash[24812]: cluster 2024-09-17T09:10:02.064216+0000 mon.a (mon.0) 3727 : cluster [DBG] osdmap e753: 8 total, 8 up, 8 in 2024-09-17T09:10:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[32124]: cluster 2024-09-17T09:10:01.253312+0000 mgr.y (mgr.14532) 701 : cluster [DBG] pgmap v1202: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:10:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[32124]: cluster 2024-09-17T09:10:02.070516+0000 mon.a (mon.0) 3728 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:10:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[32124]: audit 2024-09-17T09:10:02.075377+0000 mon.a (mon.0) 3729 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-111","var": "dedup_tier","val": "test-rados-api-smithi078-64852-154"}]: dispatch 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[32124]: audit 2024-09-17T09:10:02.132113+0000 mon.a (mon.0) 3730 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[32124]: audit 2024-09-17T09:10:02.132656+0000 mon.a (mon.0) 3731 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-154"}]: dispatch 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[32124]: cluster 2024-09-17T09:10:03.092098+0000 mon.a (mon.0) 3732 : cluster [DBG] osdmap e754: 8 total, 8 up, 8 in 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[22670]: cluster 2024-09-17T09:10:01.253312+0000 mgr.y (mgr.14532) 701 : cluster [DBG] pgmap v1202: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[22670]: cluster 2024-09-17T09:10:02.070516+0000 mon.a (mon.0) 3728 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[22670]: audit 2024-09-17T09:10:02.075377+0000 mon.a (mon.0) 3729 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-111","var": "dedup_tier","val": "test-rados-api-smithi078-64852-154"}]: dispatch 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[22670]: audit 2024-09-17T09:10:02.132113+0000 mon.a (mon.0) 3730 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[22670]: audit 2024-09-17T09:10:02.132656+0000 mon.a (mon.0) 3731 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-154"}]: dispatch 2024-09-17T09:10:03.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:03 smithi078 bash[22670]: cluster 2024-09-17T09:10:03.092098+0000 mon.a (mon.0) 3732 : cluster [DBG] osdmap e754: 8 total, 8 up, 8 in 2024-09-17T09:10:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:03 smithi136 bash[24812]: cluster 2024-09-17T09:10:01.253312+0000 mgr.y (mgr.14532) 701 : cluster [DBG] pgmap v1202: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T09:10:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:03 smithi136 bash[24812]: cluster 2024-09-17T09:10:02.070516+0000 mon.a (mon.0) 3728 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:10:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:03 smithi136 bash[24812]: audit 2024-09-17T09:10:02.075377+0000 mon.a (mon.0) 3729 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi078-64852-111","var": "dedup_tier","val": "test-rados-api-smithi078-64852-154"}]: dispatch 2024-09-17T09:10:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:03 smithi136 bash[24812]: audit 2024-09-17T09:10:02.132113+0000 mon.a (mon.0) 3730 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:03 smithi136 bash[24812]: audit 2024-09-17T09:10:02.132656+0000 mon.a (mon.0) 3731 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi078-64852-111", "tierpool": "test-rados-api-smithi078-64852-154"}]: dispatch 2024-09-17T09:10:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:03 smithi136 bash[24812]: cluster 2024-09-17T09:10:03.092098+0000 mon.a (mon.0) 3732 : cluster [DBG] osdmap e754: 8 total, 8 up, 8 in 2024-09-17T09:10:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:05 smithi078 bash[32124]: cluster 2024-09-17T09:10:03.254172+0000 mgr.y (mgr.14532) 702 : cluster [DBG] pgmap v1205: 172 pgs: 172 active+clean; 4.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T09:10:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:05 smithi078 bash[32124]: cluster 2024-09-17T09:10:04.093249+0000 mon.a (mon.0) 3733 : cluster [DBG] osdmap e755: 8 total, 8 up, 8 in 2024-09-17T09:10:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:05 smithi078 bash[32124]: audit 2024-09-17T09:10:04.095964+0000 mon.a (mon.0) 3734 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:05 smithi078 bash[22670]: cluster 2024-09-17T09:10:03.254172+0000 mgr.y (mgr.14532) 702 : cluster [DBG] pgmap v1205: 172 pgs: 172 active+clean; 4.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T09:10:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:05 smithi078 bash[22670]: cluster 2024-09-17T09:10:04.093249+0000 mon.a (mon.0) 3733 : cluster [DBG] osdmap e755: 8 total, 8 up, 8 in 2024-09-17T09:10:05.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:05 smithi078 bash[22670]: audit 2024-09-17T09:10:04.095964+0000 mon.a (mon.0) 3734 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:05.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:05 smithi136 bash[24812]: cluster 2024-09-17T09:10:03.254172+0000 mgr.y (mgr.14532) 702 : cluster [DBG] pgmap v1205: 172 pgs: 172 active+clean; 4.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T09:10:05.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:05 smithi136 bash[24812]: cluster 2024-09-17T09:10:04.093249+0000 mon.a (mon.0) 3733 : cluster [DBG] osdmap e755: 8 total, 8 up, 8 in 2024-09-17T09:10:05.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:05 smithi136 bash[24812]: audit 2024-09-17T09:10:04.095964+0000 mon.a (mon.0) 3734 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:06.117 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7775 ms) 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (12282 ms) 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8100 ms) 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13137 ms) 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7518 ms) 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8122 ms) 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-17T09:10:06.118 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: ok, hit_set contains 256:602f83fe:::foo:head 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9031 ms) 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: first is 1726564121 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,1726564126,1726564127,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,1726564126,1726564127,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,1726564126,1726564127,0 2024-09-17T09:10:06.119 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,1726564126,1726564127,1726564129,1726564130,0 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,1726564126,1726564127,1726564129,1726564130,0 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564121,1726564123,1726564124,1726564126,1726564127,1726564129,1726564130,0 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: got ls 1726564124,1726564126,1726564127,1726564129,1726564130,1726564132,1726564133,0 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: first now 1726564124, trimmed 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (21091 ms) 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: foo0 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14121 ms) 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (18078 ms) 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-17T09:10:06.120 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22584 ms) 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5057 ms) 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3031 ms) 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3043 ms) 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3030 ms) 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (231172 ms total) 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (866367 ms total) 2024-09-17T09:10:06.121 INFO:tasks.workunit.client.0.smithi078.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-09-17T09:10:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64707 2024-09-17T09:10:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64707 2024-09-17T09:10:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64879 2024-09-17T09:10:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64879 2024-09-17T09:10:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65176 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65176 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65006 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65006 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64963 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64963 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64796 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64796 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64986 2024-09-17T09:10:06.127 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64986 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64811 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64811 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65150 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65150 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64691 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64691 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64723 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64723 2024-09-17T09:10:06.128 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65158 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65158 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64683 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64683 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64699 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64699 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64910 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64910 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64978 2024-09-17T09:10:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64978 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64929 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64929 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65163 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65163 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65139 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65139 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64867 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64867 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65021 2024-09-17T09:10:06.130 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65021 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64675 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64675 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64715 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64715 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64994 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64994 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=64731 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 64731 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.131 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65055 2024-09-17T09:10:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65055 2024-09-17T09:10:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:+ for t in "${!pids[@]}" 2024-09-17T09:10:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=65114 2024-09-17T09:10:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 65114 2024-09-17T09:10:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:+ exit 0 2024-09-17T09:10:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:+ cleanup 2024-09-17T09:10:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:+ pkill -P 64670 2024-09-17T09:10:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ true 2024-09-17T09:10:06.144 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T09:10:06.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T09:10:06.158 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-17T09:10:06.160 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-17T09:10:06.160 DEBUG:teuthology.orchestra.run.smithi078:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cbdc9211df088cccbd94423c7cf3a2b85fe432b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-17T09:10:06.217 INFO:tasks.workunit.client.0.smithi078.stderr:+ uuidgen 2024-09-17T09:10:06.217 INFO:tasks.workunit.client.0.smithi078.stderr:+ p=9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:10:06.217 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool create 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 12 2024-09-17T09:10:06.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/3953120172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 msgr2=0x7f7f381002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:06.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 --2- 172.21.15.78:0/3953120172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f381002c0 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009930 tx=0x7f7f3401c7e0 comp rx=0 tx=0).stop 2024-09-17T09:10:06.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/3953120172 shutdown_connections 2024-09-17T09:10:06.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 --2- 172.21.15.78:0/3953120172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f38105010 0x7f7f3810cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:06.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 --2- 172.21.15.78:0/3953120172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f38100890 0x7f7f381048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:06.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 --2- 172.21.15.78:0/3953120172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f381002c0 unknown :-1 s=CLOSED pgs=3230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:06.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/3953120172 >> 172.21.15.78:0/3953120172 conn(0x7f7f380fb9c0 msgr2=0x7f7f380fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:06.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/3953120172 shutdown_connections 2024-09-17T09:10:06.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/3953120172 wait complete. 2024-09-17T09:10:06.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 Processor -- start 2024-09-17T09:10:06.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- start start 2024-09-17T09:10:06.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f38197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:06.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f38100890 0x7f7f381983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:06.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f38105010 0x7f7f3819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:06.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3819cdc0 con 0x7f7f38100890 2024-09-17T09:10:06.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3819cf30 con 0x7f7f38105010 2024-09-17T09:10:06.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3819d0a0 con 0x7f7f380ffee0 2024-09-17T09:10:06.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f38197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:06.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3cf1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f38100890 0x7f7f381983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:06.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f38197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:54578/0 (socket says 172.21.15.78:54578) 2024-09-17T09:10:06.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 -- 172.21.15.78:0/370400778 learned_addr learned my addr 172.21.15.78:0/370400778 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:10:06.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 -- 172.21.15.78:0/370400778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f38105010 msgr2=0x7f7f3819c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:06.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f38105010 0x7f7f3819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:06.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 -- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f38100890 msgr2=0x7f7f381983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:06.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f38100890 0x7f7f381983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:06.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 -- 172.21.15.78:0/370400778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34009560 con 0x7f7f380ffee0 2024-09-17T09:10:06.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3d71c640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f38197e80 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7f7f3401cd50 tx=0x7f7f34004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:06.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340ad650 con 0x7f7f380ffee0 2024-09-17T09:10:06.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3819d320 con 0x7f7f380ffee0 2024-09-17T09:10:06.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f7f340ad7b0 con 0x7f7f380ffee0 2024-09-17T09:10:06.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34003a80 con 0x7f7f380ffee0 2024-09-17T09:10:06.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3819d640 con 0x7f7f380ffee0 2024-09-17T09:10:06.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.343+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f381013c0 con 0x7f7f380ffee0 2024-09-17T09:10:06.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.347+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f7f340b4070 con 0x7f7f380ffee0 2024-09-17T09:10:06.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.347+0000 7f7f2e7fc640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7f2406ce30 0x7f7f2406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:06.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.347+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(757..757 src has 1..757) v4 ==== 8691+0+0 (secure 0 0 0) 0x7f7f341281c0 con 0x7f7f380ffee0 2024-09-17T09:10:06.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.347+0000 7f7f3cf1b640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7f2406ce30 0x7f7f2406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:06.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.347+0000 7f7f3cf1b640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7f2406ce30 0x7f7f2406f2f0 secure :-1 s=READY pgs=3606 cs=0 l=1 rev1=1 crypto rx=0x7f7f38199430 tx=0x7f7f280091e0 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:06.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.351+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7f340f1a40 con 0x7f7f380ffee0 2024-09-17T09:10:06.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:06.523+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12} v 0) v1 -- 0x7f7f38199250 con 0x7f7f380ffee0 2024-09-17T09:10:06.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:06 smithi136 bash[24812]: audit 2024-09-17T09:10:05.094751+0000 mon.a (mon.0) 3735 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:10:06.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:06 smithi136 bash[24812]: cluster 2024-09-17T09:10:05.095132+0000 mon.a (mon.0) 3736 : cluster [DBG] osdmap e756: 8 total, 8 up, 8 in 2024-09-17T09:10:06.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:06 smithi136 bash[24812]: audit 2024-09-17T09:10:05.096561+0000 mon.a (mon.0) 3737 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:06 smithi078 bash[32124]: audit 2024-09-17T09:10:05.094751+0000 mon.a (mon.0) 3735 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:10:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:06 smithi078 bash[32124]: cluster 2024-09-17T09:10:05.095132+0000 mon.a (mon.0) 3736 : cluster [DBG] osdmap e756: 8 total, 8 up, 8 in 2024-09-17T09:10:06.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:06 smithi078 bash[32124]: audit 2024-09-17T09:10:05.096561+0000 mon.a (mon.0) 3737 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:06.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:06 smithi078 bash[22670]: audit 2024-09-17T09:10:05.094751+0000 mon.a (mon.0) 3735 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:10:06.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:06 smithi078 bash[22670]: cluster 2024-09-17T09:10:05.095132+0000 mon.a (mon.0) 3736 : cluster [DBG] osdmap e756: 8 total, 8 up, 8 in 2024-09-17T09:10:06.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:06 smithi078 bash[22670]: audit 2024-09-17T09:10:05.096561+0000 mon.a (mon.0) 3737 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]: dispatch 2024-09-17T09:10:07.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.123+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]=0 pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' created v758) v1 ==== 176+0+0 (secure 0 0 0) 0x7f7f340b20c0 con 0x7f7f380ffee0 2024-09-17T09:10:07.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.227+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12} v 0) v1 -- 0x7f7f381002c0 con 0x7f7f380ffee0 2024-09-17T09:10:07.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f2e7fc640 1 -- 172.21.15.78:0/370400778 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]=0 pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' already exists v758) v1 ==== 183+0+0 (secure 0 0 0) 0x7f7f340bc030 con 0x7f7f380ffee0 2024-09-17T09:10:07.233 INFO:tasks.workunit.client.0.smithi078.stderr:pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' already exists 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7f2406ce30 msgr2=0x7f7f2406f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7f2406ce30 0x7f7f2406f2f0 secure :-1 s=READY pgs=3606 cs=0 l=1 rev1=1 crypto rx=0x7f7f38199430 tx=0x7f7f280091e0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 msgr2=0x7f7f38197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f38197e80 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7f7f3401cd50 tx=0x7f7f34004430 comp rx=0 tx=0).stop 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 shutdown_connections 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7f2406ce30 0x7f7f2406f2f0 unknown :-1 s=CLOSED pgs=3606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f38105010 0x7f7f3819c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f38100890 0x7f7f381983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 --2- 172.21.15.78:0/370400778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f380ffee0 0x7f7f38197e80 unknown :-1 s=CLOSED pgs=3231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 >> 172.21.15.78:0/370400778 conn(0x7f7f380fb9c0 msgr2=0x7f7f380fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:07.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 shutdown_connections 2024-09-17T09:10:07.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.231+0000 7f7f3f980640 1 -- 172.21.15.78:0/370400778 wait complete. 2024-09-17T09:10:07.249 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 max_objects 10 2024-09-17T09:10:07.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- 172.21.15.78:0/2797498672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58240fff80 msgr2=0x7f5824100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:07.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 --2- 172.21.15.78:0/2797498672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58240fff80 0x7f5824100360 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f5814009960 tx=0x7f581401c7c0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- 172.21.15.78:0/2797498672 shutdown_connections 2024-09-17T09:10:07.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 --2- 172.21.15.78:0/2797498672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241050b0 0x7f582410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 --2- 172.21.15.78:0/2797498672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824100930 0x7f5824104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 --2- 172.21.15.78:0/2797498672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58240fff80 0x7f5824100360 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- 172.21.15.78:0/2797498672 >> 172.21.15.78:0/2797498672 conn(0x7f58240fba60 msgr2=0x7f58240fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:07.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- 172.21.15.78:0/2797498672 shutdown_connections 2024-09-17T09:10:07.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- 172.21.15.78:0/2797498672 wait complete. 2024-09-17T09:10:07.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 Processor -- start 2024-09-17T09:10:07.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- start start 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58240fff80 0x7f5824197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824100930 0x7f5824198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241050b0 0x7f582419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582419cf00 con 0x7f5824100930 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582419d070 con 0x7f58241050b0 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582890f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582419d1e0 con 0x7f58240fff80 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58240fff80 0x7f5824197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58240fff80 0x7f5824197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:54602/0 (socket says 172.21.15.78:54602) 2024-09-17T09:10:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f5821d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824100930 0x7f5824198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 -- 172.21.15.78:0/4000988912 learned_addr learned my addr 172.21.15.78:0/4000988912 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f5822d9d640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241050b0 0x7f582419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 -- 172.21.15.78:0/4000988912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241050b0 msgr2=0x7f582419c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241050b0 0x7f582419c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 -- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824100930 msgr2=0x7f5824198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824100930 0x7f5824198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 -- 172.21.15.78:0/4000988912 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58180094a0 con 0x7f58240fff80 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f5821d9b640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824100930 0x7f5824198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.367+0000 7f582259c640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58240fff80 0x7f5824197fc0 secure :-1 s=READY pgs=3232 cs=0 l=1 rev1=1 crypto rx=0x7f5814005950 tx=0x7f58140ad6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814004450 con 0x7f58240fff80 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5814009560 con 0x7f58240fff80 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58241a4bb0 con 0x7f58240fff80 2024-09-17T09:10:07.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f58140a5a10 con 0x7f58240fff80 2024-09-17T09:10:07.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814003cc0 con 0x7f58240fff80 2024-09-17T09:10:07.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5824101460 con 0x7f58240fff80 2024-09-17T09:10:07.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f58140b4070 con 0x7f58240fff80 2024-09-17T09:10:07.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f58137fe640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f580c06ce30 0x7f580c06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:07.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(758..758 src has 1..758) v4 ==== 9066+0+0 (secure 0 0 0) 0x7f58141272f0 con 0x7f58240fff80 2024-09-17T09:10:07.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f5821d9b640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f580c06ce30 0x7f580c06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:07.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.371+0000 7f5821d9b640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f580c06ce30 0x7f580c06f2f0 secure :-1 s=READY pgs=3607 cs=0 l=1 rev1=1 crypto rx=0x7f5824199570 tx=0x7f58180091e0 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:07.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.375+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f58140f0900 con 0x7f58240fff80 2024-09-17T09:10:07.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:07.535+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f58241003c0 con 0x7f58240fff80 2024-09-17T09:10:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:07 smithi136 bash[24812]: cluster 2024-09-17T09:10:05.254914+0000 mgr.y (mgr.14532) 703 : cluster [DBG] pgmap v1208: 164 pgs: 164 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:10:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:07 smithi136 bash[24812]: audit 2024-09-17T09:10:06.100685+0000 mon.a (mon.0) 3738 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:10:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:07 smithi136 bash[24812]: cluster 2024-09-17T09:10:06.100882+0000 mon.a (mon.0) 3739 : cluster [DBG] osdmap e757: 8 total, 8 up, 8 in 2024-09-17T09:10:07.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:07 smithi136 bash[24812]: audit 2024-09-17T09:10:06.529027+0000 mon.c (mon.2) 318 : audit [INF] from='client.? 172.21.15.78:0/370400778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:07.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:07 smithi136 bash[24812]: audit 2024-09-17T09:10:06.529609+0000 mon.a (mon.0) 3740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[22670]: cluster 2024-09-17T09:10:05.254914+0000 mgr.y (mgr.14532) 703 : cluster [DBG] pgmap v1208: 164 pgs: 164 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:10:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[22670]: audit 2024-09-17T09:10:06.100685+0000 mon.a (mon.0) 3738 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:10:07.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[22670]: cluster 2024-09-17T09:10:06.100882+0000 mon.a (mon.0) 3739 : cluster [DBG] osdmap e757: 8 total, 8 up, 8 in 2024-09-17T09:10:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[22670]: audit 2024-09-17T09:10:06.529027+0000 mon.c (mon.2) 318 : audit [INF] from='client.? 172.21.15.78:0/370400778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:07.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[22670]: audit 2024-09-17T09:10:06.529609+0000 mon.a (mon.0) 3740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[32124]: cluster 2024-09-17T09:10:05.254914+0000 mgr.y (mgr.14532) 703 : cluster [DBG] pgmap v1208: 164 pgs: 164 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:10:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[32124]: audit 2024-09-17T09:10:06.100685+0000 mon.a (mon.0) 3738 : audit [INF] from='client.? 172.21.15.78:0/3726013160' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi078-64852-111"}]': finished 2024-09-17T09:10:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[32124]: cluster 2024-09-17T09:10:06.100882+0000 mon.a (mon.0) 3739 : cluster [DBG] osdmap e757: 8 total, 8 up, 8 in 2024-09-17T09:10:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[32124]: audit 2024-09-17T09:10:06.529027+0000 mon.c (mon.2) 318 : audit [INF] from='client.? 172.21.15.78:0/370400778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:07.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[32124]: audit 2024-09-17T09:10:06.529609+0000 mon.a (mon.0) 3740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:08.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:08.131+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v759) v1 ==== 223+0+0 (secure 0 0 0) 0x7f58140f3f20 con 0x7f58240fff80 2024-09-17T09:10:08.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:08.243+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f5824100360 con 0x7f58240fff80 2024-09-17T09:10:08.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:10:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:10:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:10:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[22670]: audit 2024-09-17T09:10:07.127663+0000 mon.a (mon.0) 3741 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]': finished 2024-09-17T09:10:08.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[22670]: cluster 2024-09-17T09:10:07.127868+0000 mon.a (mon.0) 3742 : cluster [DBG] osdmap e758: 8 total, 8 up, 8 in 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[22670]: audit 2024-09-17T09:10:07.233782+0000 mon.c (mon.2) 319 : audit [INF] from='client.? 172.21.15.78:0/370400778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[22670]: audit 2024-09-17T09:10:07.234403+0000 mon.a (mon.0) 3743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[22670]: audit 2024-09-17T09:10:07.541475+0000 mon.c (mon.2) 320 : audit [INF] from='client.? 172.21.15.78:0/4000988912' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[22670]: audit 2024-09-17T09:10:07.542113+0000 mon.a (mon.0) 3744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[22670]: cluster 2024-09-17T09:10:07.900821+0000 mon.a (mon.0) 3745 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[32124]: audit 2024-09-17T09:10:07.127663+0000 mon.a (mon.0) 3741 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]': finished 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[32124]: cluster 2024-09-17T09:10:07.127868+0000 mon.a (mon.0) 3742 : cluster [DBG] osdmap e758: 8 total, 8 up, 8 in 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[32124]: audit 2024-09-17T09:10:07.233782+0000 mon.c (mon.2) 319 : audit [INF] from='client.? 172.21.15.78:0/370400778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[32124]: audit 2024-09-17T09:10:07.234403+0000 mon.a (mon.0) 3743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[32124]: audit 2024-09-17T09:10:07.541475+0000 mon.c (mon.2) 320 : audit [INF] from='client.? 172.21.15.78:0/4000988912' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[32124]: audit 2024-09-17T09:10:07.542113+0000 mon.a (mon.0) 3744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:08.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:08 smithi078 bash[32124]: cluster 2024-09-17T09:10:07.900821+0000 mon.a (mon.0) 3745 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:10:08.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:08 smithi136 bash[24812]: audit 2024-09-17T09:10:07.127663+0000 mon.a (mon.0) 3741 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]': finished 2024-09-17T09:10:08.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:08 smithi136 bash[24812]: cluster 2024-09-17T09:10:07.127868+0000 mon.a (mon.0) 3742 : cluster [DBG] osdmap e758: 8 total, 8 up, 8 in 2024-09-17T09:10:08.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:08 smithi136 bash[24812]: audit 2024-09-17T09:10:07.233782+0000 mon.c (mon.2) 319 : audit [INF] from='client.? 172.21.15.78:0/370400778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:08.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:08 smithi136 bash[24812]: audit 2024-09-17T09:10:07.234403+0000 mon.a (mon.0) 3743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pg_num": 12}]: dispatch 2024-09-17T09:10:08.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:08 smithi136 bash[24812]: audit 2024-09-17T09:10:07.541475+0000 mon.c (mon.2) 320 : audit [INF] from='client.? 172.21.15.78:0/4000988912' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:08.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:08 smithi136 bash[24812]: audit 2024-09-17T09:10:07.542113+0000 mon.a (mon.0) 3744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:08.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:08 smithi136 bash[24812]: cluster 2024-09-17T09:10:07.900821+0000 mon.a (mon.0) 3745 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:10:09.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.155+0000 7f58137fe640 1 -- 172.21.15.78:0/4000988912 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v760) v1 ==== 223+0+0 (secure 0 0 0) 0x7f58140b20d0 con 0x7f58240fff80 2024-09-17T09:10:09.159 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_objects = 10 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:10:09.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f580c06ce30 msgr2=0x7f580c06f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f580c06ce30 0x7f580c06f2f0 secure :-1 s=READY pgs=3607 cs=0 l=1 rev1=1 crypto rx=0x7f5824199570 tx=0x7f58180091e0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58240fff80 msgr2=0x7f5824197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58240fff80 0x7f5824197fc0 secure :-1 s=READY pgs=3232 cs=0 l=1 rev1=1 crypto rx=0x7f5814005950 tx=0x7f58140ad6c0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 shutdown_connections 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f580c06ce30 0x7f580c06f2f0 unknown :-1 s=CLOSED pgs=3607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241050b0 0x7f582419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824100930 0x7f5824198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 --2- 172.21.15.78:0/4000988912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58240fff80 0x7f5824197fc0 unknown :-1 s=CLOSED pgs=3232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 >> 172.21.15.78:0/4000988912 conn(0x7f58240fba60 msgr2=0x7f58240fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 shutdown_connections 2024-09-17T09:10:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.159+0000 7f582890f640 1 -- 172.21.15.78:0/4000988912 wait complete. 2024-09-17T09:10:09.185 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool application enable 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 rados 2024-09-17T09:10:09.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 -- 172.21.15.78:0/3086857388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a2010a2d0 msgr2=0x7f7a2010c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:09.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 --2- 172.21.15.78:0/3086857388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a2010a2d0 0x7f7a2010c790 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009930 tx=0x7f7a1001c870 comp rx=0 tx=0).stop 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 -- 172.21.15.78:0/3086857388 shutdown_connections 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 --2- 172.21.15.78:0/3086857388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a2010a2d0 0x7f7a2010c790 unknown :-1 s=CLOSED pgs=3233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 --2- 172.21.15.78:0/3086857388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a201018a0 0x7f7a20109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 --2- 172.21.15.78:0/3086857388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a20100f80 0x7f7a20101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 -- 172.21.15.78:0/3086857388 >> 172.21.15.78:0/3086857388 conn(0x7f7a200fa920 msgr2=0x7f7a200fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 -- 172.21.15.78:0/3086857388 shutdown_connections 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.303+0000 7f7a26584640 1 -- 172.21.15.78:0/3086857388 wait complete. 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 Processor -- start 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 -- start start 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a20100f80 0x7f7a20197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a201018a0 0x7f7a20198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:09.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a2010a2d0 0x7f7a2019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2019cd70 con 0x7f7a2010a2d0 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2019cee0 con 0x7f7a20100f80 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2019d050 con 0x7f7a201018a0 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a201018a0 0x7f7a20198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a24b21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a2010a2d0 0x7f7a2019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a201018a0 0x7f7a20198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:54606/0 (socket says 172.21.15.78:54606) 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 -- 172.21.15.78:0/4071154118 learned_addr learned my addr 172.21.15.78:0/4071154118 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1ffff640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a20100f80 0x7f7a20197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 -- 172.21.15.78:0/4071154118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a20100f80 msgr2=0x7f7a20197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a20100f80 0x7f7a20197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 -- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a2010a2d0 msgr2=0x7f7a2019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:09.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a2010a2d0 0x7f7a2019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 -- 172.21.15.78:0/4071154118 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14009820 con 0x7f7a201018a0 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1f7fe640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a201018a0 0x7f7a20198370 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009d90 tx=0x7f7a1400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003b80 con 0x7f7a201018a0 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f7a14003ce0 con 0x7f7a201018a0 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a10009560 con 0x7f7a201018a0 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14010670 con 0x7f7a201018a0 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a201a4a20 con 0x7f7a201018a0 2024-09-17T09:10:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a20068e30 con 0x7f7a201018a0 2024-09-17T09:10:09.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f7a14004000 con 0x7f7a201018a0 2024-09-17T09:10:09.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1d7fa640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7a0806ce30 0x7f7a0806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:09.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(760..760 src has 1..760) v4 ==== 9066+0+0 (secure 0 0 0) 0x7f7a14014070 con 0x7f7a201018a0 2024-09-17T09:10:09.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1ffff640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7a0806ce30 0x7f7a0806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:09.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.307+0000 7f7a1ffff640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7a0806ce30 0x7f7a0806f2f0 secure :-1 s=READY pgs=3608 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800ba40 tx=0x7f7a18005cd0 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:09.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.311+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a14056f10 con 0x7f7a201018a0 2024-09-17T09:10:09.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:09.483+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"} v 0) v1 -- 0x7f7a20199190 con 0x7f7a201018a0 2024-09-17T09:10:09.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:09 smithi136 bash[24812]: cluster 2024-09-17T09:10:07.255521+0000 mgr.y (mgr.14532) 704 : cluster [DBG] pgmap v1211: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:10:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:09 smithi136 bash[24812]: audit 2024-09-17T09:10:08.133517+0000 mon.a (mon.0) 3746 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:10:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:09 smithi136 bash[24812]: cluster 2024-09-17T09:10:08.133801+0000 mon.a (mon.0) 3747 : cluster [DBG] osdmap e759: 8 total, 8 up, 8 in 2024-09-17T09:10:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:09 smithi136 bash[24812]: audit 2024-09-17T09:10:08.248131+0000 mon.c (mon.2) 321 : audit [INF] from='client.? 172.21.15.78:0/4000988912' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:09 smithi136 bash[24812]: audit 2024-09-17T09:10:08.248610+0000 mon.a (mon.0) 3748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[22670]: cluster 2024-09-17T09:10:07.255521+0000 mgr.y (mgr.14532) 704 : cluster [DBG] pgmap v1211: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:10:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[22670]: audit 2024-09-17T09:10:08.133517+0000 mon.a (mon.0) 3746 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:10:09.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[22670]: cluster 2024-09-17T09:10:08.133801+0000 mon.a (mon.0) 3747 : cluster [DBG] osdmap e759: 8 total, 8 up, 8 in 2024-09-17T09:10:09.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[22670]: audit 2024-09-17T09:10:08.248131+0000 mon.c (mon.2) 321 : audit [INF] from='client.? 172.21.15.78:0/4000988912' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:09.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[22670]: audit 2024-09-17T09:10:08.248610+0000 mon.a (mon.0) 3748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[32124]: cluster 2024-09-17T09:10:07.255521+0000 mgr.y (mgr.14532) 704 : cluster [DBG] pgmap v1211: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:10:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[32124]: audit 2024-09-17T09:10:08.133517+0000 mon.a (mon.0) 3746 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:10:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[32124]: cluster 2024-09-17T09:10:08.133801+0000 mon.a (mon.0) 3747 : cluster [DBG] osdmap e759: 8 total, 8 up, 8 in 2024-09-17T09:10:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[32124]: audit 2024-09-17T09:10:08.248131+0000 mon.c (mon.2) 321 : audit [INF] from='client.? 172.21.15.78:0/4000988912' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:09.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:09 smithi078 bash[32124]: audit 2024-09-17T09:10:08.248610+0000 mon.a (mon.0) 3748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:10:10.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:10.175+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]=0 enabled application 'rados' on pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' v761) v1 ==== 213+0+0 (secure 0 0 0) 0x7f7a1405a530 con 0x7f7a201018a0 2024-09-17T09:10:10.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:10.283+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"} v 0) v1 -- 0x7f7a20101360 con 0x7f7a201018a0 2024-09-17T09:10:10.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:10:10 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:10:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:10 smithi136 bash[24812]: audit 2024-09-17T09:10:09.158312+0000 mon.a (mon.0) 3749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:10:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:10 smithi136 bash[24812]: cluster 2024-09-17T09:10:09.158544+0000 mon.a (mon.0) 3750 : cluster [DBG] osdmap e760: 8 total, 8 up, 8 in 2024-09-17T09:10:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:10 smithi136 bash[24812]: audit 2024-09-17T09:10:09.490066+0000 mon.c (mon.2) 322 : audit [INF] from='client.? 172.21.15.78:0/4071154118' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:10.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:10 smithi136 bash[24812]: audit 2024-09-17T09:10:09.490720+0000 mon.a (mon.0) 3751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[32124]: audit 2024-09-17T09:10:09.158312+0000 mon.a (mon.0) 3749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:10:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[32124]: cluster 2024-09-17T09:10:09.158544+0000 mon.a (mon.0) 3750 : cluster [DBG] osdmap e760: 8 total, 8 up, 8 in 2024-09-17T09:10:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[32124]: audit 2024-09-17T09:10:09.490066+0000 mon.c (mon.2) 322 : audit [INF] from='client.? 172.21.15.78:0/4071154118' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:10.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[32124]: audit 2024-09-17T09:10:09.490720+0000 mon.a (mon.0) 3751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[22670]: audit 2024-09-17T09:10:09.158312+0000 mon.a (mon.0) 3749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:10:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[22670]: cluster 2024-09-17T09:10:09.158544+0000 mon.a (mon.0) 3750 : cluster [DBG] osdmap e760: 8 total, 8 up, 8 in 2024-09-17T09:10:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[22670]: audit 2024-09-17T09:10:09.490066+0000 mon.c (mon.2) 322 : audit [INF] from='client.? 172.21.15.78:0/4071154118' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:10.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:10 smithi078 bash[22670]: audit 2024-09-17T09:10:09.490720+0000 mon.a (mon.0) 3751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.187+0000 7f7a1d7fa640 1 -- 172.21.15.78:0/4071154118 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]=0 enabled application 'rados' on pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' v762) v1 ==== 213+0+0 (secure 0 0 0) 0x7f7a1405a710 con 0x7f7a201018a0 2024-09-17T09:10:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:enabled application 'rados' on pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' 2024-09-17T09:10:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7a0806ce30 msgr2=0x7f7a0806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7a0806ce30 0x7f7a0806f2f0 secure :-1 s=READY pgs=3608 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800ba40 tx=0x7f7a18005cd0 comp rx=0 tx=0).stop 2024-09-17T09:10:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a201018a0 msgr2=0x7f7a20198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a201018a0 0x7f7a20198370 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009d90 tx=0x7f7a1400c6a0 comp rx=0 tx=0).stop 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 shutdown_connections 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7a0806ce30 0x7f7a0806f2f0 unknown :-1 s=CLOSED pgs=3608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a2010a2d0 0x7f7a2019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a201018a0 0x7f7a20198370 unknown :-1 s=CLOSED pgs=3234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 --2- 172.21.15.78:0/4071154118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a20100f80 0x7f7a20197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 >> 172.21.15.78:0/4071154118 conn(0x7f7a200fa920 msgr2=0x7f7a2010bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 shutdown_connections 2024-09-17T09:10:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:11.195+0000 7f7a26584640 1 -- 172.21.15.78:0/4071154118 wait complete. 2024-09-17T09:10:11.217 INFO:tasks.workunit.client.0.smithi078.stderr:+ seq 1 10 2024-09-17T09:10:11.281 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj1 /etc/passwd 2024-09-17T09:10:11.336 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj2 /etc/passwd 2024-09-17T09:10:11.377 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj3 /etc/passwd 2024-09-17T09:10:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj4 /etc/passwd 2024-09-17T09:10:11.460 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj5 /etc/passwd 2024-09-17T09:10:11.498 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj6 /etc/passwd 2024-09-17T09:10:11.538 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj7 /etc/passwd 2024-09-17T09:10:11.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:11 smithi136 bash[24812]: cluster 2024-09-17T09:10:09.256246+0000 mgr.y (mgr.14532) 705 : cluster [DBG] pgmap v1214: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:11.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:11 smithi136 bash[24812]: audit 2024-09-17T09:10:10.147404+0000 mgr.y (mgr.14532) 706 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:11.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:11 smithi136 bash[24812]: audit 2024-09-17T09:10:10.178642+0000 mon.a (mon.0) 3752 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]': finished 2024-09-17T09:10:11.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:11 smithi136 bash[24812]: cluster 2024-09-17T09:10:10.178843+0000 mon.a (mon.0) 3753 : cluster [DBG] osdmap e761: 8 total, 8 up, 8 in 2024-09-17T09:10:11.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:11 smithi136 bash[24812]: audit 2024-09-17T09:10:10.287417+0000 mon.c (mon.2) 323 : audit [INF] from='client.? 172.21.15.78:0/4071154118' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:11.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:11 smithi136 bash[24812]: audit 2024-09-17T09:10:10.287958+0000 mon.a (mon.0) 3754 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:11.574 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj8 /etc/passwd 2024-09-17T09:10:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[32124]: cluster 2024-09-17T09:10:09.256246+0000 mgr.y (mgr.14532) 705 : cluster [DBG] pgmap v1214: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[32124]: audit 2024-09-17T09:10:10.147404+0000 mgr.y (mgr.14532) 706 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[32124]: audit 2024-09-17T09:10:10.178642+0000 mon.a (mon.0) 3752 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]': finished 2024-09-17T09:10:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[32124]: cluster 2024-09-17T09:10:10.178843+0000 mon.a (mon.0) 3753 : cluster [DBG] osdmap e761: 8 total, 8 up, 8 in 2024-09-17T09:10:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[32124]: audit 2024-09-17T09:10:10.287417+0000 mon.c (mon.2) 323 : audit [INF] from='client.? 172.21.15.78:0/4071154118' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:11.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[32124]: audit 2024-09-17T09:10:10.287958+0000 mon.a (mon.0) 3754 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[22670]: cluster 2024-09-17T09:10:09.256246+0000 mgr.y (mgr.14532) 705 : cluster [DBG] pgmap v1214: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[22670]: audit 2024-09-17T09:10:10.147404+0000 mgr.y (mgr.14532) 706 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[22670]: audit 2024-09-17T09:10:10.178642+0000 mon.a (mon.0) 3752 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]': finished 2024-09-17T09:10:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[22670]: cluster 2024-09-17T09:10:10.178843+0000 mon.a (mon.0) 3753 : cluster [DBG] osdmap e761: 8 total, 8 up, 8 in 2024-09-17T09:10:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[22670]: audit 2024-09-17T09:10:10.287417+0000 mon.c (mon.2) 323 : audit [INF] from='client.? 172.21.15.78:0/4071154118' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:11.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:11 smithi078 bash[22670]: audit 2024-09-17T09:10:10.287958+0000 mon.a (mon.0) 3754 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]: dispatch 2024-09-17T09:10:11.611 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj9 /etc/passwd 2024-09-17T09:10:11.648 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put obj10 /etc/passwd 2024-09-17T09:10:11.686 INFO:tasks.workunit.client.0.smithi078.stderr:+ sleep 30 2024-09-17T09:10:12.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:12 smithi136 bash[24812]: audit 2024-09-17T09:10:11.193443+0000 mon.a (mon.0) 3755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]': finished 2024-09-17T09:10:12.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:12 smithi136 bash[24812]: cluster 2024-09-17T09:10:11.193642+0000 mon.a (mon.0) 3756 : cluster [DBG] osdmap e762: 8 total, 8 up, 8 in 2024-09-17T09:10:12.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:12 smithi136 bash[24812]: audit 2024-09-17T09:10:11.905053+0000 mon.a (mon.0) 3757 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:12 smithi078 bash[22670]: audit 2024-09-17T09:10:11.193443+0000 mon.a (mon.0) 3755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]': finished 2024-09-17T09:10:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:12 smithi078 bash[22670]: cluster 2024-09-17T09:10:11.193642+0000 mon.a (mon.0) 3756 : cluster [DBG] osdmap e762: 8 total, 8 up, 8 in 2024-09-17T09:10:12.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:12 smithi078 bash[22670]: audit 2024-09-17T09:10:11.905053+0000 mon.a (mon.0) 3757 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:12 smithi078 bash[32124]: audit 2024-09-17T09:10:11.193443+0000 mon.a (mon.0) 3755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "app": "rados"}]': finished 2024-09-17T09:10:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:12 smithi078 bash[32124]: cluster 2024-09-17T09:10:11.193642+0000 mon.a (mon.0) 3756 : cluster [DBG] osdmap e762: 8 total, 8 up, 8 in 2024-09-17T09:10:12.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:12 smithi078 bash[32124]: audit 2024-09-17T09:10:11.905053+0000 mon.a (mon.0) 3757 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:13.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:13 smithi136 bash[24812]: cluster 2024-09-17T09:10:11.257028+0000 mgr.y (mgr.14532) 707 : cluster [DBG] pgmap v1217: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:13 smithi078 bash[22670]: cluster 2024-09-17T09:10:11.257028+0000 mgr.y (mgr.14532) 707 : cluster [DBG] pgmap v1217: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:13 smithi078 bash[32124]: cluster 2024-09-17T09:10:11.257028+0000 mgr.y (mgr.14532) 707 : cluster [DBG] pgmap v1217: 176 pgs: 12 creating+peering, 164 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:15.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:15 smithi136 bash[24812]: cluster 2024-09-17T09:10:13.258957+0000 mgr.y (mgr.14532) 708 : cluster [DBG] pgmap v1218: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 25 KiB/s wr, 2 op/s 2024-09-17T09:10:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:15 smithi078 bash[22670]: cluster 2024-09-17T09:10:13.258957+0000 mgr.y (mgr.14532) 708 : cluster [DBG] pgmap v1218: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 25 KiB/s wr, 2 op/s 2024-09-17T09:10:15.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:15 smithi078 bash[32124]: cluster 2024-09-17T09:10:13.258957+0000 mgr.y (mgr.14532) 708 : cluster [DBG] pgmap v1218: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 25 KiB/s wr, 2 op/s 2024-09-17T09:10:17.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:17 smithi136 bash[24812]: cluster 2024-09-17T09:10:15.259674+0000 mgr.y (mgr.14532) 709 : cluster [DBG] pgmap v1219: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 21 KiB/s wr, 2 op/s 2024-09-17T09:10:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:17 smithi078 bash[32124]: cluster 2024-09-17T09:10:15.259674+0000 mgr.y (mgr.14532) 709 : cluster [DBG] pgmap v1219: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 21 KiB/s wr, 2 op/s 2024-09-17T09:10:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:17 smithi078 bash[22670]: cluster 2024-09-17T09:10:15.259674+0000 mgr.y (mgr.14532) 709 : cluster [DBG] pgmap v1219: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 21 KiB/s wr, 2 op/s 2024-09-17T09:10:18.224 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:10:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:10:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:10:18.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:18 smithi136 bash[24812]: cluster 2024-09-17T09:10:17.903569+0000 mon.a (mon.0) 3758 : cluster [WRN] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' is full (reached quota's max_objects: 10) 2024-09-17T09:10:18.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:18 smithi136 bash[24812]: cluster 2024-09-17T09:10:17.904074+0000 mon.a (mon.0) 3759 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:10:18.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:18 smithi136 bash[24812]: cluster 2024-09-17T09:10:17.912987+0000 mon.a (mon.0) 3760 : cluster [DBG] osdmap e763: 8 total, 8 up, 8 in 2024-09-17T09:10:18.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:18 smithi078 bash[22670]: cluster 2024-09-17T09:10:17.903569+0000 mon.a (mon.0) 3758 : cluster [WRN] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' is full (reached quota's max_objects: 10) 2024-09-17T09:10:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:18 smithi078 bash[22670]: cluster 2024-09-17T09:10:17.904074+0000 mon.a (mon.0) 3759 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:10:18.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:18 smithi078 bash[22670]: cluster 2024-09-17T09:10:17.912987+0000 mon.a (mon.0) 3760 : cluster [DBG] osdmap e763: 8 total, 8 up, 8 in 2024-09-17T09:10:18.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:18 smithi078 bash[32124]: cluster 2024-09-17T09:10:17.903569+0000 mon.a (mon.0) 3758 : cluster [WRN] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' is full (reached quota's max_objects: 10) 2024-09-17T09:10:18.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:18 smithi078 bash[32124]: cluster 2024-09-17T09:10:17.904074+0000 mon.a (mon.0) 3759 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:10:18.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:18 smithi078 bash[32124]: cluster 2024-09-17T09:10:17.912987+0000 mon.a (mon.0) 3760 : cluster [DBG] osdmap e763: 8 total, 8 up, 8 in 2024-09-17T09:10:19.541 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:19 smithi136 bash[24812]: cluster 2024-09-17T09:10:17.260381+0000 mgr.y (mgr.14532) 710 : cluster [DBG] pgmap v1220: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 16 KiB/s wr, 1 op/s 2024-09-17T09:10:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:19 smithi078 bash[22670]: cluster 2024-09-17T09:10:17.260381+0000 mgr.y (mgr.14532) 710 : cluster [DBG] pgmap v1220: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 16 KiB/s wr, 1 op/s 2024-09-17T09:10:19.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:19 smithi078 bash[32124]: cluster 2024-09-17T09:10:17.260381+0000 mgr.y (mgr.14532) 710 : cluster [DBG] pgmap v1220: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 16 KiB/s wr, 1 op/s 2024-09-17T09:10:20.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:10:20 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:10:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:20 smithi136 bash[24812]: cluster 2024-09-17T09:10:19.262228+0000 mgr.y (mgr.14532) 711 : cluster [DBG] pgmap v1222: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 16 KiB/s wr, 2 op/s 2024-09-17T09:10:20.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:20 smithi136 bash[24812]: audit 2024-09-17T09:10:20.158947+0000 mgr.y (mgr.14532) 712 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:20 smithi078 bash[32124]: cluster 2024-09-17T09:10:19.262228+0000 mgr.y (mgr.14532) 711 : cluster [DBG] pgmap v1222: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 16 KiB/s wr, 2 op/s 2024-09-17T09:10:20.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:20 smithi078 bash[32124]: audit 2024-09-17T09:10:20.158947+0000 mgr.y (mgr.14532) 712 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:20 smithi078 bash[22670]: cluster 2024-09-17T09:10:19.262228+0000 mgr.y (mgr.14532) 711 : cluster [DBG] pgmap v1222: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 16 KiB/s wr, 2 op/s 2024-09-17T09:10:20.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:20 smithi078 bash[22670]: audit 2024-09-17T09:10:20.158947+0000 mgr.y (mgr.14532) 712 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:22 smithi078 bash[32124]: cluster 2024-09-17T09:10:21.263071+0000 mgr.y (mgr.14532) 713 : cluster [DBG] pgmap v1223: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:10:22.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:22 smithi078 bash[22670]: cluster 2024-09-17T09:10:21.263071+0000 mgr.y (mgr.14532) 713 : cluster [DBG] pgmap v1223: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:10:22.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:22 smithi136 bash[24812]: cluster 2024-09-17T09:10:21.263071+0000 mgr.y (mgr.14532) 713 : cluster [DBG] pgmap v1223: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:10:24.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:24 smithi078 bash[32124]: cluster 2024-09-17T09:10:23.264875+0000 mgr.y (mgr.14532) 714 : cluster [DBG] pgmap v1224: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:24.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:24 smithi078 bash[22670]: cluster 2024-09-17T09:10:23.264875+0000 mgr.y (mgr.14532) 714 : cluster [DBG] pgmap v1224: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:24.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:24 smithi136 bash[24812]: cluster 2024-09-17T09:10:23.264875+0000 mgr.y (mgr.14532) 714 : cluster [DBG] pgmap v1224: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:26.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:26 smithi078 bash[32124]: cluster 2024-09-17T09:10:25.265691+0000 mgr.y (mgr.14532) 715 : cluster [DBG] pgmap v1225: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:26 smithi078 bash[22670]: cluster 2024-09-17T09:10:25.265691+0000 mgr.y (mgr.14532) 715 : cluster [DBG] pgmap v1225: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:26.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:26 smithi136 bash[24812]: cluster 2024-09-17T09:10:25.265691+0000 mgr.y (mgr.14532) 715 : cluster [DBG] pgmap v1225: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:28.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:27 smithi136 bash[24812]: audit 2024-09-17T09:10:26.941382+0000 mon.a (mon.0) 3761 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:10:28.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:27 smithi136 bash[24812]: audit 2024-09-17T09:10:26.943558+0000 mon.a (mon.0) 3762 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:28.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:10:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:10:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:10:28.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:27 smithi078 bash[22670]: audit 2024-09-17T09:10:26.941382+0000 mon.a (mon.0) 3761 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:10:28.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:27 smithi078 bash[22670]: audit 2024-09-17T09:10:26.943558+0000 mon.a (mon.0) 3762 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:28.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:27 smithi078 bash[32124]: audit 2024-09-17T09:10:26.941382+0000 mon.a (mon.0) 3761 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:10:28.355 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:27 smithi078 bash[32124]: audit 2024-09-17T09:10:26.943558+0000 mon.a (mon.0) 3762 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:29.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:28 smithi136 bash[24812]: cluster 2024-09-17T09:10:27.266429+0000 mgr.y (mgr.14532) 716 : cluster [DBG] pgmap v1226: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:29.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:28 smithi078 bash[32124]: cluster 2024-09-17T09:10:27.266429+0000 mgr.y (mgr.14532) 716 : cluster [DBG] pgmap v1226: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:29.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:28 smithi078 bash[22670]: cluster 2024-09-17T09:10:27.266429+0000 mgr.y (mgr.14532) 716 : cluster [DBG] pgmap v1226: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:30.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:10:30 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:10:31.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:30 smithi136 bash[24812]: cluster 2024-09-17T09:10:29.268259+0000 mgr.y (mgr.14532) 717 : cluster [DBG] pgmap v1227: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:10:31.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:30 smithi136 bash[24812]: audit 2024-09-17T09:10:30.170441+0000 mgr.y (mgr.14532) 718 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:30 smithi078 bash[32124]: cluster 2024-09-17T09:10:29.268259+0000 mgr.y (mgr.14532) 717 : cluster [DBG] pgmap v1227: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:10:31.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:30 smithi078 bash[32124]: audit 2024-09-17T09:10:30.170441+0000 mgr.y (mgr.14532) 718 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:30 smithi078 bash[22670]: cluster 2024-09-17T09:10:29.268259+0000 mgr.y (mgr.14532) 717 : cluster [DBG] pgmap v1227: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:10:31.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:30 smithi078 bash[22670]: audit 2024-09-17T09:10:30.170441+0000 mgr.y (mgr.14532) 718 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:33.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:32 smithi136 bash[24812]: cluster 2024-09-17T09:10:31.269093+0000 mgr.y (mgr.14532) 719 : cluster [DBG] pgmap v1228: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:33.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:32 smithi078 bash[32124]: cluster 2024-09-17T09:10:31.269093+0000 mgr.y (mgr.14532) 719 : cluster [DBG] pgmap v1228: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:33.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:32 smithi078 bash[22670]: cluster 2024-09-17T09:10:31.269093+0000 mgr.y (mgr.14532) 719 : cluster [DBG] pgmap v1228: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:35.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:34 smithi136 bash[24812]: cluster 2024-09-17T09:10:33.270899+0000 mgr.y (mgr.14532) 720 : cluster [DBG] pgmap v1229: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:35.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:34 smithi078 bash[32124]: cluster 2024-09-17T09:10:33.270899+0000 mgr.y (mgr.14532) 720 : cluster [DBG] pgmap v1229: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:35.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:34 smithi078 bash[22670]: cluster 2024-09-17T09:10:33.270899+0000 mgr.y (mgr.14532) 720 : cluster [DBG] pgmap v1229: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:36.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:35 smithi136 bash[24812]: audit 2024-09-17T09:10:35.648002+0000 mon.a (mon.0) 3763 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:36.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:35 smithi078 bash[32124]: audit 2024-09-17T09:10:35.648002+0000 mon.a (mon.0) 3763 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:36.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:35 smithi078 bash[22670]: audit 2024-09-17T09:10:35.648002+0000 mon.a (mon.0) 3763 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:37.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:36 smithi136 bash[24812]: cluster 2024-09-17T09:10:35.271647+0000 mgr.y (mgr.14532) 721 : cluster [DBG] pgmap v1230: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:37.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:36 smithi136 bash[24812]: audit 2024-09-17T09:10:36.209133+0000 mon.a (mon.0) 3764 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:37.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:36 smithi136 bash[24812]: audit 2024-09-17T09:10:36.211063+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:37.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:36 smithi136 bash[24812]: audit 2024-09-17T09:10:36.221430+0000 mon.a (mon.0) 3766 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:10:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[32124]: cluster 2024-09-17T09:10:35.271647+0000 mgr.y (mgr.14532) 721 : cluster [DBG] pgmap v1230: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[32124]: audit 2024-09-17T09:10:36.209133+0000 mon.a (mon.0) 3764 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:37.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[32124]: audit 2024-09-17T09:10:36.211063+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:37.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[32124]: audit 2024-09-17T09:10:36.221430+0000 mon.a (mon.0) 3766 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:10:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[22670]: cluster 2024-09-17T09:10:35.271647+0000 mgr.y (mgr.14532) 721 : cluster [DBG] pgmap v1230: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[22670]: audit 2024-09-17T09:10:36.209133+0000 mon.a (mon.0) 3764 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[22670]: audit 2024-09-17T09:10:36.211063+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:37.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:36 smithi078 bash[22670]: audit 2024-09-17T09:10:36.221430+0000 mon.a (mon.0) 3766 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:10:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:10:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:10:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:10:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:38 smithi136 bash[24812]: cluster 2024-09-17T09:10:37.272383+0000 mgr.y (mgr.14532) 722 : cluster [DBG] pgmap v1231: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:39.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:38 smithi078 bash[32124]: cluster 2024-09-17T09:10:37.272383+0000 mgr.y (mgr.14532) 722 : cluster [DBG] pgmap v1231: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:38 smithi078 bash[22670]: cluster 2024-09-17T09:10:37.272383+0000 mgr.y (mgr.14532) 722 : cluster [DBG] pgmap v1231: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:40.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:10:40 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:10:41.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:40 smithi136 bash[24812]: cluster 2024-09-17T09:10:39.274239+0000 mgr.y (mgr.14532) 723 : cluster [DBG] pgmap v1232: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:41.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:40 smithi136 bash[24812]: audit 2024-09-17T09:10:40.177782+0000 mgr.y (mgr.14532) 724 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:40 smithi078 bash[32124]: cluster 2024-09-17T09:10:39.274239+0000 mgr.y (mgr.14532) 723 : cluster [DBG] pgmap v1232: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:41.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:40 smithi078 bash[32124]: audit 2024-09-17T09:10:40.177782+0000 mgr.y (mgr.14532) 724 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:40 smithi078 bash[22670]: cluster 2024-09-17T09:10:39.274239+0000 mgr.y (mgr.14532) 723 : cluster [DBG] pgmap v1232: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:41.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:40 smithi078 bash[22670]: audit 2024-09-17T09:10:40.177782+0000 mgr.y (mgr.14532) 724 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:41.687 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=131477 2024-09-17T09:10:41.687 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 max_objects 100 2024-09-17T09:10:41.688 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put onemore /etc/passwd 2024-09-17T09:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 -- 172.21.15.78:0/2082988261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8301065f0 msgr2=0x7fa8301069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 --2- 172.21.15.78:0/2082988261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8301065f0 0x7fa8301069d0 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 crypto rx=0x7fa820009870 tx=0x7fa82001c720 comp rx=0 tx=0).stop 2024-09-17T09:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 -- 172.21.15.78:0/2082988261 shutdown_connections 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 --2- 172.21.15.78:0/2082988261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa83010b6a0 0x7fa830113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 --2- 172.21.15.78:0/2082988261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa830106fa0 0x7fa83010af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 --2- 172.21.15.78:0/2082988261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa8301065f0 0x7fa8301069d0 unknown :-1 s=CLOSED pgs=3255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 -- 172.21.15.78:0/2082988261 >> 172.21.15.78:0/2082988261 conn(0x7fa830075ca0 msgr2=0x7fa8300780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 -- 172.21.15.78:0/2082988261 shutdown_connections 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.810+0000 7fa836c7a640 1 -- 172.21.15.78:0/2082988261 wait complete. 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 Processor -- start 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 -- start start 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8301065f0 0x7fa8301a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa830106fa0 0x7fa8301a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:41.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa83010b6a0 0x7fa83019ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019f060 con 0x7fa8301065f0 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019f1d0 con 0x7fa83010b6a0 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019f390 con 0x7fa830106fa0 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8301065f0 0x7fa8301a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa82ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa830106fa0 0x7fa8301a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8301065f0 0x7fa8301a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53578/0 (socket says 172.21.15.78:53578) 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 -- 172.21.15.78:0/1315023680 learned_addr learned my addr 172.21.15.78:0/1315023680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 -- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa830106fa0 msgr2=0x7fa8301a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa830106fa0 0x7fa8301a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa835217640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa83010b6a0 0x7fa83019ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 -- 172.21.15.78:0/1315023680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa83010b6a0 msgr2=0x7fa83019ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:41.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa83010b6a0 0x7fa83019ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa824009560 con 0x7fa8301065f0 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa82ffff640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa830106fa0 0x7fa8301a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa835217640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa83010b6a0 0x7fa83019ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa834a16640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8301065f0 0x7fa8301a4920 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7fa8200057d0 tx=0x7fa8200ad620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200ba070 con 0x7fa8301065f0 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8200094a0 con 0x7fa8301065f0 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa8200a5520 con 0x7fa8301065f0 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820003800 con 0x7fa8301065f0 2024-09-17T09:10:41.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8301ab740 con 0x7fa8301065f0 2024-09-17T09:10:41.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa830107a50 con 0x7fa8301065f0 2024-09-17T09:10:41.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fa8200b4040 con 0x7fa8301065f0 2024-09-17T09:10:41.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.814+0000 7fa82dffb640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa81806ce30 0x7fa81806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:41.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.818+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(763..763 src has 1..763) v4 ==== 9079+0+0 (secure 0 0 0) 0x7fa8200a5e40 con 0x7fa8301065f0 2024-09-17T09:10:41.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.818+0000 7fa82ffff640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa81806ce30 0x7fa81806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:41.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.818+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=764}) v3 -- 0x7fa818078730 con 0x7fa8301065f0 2024-09-17T09:10:41.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.818+0000 7fa82ffff640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa81806ce30 0x7fa81806f2f0 secure :-1 s=READY pgs=3620 cs=0 l=1 rev1=1 crypto rx=0x7fa83019fe80 tx=0x7fa824009260 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:41.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.822+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa8200b2060 con 0x7fa8301065f0 2024-09-17T09:10:42.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:41.998+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fa83019ff20 con 0x7fa8301065f0 2024-09-17T09:10:42.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:41 smithi136 bash[24812]: audit 2024-09-17T09:10:41.971331+0000 mon.a (mon.0) 3767 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:41 smithi078 bash[22670]: audit 2024-09-17T09:10:41.971331+0000 mon.a (mon.0) 3767 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:41 smithi078 bash[32124]: audit 2024-09-17T09:10:41.971331+0000 mon.a (mon.0) 3767 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:42.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:42.994+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 7 ==== osd_map(764..764 src has 1..764) v4 ==== 628+0+0 (secure 0 0 0) 0x7fa8200a5690 con 0x7fa8301065f0 2024-09-17T09:10:42.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:42.994+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=765}) v3 -- 0x7fa818079290 con 0x7fa8301065f0 2024-09-17T09:10:43.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:43.010+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v764) v1 ==== 225+0+0 (secure 0 0 0) 0x7fa8200f0030 con 0x7fa8301065f0 2024-09-17T09:10:43.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:43.114+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fa83019ff20 con 0x7fa8301065f0 2024-09-17T09:10:43.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:42 smithi136 bash[24812]: cluster 2024-09-17T09:10:41.275056+0000 mgr.y (mgr.14532) 725 : cluster [DBG] pgmap v1233: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:43.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:42 smithi136 bash[24812]: audit 2024-09-17T09:10:42.004453+0000 mon.a (mon.0) 3768 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]: dispatch 2024-09-17T09:10:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:42 smithi078 bash[32124]: cluster 2024-09-17T09:10:41.275056+0000 mgr.y (mgr.14532) 725 : cluster [DBG] pgmap v1233: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:42 smithi078 bash[32124]: audit 2024-09-17T09:10:42.004453+0000 mon.a (mon.0) 3768 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]: dispatch 2024-09-17T09:10:43.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:42 smithi078 bash[22670]: cluster 2024-09-17T09:10:41.275056+0000 mgr.y (mgr.14532) 725 : cluster [DBG] pgmap v1233: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:10:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:42 smithi078 bash[22670]: audit 2024-09-17T09:10:42.004453+0000 mon.a (mon.0) 3768 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]: dispatch 2024-09-17T09:10:44.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.010+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 9 ==== osd_map(765..765 src has 1..765) v4 ==== 628+0+0 (secure 0 0 0) 0x7fa8200f4c60 con 0x7fa8301065f0 2024-09-17T09:10:44.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.010+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=766}) v3 -- 0x7fa8180796c0 con 0x7fa8301065f0 2024-09-17T09:10:44.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.018+0000 7fa82dffb640 1 -- 172.21.15.78:0/1315023680 <== mon.0 v2:172.21.15.78:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v765) v1 ==== 225+0+0 (secure 0 0 0) 0x7fa8200b20d0 con 0x7fa8301065f0 2024-09-17T09:10:44.019 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_objects = 100 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa81806ce30 msgr2=0x7fa81806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa81806ce30 0x7fa81806f2f0 secure :-1 s=READY pgs=3620 cs=0 l=1 rev1=1 crypto rx=0x7fa83019fe80 tx=0x7fa824009260 comp rx=0 tx=0).stop 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8301065f0 msgr2=0x7fa8301a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8301065f0 0x7fa8301a4920 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7fa8200057d0 tx=0x7fa8200ad620 comp rx=0 tx=0).stop 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 shutdown_connections 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fa81806ce30 0x7fa81806f2f0 unknown :-1 s=CLOSED pgs=3620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa83010b6a0 0x7fa83019ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa830106fa0 0x7fa8301a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 --2- 172.21.15.78:0/1315023680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8301065f0 0x7fa8301a4920 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:44.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 >> 172.21.15.78:0/1315023680 conn(0x7fa830075ca0 msgr2=0x7fa830076460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:44.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 shutdown_connections 2024-09-17T09:10:44.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:44.026+0000 7fa836c7a640 1 -- 172.21.15.78:0/1315023680 wait complete. 2024-09-17T09:10:44.043 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 131477 2024-09-17T09:10:44.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:44 smithi136 bash[24812]: audit 2024-09-17T09:10:43.006409+0000 mon.a (mon.0) 3769 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]': finished 2024-09-17T09:10:44.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:44 smithi136 bash[24812]: cluster 2024-09-17T09:10:43.006612+0000 mon.a (mon.0) 3770 : cluster [DBG] osdmap e764: 8 total, 8 up, 8 in 2024-09-17T09:10:44.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:44 smithi136 bash[24812]: audit 2024-09-17T09:10:43.120585+0000 mon.a (mon.0) 3771 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]: dispatch 2024-09-17T09:10:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:44 smithi078 bash[32124]: audit 2024-09-17T09:10:43.006409+0000 mon.a (mon.0) 3769 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]': finished 2024-09-17T09:10:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:44 smithi078 bash[32124]: cluster 2024-09-17T09:10:43.006612+0000 mon.a (mon.0) 3770 : cluster [DBG] osdmap e764: 8 total, 8 up, 8 in 2024-09-17T09:10:44.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:44 smithi078 bash[32124]: audit 2024-09-17T09:10:43.120585+0000 mon.a (mon.0) 3771 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]: dispatch 2024-09-17T09:10:44.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:44 smithi078 bash[22670]: audit 2024-09-17T09:10:43.006409+0000 mon.a (mon.0) 3769 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]': finished 2024-09-17T09:10:44.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:44 smithi078 bash[22670]: cluster 2024-09-17T09:10:43.006612+0000 mon.a (mon.0) 3770 : cluster [DBG] osdmap e764: 8 total, 8 up, 8 in 2024-09-17T09:10:44.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:44 smithi078 bash[22670]: audit 2024-09-17T09:10:43.120585+0000 mon.a (mon.0) 3771 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]: dispatch 2024-09-17T09:10:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:45 smithi136 bash[24812]: cluster 2024-09-17T09:10:43.276781+0000 mgr.y (mgr.14532) 726 : cluster [DBG] pgmap v1235: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:45 smithi136 bash[24812]: audit 2024-09-17T09:10:44.020315+0000 mon.a (mon.0) 3772 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]': finished 2024-09-17T09:10:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:45 smithi136 bash[24812]: cluster 2024-09-17T09:10:44.020487+0000 mon.a (mon.0) 3773 : cluster [DBG] osdmap e765: 8 total, 8 up, 8 in 2024-09-17T09:10:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:45 smithi078 bash[22670]: cluster 2024-09-17T09:10:43.276781+0000 mgr.y (mgr.14532) 726 : cluster [DBG] pgmap v1235: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:45 smithi078 bash[22670]: audit 2024-09-17T09:10:44.020315+0000 mon.a (mon.0) 3772 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]': finished 2024-09-17T09:10:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:45 smithi078 bash[22670]: cluster 2024-09-17T09:10:44.020487+0000 mon.a (mon.0) 3773 : cluster [DBG] osdmap e765: 8 total, 8 up, 8 in 2024-09-17T09:10:45.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:45 smithi078 bash[32124]: cluster 2024-09-17T09:10:43.276781+0000 mgr.y (mgr.14532) 726 : cluster [DBG] pgmap v1235: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:10:45.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:45 smithi078 bash[32124]: audit 2024-09-17T09:10:44.020315+0000 mon.a (mon.0) 3772 : audit [INF] from='client.? 172.21.15.78:0/1315023680' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "100"}]': finished 2024-09-17T09:10:45.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:45 smithi078 bash[32124]: cluster 2024-09-17T09:10:44.020487+0000 mon.a (mon.0) 3773 : cluster [DBG] osdmap e765: 8 total, 8 up, 8 in 2024-09-17T09:10:47.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:47 smithi136 bash[24812]: cluster 2024-09-17T09:10:45.277649+0000 mgr.y (mgr.14532) 727 : cluster [DBG] pgmap v1237: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:47 smithi078 bash[22670]: cluster 2024-09-17T09:10:45.277649+0000 mgr.y (mgr.14532) 727 : cluster [DBG] pgmap v1237: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:47 smithi078 bash[32124]: cluster 2024-09-17T09:10:45.277649+0000 mgr.y (mgr.14532) 727 : cluster [DBG] pgmap v1237: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:10:47.935 INFO:tasks.workunit.client.0.smithi078.stderr:+ [ 0 -ne 0 ] 2024-09-17T09:10:47.935 INFO:tasks.workunit.client.0.smithi078.stderr:+ true 2024-09-17T09:10:47.936 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put twomore /etc/passwd 2024-09-17T09:10:47.980 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 max_bytes 100 2024-09-17T09:10:48.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- 172.21.15.78:0/2027577495 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff330102b20 msgr2=0x7ff330106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:48.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 --2- 172.21.15.78:0/2027577495 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff330102b20 0x7ff330106b70 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 crypto rx=0x7ff318009930 tx=0x7ff31801c7e0 comp rx=0 tx=0).stop 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- 172.21.15.78:0/2027577495 shutdown_connections 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 --2- 172.21.15.78:0/2027577495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3301072a0 0x7ff33010ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 --2- 172.21.15.78:0/2027577495 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff330102b20 0x7ff330106b70 unknown :-1 s=CLOSED pgs=3259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 --2- 172.21.15.78:0/2027577495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff330102170 0x7ff330102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- 172.21.15.78:0/2027577495 >> 172.21.15.78:0/2027577495 conn(0x7ff3300fdc10 msgr2=0x7ff330100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- 172.21.15.78:0/2027577495 shutdown_connections 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- 172.21.15.78:0/2027577495 wait complete. 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 Processor -- start 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- start start 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff330102170 0x7ff33019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:48.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff330102b20 0x7ff33019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3301072a0 0x7ff33019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33019fe30 con 0x7ff330102170 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33019ffa0 con 0x7ff330102b20 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3301a0110 con 0x7ff3301072a0 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3301072a0 0x7ff33019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3301072a0 0x7ff33019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:36358/0 (socket says 172.21.15.78:36358) 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 -- 172.21.15.78:0/3403121368 learned_addr learned my addr 172.21.15.78:0/3403121368 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32ed9d640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff330102170 0x7ff33019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 -- 172.21.15.78:0/3403121368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff330102b20 msgr2=0x7ff33019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff330102b20 0x7ff33019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 -- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff330102170 msgr2=0x7ff33019aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff330102170 0x7ff33019aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 -- 172.21.15.78:0/3403121368 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280094a0 con 0x7ff3301072a0 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32ed9d640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff330102170 0x7ff33019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff32f59e640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3301072a0 0x7ff33019f830 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7ff328009fd0 tx=0x7ff32800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32800cd80 con 0x7ff3301072a0 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7ff328004470 con 0x7ff3301072a0 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328003de0 con 0x7ff3301072a0 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff318009560 con 0x7ff3301072a0 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.102+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3301a7ae0 con 0x7ff3301072a0 2024-09-17T09:10:48.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.106+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff330103650 con 0x7ff3301072a0 2024-09-17T09:10:48.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.106+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7ff328003f80 con 0x7ff3301072a0 2024-09-17T09:10:48.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.106+0000 7ff327fff640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff31c06ce30 0x7ff31c06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:10:48.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.106+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(766..766 src has 1..766) v4 ==== 9079+0+0 (secure 0 0 0) 0x7ff328014070 con 0x7ff3301072a0 2024-09-17T09:10:48.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.106+0000 7ff32ed9d640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff31c06ce30 0x7ff31c06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:10:48.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.106+0000 7ff32ed9d640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff31c06ce30 0x7ff31c06f2f0 secure :-1 s=READY pgs=3622 cs=0 l=1 rev1=1 crypto rx=0x7ff320009fa0 tx=0x7ff320009570 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:10:48.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.110+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff328056bd0 con 0x7ff3301072a0 2024-09-17T09:10:48.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:48.282+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7ff33019c250 con 0x7ff3301072a0 2024-09-17T09:10:48.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:48 smithi136 bash[24812]: cluster 2024-09-17T09:10:47.911025+0000 mon.a (mon.0) 3774 : cluster [INF] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' no longer out of quota; removing NO_QUOTA flag 2024-09-17T09:10:48.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:48 smithi136 bash[24812]: cluster 2024-09-17T09:10:47.911517+0000 mon.a (mon.0) 3775 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:10:48.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:48 smithi136 bash[24812]: cluster 2024-09-17T09:10:47.922799+0000 mon.a (mon.0) 3776 : cluster [DBG] osdmap e766: 8 total, 8 up, 8 in 2024-09-17T09:10:48.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:10:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:10:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:10:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:48 smithi078 bash[22670]: cluster 2024-09-17T09:10:47.911025+0000 mon.a (mon.0) 3774 : cluster [INF] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' no longer out of quota; removing NO_QUOTA flag 2024-09-17T09:10:48.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:48 smithi078 bash[22670]: cluster 2024-09-17T09:10:47.911517+0000 mon.a (mon.0) 3775 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:10:48.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:48 smithi078 bash[22670]: cluster 2024-09-17T09:10:47.922799+0000 mon.a (mon.0) 3776 : cluster [DBG] osdmap e766: 8 total, 8 up, 8 in 2024-09-17T09:10:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:48 smithi078 bash[32124]: cluster 2024-09-17T09:10:47.911025+0000 mon.a (mon.0) 3774 : cluster [INF] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' no longer out of quota; removing NO_QUOTA flag 2024-09-17T09:10:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:48 smithi078 bash[32124]: cluster 2024-09-17T09:10:47.911517+0000 mon.a (mon.0) 3775 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:10:48.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:48 smithi078 bash[32124]: cluster 2024-09-17T09:10:47.922799+0000 mon.a (mon.0) 3776 : cluster [DBG] osdmap e766: 8 total, 8 up, 8 in 2024-09-17T09:10:49.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:49.042+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v767) v1 ==== 221+0+0 (secure 0 0 0) 0x7ff32805a1f0 con 0x7ff3301072a0 2024-09-17T09:10:49.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:49.150+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7ff330114820 con 0x7ff3301072a0 2024-09-17T09:10:49.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:49 smithi136 bash[24812]: cluster 2024-09-17T09:10:47.278567+0000 mgr.y (mgr.14532) 728 : cluster [DBG] pgmap v1238: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:10:49.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:49 smithi136 bash[24812]: audit 2024-09-17T09:10:48.283929+0000 mon.c (mon.2) 324 : audit [INF] from='client.? 172.21.15.78:0/3403121368' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:49.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:49 smithi136 bash[24812]: audit 2024-09-17T09:10:48.284667+0000 mon.a (mon.0) 3777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:49.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:49 smithi078 bash[22670]: cluster 2024-09-17T09:10:47.278567+0000 mgr.y (mgr.14532) 728 : cluster [DBG] pgmap v1238: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:10:49.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:49 smithi078 bash[22670]: audit 2024-09-17T09:10:48.283929+0000 mon.c (mon.2) 324 : audit [INF] from='client.? 172.21.15.78:0/3403121368' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:49.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:49 smithi078 bash[22670]: audit 2024-09-17T09:10:48.284667+0000 mon.a (mon.0) 3777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:49 smithi078 bash[32124]: cluster 2024-09-17T09:10:47.278567+0000 mgr.y (mgr.14532) 728 : cluster [DBG] pgmap v1238: 176 pgs: 176 active+clean; 710 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:10:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:49 smithi078 bash[32124]: audit 2024-09-17T09:10:48.283929+0000 mon.c (mon.2) 324 : audit [INF] from='client.? 172.21.15.78:0/3403121368' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:49 smithi078 bash[32124]: audit 2024-09-17T09:10:48.284667+0000 mon.a (mon.0) 3777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:50.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.046+0000 7ff327fff640 1 -- 172.21.15.78:0/3403121368 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v768) v1 ==== 221+0+0 (secure 0 0 0) 0x7ff32805a3d0 con 0x7ff3301072a0 2024-09-17T09:10:50.046 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_bytes = 100 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff31c06ce30 msgr2=0x7ff31c06f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff31c06ce30 0x7ff31c06f2f0 secure :-1 s=READY pgs=3622 cs=0 l=1 rev1=1 crypto rx=0x7ff320009fa0 tx=0x7ff320009570 comp rx=0 tx=0).stop 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3301072a0 msgr2=0x7ff33019f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3301072a0 0x7ff33019f830 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7ff328009fd0 tx=0x7ff32800ee40 comp rx=0 tx=0).stop 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 shutdown_connections 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7ff31c06ce30 0x7ff31c06f2f0 unknown :-1 s=CLOSED pgs=3622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3301072a0 0x7ff33019f830 unknown :-1 s=CLOSED pgs=3260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff330102b20 0x7ff33019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 --2- 172.21.15.78:0/3403121368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff330102170 0x7ff33019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 >> 172.21.15.78:0/3403121368 conn(0x7ff3300fdc10 msgr2=0x7ff3300fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:10:50.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 shutdown_connections 2024-09-17T09:10:50.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:10:50.050+0000 7ff335219640 1 -- 172.21.15.78:0/3403121368 wait complete. 2024-09-17T09:10:50.068 INFO:tasks.workunit.client.0.smithi078.stderr:+ sleep 30 2024-09-17T09:10:50.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[22670]: audit 2024-09-17T09:10:49.043168+0000 mon.a (mon.0) 3778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]': finished 2024-09-17T09:10:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[22670]: cluster 2024-09-17T09:10:49.043357+0000 mon.a (mon.0) 3779 : cluster [DBG] osdmap e767: 8 total, 8 up, 8 in 2024-09-17T09:10:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[22670]: audit 2024-09-17T09:10:49.153927+0000 mon.c (mon.2) 325 : audit [INF] from='client.? 172.21.15.78:0/3403121368' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:50.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[22670]: audit 2024-09-17T09:10:49.154402+0000 mon.a (mon.0) 3780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[32124]: audit 2024-09-17T09:10:49.043168+0000 mon.a (mon.0) 3778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]': finished 2024-09-17T09:10:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[32124]: cluster 2024-09-17T09:10:49.043357+0000 mon.a (mon.0) 3779 : cluster [DBG] osdmap e767: 8 total, 8 up, 8 in 2024-09-17T09:10:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[32124]: audit 2024-09-17T09:10:49.153927+0000 mon.c (mon.2) 325 : audit [INF] from='client.? 172.21.15.78:0/3403121368' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:50.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:50 smithi078 bash[32124]: audit 2024-09-17T09:10:49.154402+0000 mon.a (mon.0) 3780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:50.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:10:50 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:10:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:50 smithi136 bash[24812]: audit 2024-09-17T09:10:49.043168+0000 mon.a (mon.0) 3778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]': finished 2024-09-17T09:10:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:50 smithi136 bash[24812]: cluster 2024-09-17T09:10:49.043357+0000 mon.a (mon.0) 3779 : cluster [DBG] osdmap e767: 8 total, 8 up, 8 in 2024-09-17T09:10:50.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:50 smithi136 bash[24812]: audit 2024-09-17T09:10:49.153927+0000 mon.c (mon.2) 325 : audit [INF] from='client.? 172.21.15.78:0/3403121368' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:50.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:50 smithi136 bash[24812]: audit 2024-09-17T09:10:49.154402+0000 mon.a (mon.0) 3780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-17T09:10:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[22670]: cluster 2024-09-17T09:10:49.279331+0000 mgr.y (mgr.14532) 729 : cluster [DBG] pgmap v1241: 176 pgs: 176 active+clean; 736 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-17T09:10:51.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[22670]: audit 2024-09-17T09:10:50.044267+0000 mon.a (mon.0) 3781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]': finished 2024-09-17T09:10:51.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[22670]: cluster 2024-09-17T09:10:50.044453+0000 mon.a (mon.0) 3782 : cluster [DBG] osdmap e768: 8 total, 8 up, 8 in 2024-09-17T09:10:51.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[22670]: audit 2024-09-17T09:10:50.186930+0000 mgr.y (mgr.14532) 730 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[32124]: cluster 2024-09-17T09:10:49.279331+0000 mgr.y (mgr.14532) 729 : cluster [DBG] pgmap v1241: 176 pgs: 176 active+clean; 736 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-17T09:10:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[32124]: audit 2024-09-17T09:10:50.044267+0000 mon.a (mon.0) 3781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]': finished 2024-09-17T09:10:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[32124]: cluster 2024-09-17T09:10:50.044453+0000 mon.a (mon.0) 3782 : cluster [DBG] osdmap e768: 8 total, 8 up, 8 in 2024-09-17T09:10:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:51 smithi078 bash[32124]: audit 2024-09-17T09:10:50.186930+0000 mgr.y (mgr.14532) 730 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:51 smithi136 bash[24812]: cluster 2024-09-17T09:10:49.279331+0000 mgr.y (mgr.14532) 729 : cluster [DBG] pgmap v1241: 176 pgs: 176 active+clean; 736 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-17T09:10:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:51 smithi136 bash[24812]: audit 2024-09-17T09:10:50.044267+0000 mon.a (mon.0) 3781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "100"}]': finished 2024-09-17T09:10:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:51 smithi136 bash[24812]: cluster 2024-09-17T09:10:50.044453+0000 mon.a (mon.0) 3782 : cluster [DBG] osdmap e768: 8 total, 8 up, 8 in 2024-09-17T09:10:51.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:51 smithi136 bash[24812]: audit 2024-09-17T09:10:50.186930+0000 mgr.y (mgr.14532) 730 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:10:53.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[32124]: cluster 2024-09-17T09:10:51.280208+0000 mgr.y (mgr.14532) 731 : cluster [DBG] pgmap v1243: 176 pgs: 176 active+clean; 736 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-17T09:10:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[32124]: cluster 2024-09-17T09:10:52.913196+0000 mon.a (mon.0) 3783 : cluster [WRN] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' is full (reached quota's max_bytes: 100 B) 2024-09-17T09:10:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[32124]: cluster 2024-09-17T09:10:52.913685+0000 mon.a (mon.0) 3784 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:10:53.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[32124]: cluster 2024-09-17T09:10:52.923592+0000 mon.a (mon.0) 3785 : cluster [DBG] osdmap e769: 8 total, 8 up, 8 in 2024-09-17T09:10:53.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[22670]: cluster 2024-09-17T09:10:51.280208+0000 mgr.y (mgr.14532) 731 : cluster [DBG] pgmap v1243: 176 pgs: 176 active+clean; 736 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-17T09:10:53.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[22670]: cluster 2024-09-17T09:10:52.913196+0000 mon.a (mon.0) 3783 : cluster [WRN] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' is full (reached quota's max_bytes: 100 B) 2024-09-17T09:10:53.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[22670]: cluster 2024-09-17T09:10:52.913685+0000 mon.a (mon.0) 3784 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:10:53.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:53 smithi078 bash[22670]: cluster 2024-09-17T09:10:52.923592+0000 mon.a (mon.0) 3785 : cluster [DBG] osdmap e769: 8 total, 8 up, 8 in 2024-09-17T09:10:53.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:53 smithi136 bash[24812]: cluster 2024-09-17T09:10:51.280208+0000 mgr.y (mgr.14532) 731 : cluster [DBG] pgmap v1243: 176 pgs: 176 active+clean; 736 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-17T09:10:53.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:53 smithi136 bash[24812]: cluster 2024-09-17T09:10:52.913196+0000 mon.a (mon.0) 3783 : cluster [WRN] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' is full (reached quota's max_bytes: 100 B) 2024-09-17T09:10:53.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:53 smithi136 bash[24812]: cluster 2024-09-17T09:10:52.913685+0000 mon.a (mon.0) 3784 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:10:53.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:53 smithi136 bash[24812]: cluster 2024-09-17T09:10:52.923592+0000 mon.a (mon.0) 3785 : cluster [DBG] osdmap e769: 8 total, 8 up, 8 in 2024-09-17T09:10:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:55 smithi078 bash[32124]: cluster 2024-09-17T09:10:53.282184+0000 mgr.y (mgr.14532) 732 : cluster [DBG] pgmap v1245: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.8 KiB/s wr, 2 op/s 2024-09-17T09:10:55.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:55 smithi078 bash[22670]: cluster 2024-09-17T09:10:53.282184+0000 mgr.y (mgr.14532) 732 : cluster [DBG] pgmap v1245: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.8 KiB/s wr, 2 op/s 2024-09-17T09:10:55.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:55 smithi136 bash[24812]: cluster 2024-09-17T09:10:53.282184+0000 mgr.y (mgr.14532) 732 : cluster [DBG] pgmap v1245: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.8 KiB/s wr, 2 op/s 2024-09-17T09:10:57.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:57 smithi078 bash[32124]: cluster 2024-09-17T09:10:55.283103+0000 mgr.y (mgr.14532) 733 : cluster [DBG] pgmap v1246: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s 2024-09-17T09:10:57.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:57 smithi078 bash[32124]: audit 2024-09-17T09:10:57.004168+0000 mon.a (mon.0) 3786 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:57.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:57 smithi078 bash[22670]: cluster 2024-09-17T09:10:55.283103+0000 mgr.y (mgr.14532) 733 : cluster [DBG] pgmap v1246: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s 2024-09-17T09:10:57.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:57 smithi078 bash[22670]: audit 2024-09-17T09:10:57.004168+0000 mon.a (mon.0) 3786 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:57.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:57 smithi136 bash[24812]: cluster 2024-09-17T09:10:55.283103+0000 mgr.y (mgr.14532) 733 : cluster [DBG] pgmap v1246: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s 2024-09-17T09:10:57.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:57 smithi136 bash[24812]: audit 2024-09-17T09:10:57.004168+0000 mon.a (mon.0) 3786 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:10:58.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:10:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:10:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:10:59.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:10:59 smithi078 bash[22670]: cluster 2024-09-17T09:10:57.283908+0000 mgr.y (mgr.14532) 734 : cluster [DBG] pgmap v1247: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:10:59.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:10:59 smithi078 bash[32124]: cluster 2024-09-17T09:10:57.283908+0000 mgr.y (mgr.14532) 734 : cluster [DBG] pgmap v1247: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:10:59.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:10:59 smithi136 bash[24812]: cluster 2024-09-17T09:10:57.283908+0000 mgr.y (mgr.14532) 734 : cluster [DBG] pgmap v1247: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:11:00.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:11:00 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:11:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:01 smithi078 bash[22670]: cluster 2024-09-17T09:10:59.285785+0000 mgr.y (mgr.14532) 735 : cluster [DBG] pgmap v1248: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:11:01.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:01 smithi078 bash[22670]: audit 2024-09-17T09:11:00.198331+0000 mgr.y (mgr.14532) 736 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:01.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:01 smithi078 bash[32124]: cluster 2024-09-17T09:10:59.285785+0000 mgr.y (mgr.14532) 735 : cluster [DBG] pgmap v1248: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:11:01.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:01 smithi078 bash[32124]: audit 2024-09-17T09:11:00.198331+0000 mgr.y (mgr.14532) 736 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:01.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:01 smithi136 bash[24812]: cluster 2024-09-17T09:10:59.285785+0000 mgr.y (mgr.14532) 735 : cluster [DBG] pgmap v1248: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T09:11:01.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:01 smithi136 bash[24812]: audit 2024-09-17T09:11:00.198331+0000 mgr.y (mgr.14532) 736 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:03 smithi078 bash[22670]: cluster 2024-09-17T09:11:01.286569+0000 mgr.y (mgr.14532) 737 : cluster [DBG] pgmap v1249: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:11:03.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:03 smithi078 bash[32124]: cluster 2024-09-17T09:11:01.286569+0000 mgr.y (mgr.14532) 737 : cluster [DBG] pgmap v1249: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:11:03.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:03 smithi136 bash[24812]: cluster 2024-09-17T09:11:01.286569+0000 mgr.y (mgr.14532) 737 : cluster [DBG] pgmap v1249: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:11:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:05 smithi078 bash[22670]: cluster 2024-09-17T09:11:03.288417+0000 mgr.y (mgr.14532) 738 : cluster [DBG] pgmap v1250: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T09:11:05.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:05 smithi078 bash[32124]: cluster 2024-09-17T09:11:03.288417+0000 mgr.y (mgr.14532) 738 : cluster [DBG] pgmap v1250: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T09:11:05.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:05 smithi136 bash[24812]: cluster 2024-09-17T09:11:03.288417+0000 mgr.y (mgr.14532) 738 : cluster [DBG] pgmap v1250: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T09:11:07.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:07 smithi078 bash[22670]: cluster 2024-09-17T09:11:05.289118+0000 mgr.y (mgr.14532) 739 : cluster [DBG] pgmap v1251: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:07.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:07 smithi078 bash[32124]: cluster 2024-09-17T09:11:05.289118+0000 mgr.y (mgr.14532) 739 : cluster [DBG] pgmap v1251: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:07.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:07 smithi136 bash[24812]: cluster 2024-09-17T09:11:05.289118+0000 mgr.y (mgr.14532) 739 : cluster [DBG] pgmap v1251: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:08.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:11:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:11:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:11:09.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:09 smithi078 bash[32124]: cluster 2024-09-17T09:11:07.289915+0000 mgr.y (mgr.14532) 740 : cluster [DBG] pgmap v1252: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:09.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:09 smithi078 bash[22670]: cluster 2024-09-17T09:11:07.289915+0000 mgr.y (mgr.14532) 740 : cluster [DBG] pgmap v1252: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:09.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:09 smithi136 bash[24812]: cluster 2024-09-17T09:11:07.289915+0000 mgr.y (mgr.14532) 740 : cluster [DBG] pgmap v1252: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:10.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:11:10 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:11:11.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:11 smithi078 bash[22670]: cluster 2024-09-17T09:11:09.291809+0000 mgr.y (mgr.14532) 741 : cluster [DBG] pgmap v1253: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:11.356 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:11 smithi078 bash[22670]: audit 2024-09-17T09:11:10.209739+0000 mgr.y (mgr.14532) 742 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:11.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:11 smithi078 bash[32124]: cluster 2024-09-17T09:11:09.291809+0000 mgr.y (mgr.14532) 741 : cluster [DBG] pgmap v1253: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:11.356 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:11 smithi078 bash[32124]: audit 2024-09-17T09:11:10.209739+0000 mgr.y (mgr.14532) 742 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:11.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:11 smithi136 bash[24812]: cluster 2024-09-17T09:11:09.291809+0000 mgr.y (mgr.14532) 741 : cluster [DBG] pgmap v1253: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:11.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:11 smithi136 bash[24812]: audit 2024-09-17T09:11:10.209739+0000 mgr.y (mgr.14532) 742 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:12.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:12 smithi136 bash[24812]: audit 2024-09-17T09:11:12.032939+0000 mon.a (mon.0) 3787 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:12.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:12 smithi078 bash[22670]: audit 2024-09-17T09:11:12.032939+0000 mon.a (mon.0) 3787 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:12.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:12 smithi078 bash[32124]: audit 2024-09-17T09:11:12.032939+0000 mon.a (mon.0) 3787 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:13.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:13 smithi136 bash[24812]: cluster 2024-09-17T09:11:11.292522+0000 mgr.y (mgr.14532) 743 : cluster [DBG] pgmap v1254: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:13 smithi078 bash[22670]: cluster 2024-09-17T09:11:11.292522+0000 mgr.y (mgr.14532) 743 : cluster [DBG] pgmap v1254: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:13.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:13 smithi078 bash[32124]: cluster 2024-09-17T09:11:11.292522+0000 mgr.y (mgr.14532) 743 : cluster [DBG] pgmap v1254: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:15.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:15 smithi136 bash[24812]: cluster 2024-09-17T09:11:13.294358+0000 mgr.y (mgr.14532) 744 : cluster [DBG] pgmap v1255: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:15 smithi078 bash[22670]: cluster 2024-09-17T09:11:13.294358+0000 mgr.y (mgr.14532) 744 : cluster [DBG] pgmap v1255: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:15.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:15 smithi078 bash[32124]: cluster 2024-09-17T09:11:13.294358+0000 mgr.y (mgr.14532) 744 : cluster [DBG] pgmap v1255: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:17.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:17 smithi136 bash[24812]: cluster 2024-09-17T09:11:15.295134+0000 mgr.y (mgr.14532) 745 : cluster [DBG] pgmap v1256: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:17 smithi078 bash[22670]: cluster 2024-09-17T09:11:15.295134+0000 mgr.y (mgr.14532) 745 : cluster [DBG] pgmap v1256: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:17.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:17 smithi078 bash[32124]: cluster 2024-09-17T09:11:15.295134+0000 mgr.y (mgr.14532) 745 : cluster [DBG] pgmap v1256: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:18.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:11:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:11:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:11:19.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:19 smithi136 bash[24812]: cluster 2024-09-17T09:11:17.295872+0000 mgr.y (mgr.14532) 746 : cluster [DBG] pgmap v1257: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:19 smithi078 bash[22670]: cluster 2024-09-17T09:11:17.295872+0000 mgr.y (mgr.14532) 746 : cluster [DBG] pgmap v1257: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:19 smithi078 bash[32124]: cluster 2024-09-17T09:11:17.295872+0000 mgr.y (mgr.14532) 746 : cluster [DBG] pgmap v1257: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:20.070 INFO:tasks.workunit.client.0.smithi078.stderr:+ pid=131567 2024-09-17T09:11:20.070 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 max_bytes 0 2024-09-17T09:11:20.071 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put two /etc/passwd 2024-09-17T09:11:20.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1268792696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 msgr2=0x7fb030109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:20.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1268792696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb030109cc0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fb020009870 tx=0x7fb02001c7b0 comp rx=0 tx=0).stop 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1268792696 shutdown_connections 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1268792696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 0x7fb03010c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1268792696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb030109cc0 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1268792696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb030100eb0 0x7fb030101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1268792696 >> 172.21.15.78:0/1268792696 conn(0x7fb0300fa910 msgr2=0x7fb0300fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1268792696 shutdown_connections 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1268792696 wait complete. 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 Processor -- start 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- start start 2024-09-17T09:11:20.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb030100eb0 0x7fb030197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb0301984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 0x7fb03019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03019cef0 con 0x7fb0301017d0 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03019d060 con 0x7fb030100eb0 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03019d1d0 con 0x7fb03010a2e0 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb0301984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0363b8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 0x7fb03019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb0301984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41864/0 (socket says 172.21.15.78:41864) 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 -- 172.21.15.78:0/1128942921 learned_addr learned my addr 172.21.15.78:0/1128942921 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0363b8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 0x7fb03019c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55680/0 (socket says 172.21.15.78:55680) 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb035bb7640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb030100eb0 0x7fb030197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:20.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 -- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 msgr2=0x7fb03019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 0x7fb03019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 -- 172.21.15.78:0/1128942921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb030100eb0 msgr2=0x7fb030197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb030100eb0 0x7fb030197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280098e0 con 0x7fb0301017d0 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0363b8640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 0x7fb03019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb035bb7640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb030100eb0 0x7fb030197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb0353b6640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb0301984f0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7fb020005950 tx=0x7fb0200ad760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020004450 con 0x7fb0301017d0 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fb0200a5a00 con 0x7fb0301017d0 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0200094a0 con 0x7fb0301017d0 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020003ba0 con 0x7fb0301017d0 2024-09-17T09:11:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03019d760 con 0x7fb0301017d0 2024-09-17T09:11:20.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.201+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb030068a90 con 0x7fb0301017d0 2024-09-17T09:11:20.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.205+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fb0200b4040 con 0x7fb0301017d0 2024-09-17T09:11:20.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.205+0000 7fb026ffd640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb01c06ce30 0x7fb01c06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:20.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.205+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(769..769 src has 1..769) v4 ==== 9079+0+0 (secure 0 0 0) 0x7fb0201276b0 con 0x7fb0301017d0 2024-09-17T09:11:20.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.205+0000 7fb035bb7640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb01c06ce30 0x7fb01c06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:20.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.205+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=770}) v3 -- 0x7fb01c078730 con 0x7fb0301017d0 2024-09-17T09:11:20.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.205+0000 7fb035bb7640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb01c06ce30 0x7fb01c06f2f0 secure :-1 s=READY pgs=3624 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005fd0 tx=0x7fb02c005e60 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:20.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.209+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb0200f0cc0 con 0x7fb0301017d0 2024-09-17T09:11:20.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:20.381+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fb030199340 con 0x7fb0301017d0 2024-09-17T09:11:20.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:11:20 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:11:21.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:21.133+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 7 ==== osd_map(770..770 src has 1..770) v4 ==== 628+0+0 (secure 0 0 0) 0x7fb0200a5b70 con 0x7fb0301017d0 2024-09-17T09:11:21.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:21.133+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=771}) v3 -- 0x7fb01c079260 con 0x7fb0301017d0 2024-09-17T09:11:21.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:21.141+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v770) v1 ==== 217+0+0 (secure 0 0 0) 0x7fb0200b20d0 con 0x7fb0301017d0 2024-09-17T09:11:21.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:21.253+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fb030101290 con 0x7fb0301017d0 2024-09-17T09:11:21.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:21 smithi136 bash[24812]: cluster 2024-09-17T09:11:19.297734+0000 mgr.y (mgr.14532) 747 : cluster [DBG] pgmap v1258: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:21.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:21 smithi136 bash[24812]: audit 2024-09-17T09:11:20.214901+0000 mgr.y (mgr.14532) 748 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:21 smithi136 bash[24812]: audit 2024-09-17T09:11:20.383687+0000 mon.a (mon.0) 3788 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:11:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:21 smithi078 bash[22670]: cluster 2024-09-17T09:11:19.297734+0000 mgr.y (mgr.14532) 747 : cluster [DBG] pgmap v1258: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:21 smithi078 bash[22670]: audit 2024-09-17T09:11:20.214901+0000 mgr.y (mgr.14532) 748 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:21.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:21 smithi078 bash[22670]: audit 2024-09-17T09:11:20.383687+0000 mon.a (mon.0) 3788 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:11:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:21 smithi078 bash[32124]: cluster 2024-09-17T09:11:19.297734+0000 mgr.y (mgr.14532) 747 : cluster [DBG] pgmap v1258: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:21 smithi078 bash[32124]: audit 2024-09-17T09:11:20.214901+0000 mgr.y (mgr.14532) 748 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:21 smithi078 bash[32124]: audit 2024-09-17T09:11:20.383687+0000 mon.a (mon.0) 3788 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:11:22.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.145+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 9 ==== osd_map(771..771 src has 1..771) v4 ==== 628+0+0 (secure 0 0 0) 0x7fb0200f8700 con 0x7fb0301017d0 2024-09-17T09:11:22.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.145+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=772}) v3 -- 0x7fb01c079650 con 0x7fb0301017d0 2024-09-17T09:11:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.153+0000 7fb026ffd640 1 -- 172.21.15.78:0/1128942921 <== mon.0 v2:172.21.15.78:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v771) v1 ==== 217+0+0 (secure 0 0 0) 0x7fb0200c4020 con 0x7fb0301017d0 2024-09-17T09:11:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_bytes = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb01c06ce30 msgr2=0x7fb01c06f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb01c06ce30 0x7fb01c06f2f0 secure :-1 s=READY pgs=3624 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005fd0 tx=0x7fb02c005e60 comp rx=0 tx=0).stop 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 msgr2=0x7fb0301984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb0301984f0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7fb020005950 tx=0x7fb0200ad760 comp rx=0 tx=0).stop 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 shutdown_connections 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fb01c06ce30 0x7fb01c06f2f0 unknown :-1 s=CLOSED pgs=3624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb03010a2e0 0x7fb03019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0301017d0 0x7fb0301984f0 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 --2- 172.21.15.78:0/1128942921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb030100eb0 0x7fb030197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 >> 172.21.15.78:0/1128942921 conn(0x7fb0300fa910 msgr2=0x7fb03010bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:22.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 shutdown_connections 2024-09-17T09:11:22.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.157+0000 7fb037e1b640 1 -- 172.21.15.78:0/1128942921 wait complete. 2024-09-17T09:11:22.176 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 max_objects 0 2024-09-17T09:11:22.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- 172.21.15.78:0/440415101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500ff4d0 msgr2=0x7f7c50105c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:22.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 --2- 172.21.15.78:0/440415101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500ff4d0 0x7f7c50105c20 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009870 tx=0x7f7c4001c6c0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- 172.21.15.78:0/440415101 shutdown_connections 2024-09-17T09:11:22.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 --2- 172.21.15.78:0/440415101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c50106360 0x7f7c5010ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 --2- 172.21.15.78:0/440415101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500ff4d0 0x7f7c50105c20 unknown :-1 s=CLOSED pgs=3264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 --2- 172.21.15.78:0/440415101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c500feb20 0x7f7c500fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- 172.21.15.78:0/440415101 >> 172.21.15.78:0/440415101 conn(0x7f7c500741f0 msgr2=0x7f7c50074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- 172.21.15.78:0/440415101 shutdown_connections 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- 172.21.15.78:0/440415101 wait complete. 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 Processor -- start 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- start start 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500feb20 0x7f7c50197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c500ff4d0 0x7f7c501984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:22.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c50106360 0x7f7c5019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5019cee0 con 0x7f7c50106360 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5019d050 con 0x7f7c500ff4d0 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c56e87640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5019d1c0 con 0x7f7c500feb20 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500feb20 0x7f7c50197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500feb20 0x7f7c50197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55706/0 (socket says 172.21.15.78:55706) 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 -- 172.21.15.78:0/2504795012 learned_addr learned my addr 172.21.15.78:0/2504795012 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c55424640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c50106360 0x7f7c5019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 -- 172.21.15.78:0/2504795012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c500ff4d0 msgr2=0x7f7c501984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c500ff4d0 0x7f7c501984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 -- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c50106360 msgr2=0x7f7c5019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c50106360 0x7f7c5019c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0098e0 con 0x7f7c500feb20 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.297+0000 7f7c54c23640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500feb20 0x7f7c50197fa0 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c3f0 tx=0x7f7c4c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c003980 con 0x7f7c500feb20 2024-09-17T09:11:22.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c400094a0 con 0x7f7c500feb20 2024-09-17T09:11:22.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f7c4c00b690 con 0x7f7c500feb20 2024-09-17T09:11:22.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c004260 con 0x7f7c500feb20 2024-09-17T09:11:22.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c501a4b90 con 0x7f7c500feb20 2024-09-17T09:11:22.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c50067fb0 con 0x7f7c500feb20 2024-09-17T09:11:22.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f7c4c00a040 con 0x7f7c500feb20 2024-09-17T09:11:22.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c45ffb640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7c3806ce30 0x7f7c3806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:22.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(771..771 src has 1..771) v4 ==== 9079+0+0 (secure 0 0 0) 0x7f7c4c08d110 con 0x7f7c500feb20 2024-09-17T09:11:22.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c47fff640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7c3806ce30 0x7f7c3806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:22.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=772}) v3 -- 0x7f7c38078730 con 0x7f7c500feb20 2024-09-17T09:11:22.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.301+0000 7f7c47fff640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7c3806ce30 0x7f7c3806f2f0 secure :-1 s=READY pgs=3625 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b0040 tx=0x7f7c400194c0 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:22.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.305+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c4c056670 con 0x7f7c500feb20 2024-09-17T09:11:22.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.481+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f7c50199300 con 0x7f7c500feb20 2024-09-17T09:11:22.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:22 smithi136 bash[24812]: audit 2024-09-17T09:11:21.144236+0000 mon.a (mon.0) 3789 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:11:22.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:22 smithi136 bash[24812]: cluster 2024-09-17T09:11:21.144416+0000 mon.a (mon.0) 3790 : cluster [DBG] osdmap e770: 8 total, 8 up, 8 in 2024-09-17T09:11:22.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:22 smithi136 bash[24812]: audit 2024-09-17T09:11:21.257199+0000 mon.a (mon.0) 3791 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:11:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:22 smithi078 bash[32124]: audit 2024-09-17T09:11:21.144236+0000 mon.a (mon.0) 3789 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:11:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:22 smithi078 bash[32124]: cluster 2024-09-17T09:11:21.144416+0000 mon.a (mon.0) 3790 : cluster [DBG] osdmap e770: 8 total, 8 up, 8 in 2024-09-17T09:11:22.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:22 smithi078 bash[32124]: audit 2024-09-17T09:11:21.257199+0000 mon.a (mon.0) 3791 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:11:22.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:22 smithi078 bash[22670]: audit 2024-09-17T09:11:21.144236+0000 mon.a (mon.0) 3789 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:11:22.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:22 smithi078 bash[22670]: cluster 2024-09-17T09:11:21.144416+0000 mon.a (mon.0) 3790 : cluster [DBG] osdmap e770: 8 total, 8 up, 8 in 2024-09-17T09:11:22.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:22 smithi078 bash[22670]: audit 2024-09-17T09:11:21.257199+0000 mon.a (mon.0) 3791 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:11:22.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.925+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 7 ==== osd_map(772..772 src has 1..772) v4 ==== 628+0+0 (secure 0 0 0) 0x7f7c4c05aa30 con 0x7f7c500feb20 2024-09-17T09:11:22.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.925+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=773}) v3 -- 0x7f7c38079260 con 0x7f7c500feb20 2024-09-17T09:11:22.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:22.933+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v772) v1 ==== 221+0+0 (secure 0 0 0) 0x7f7c4c059c90 con 0x7f7c500feb20 2024-09-17T09:11:23.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.041+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f7c500fef00 con 0x7f7c500feb20 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: cluster 2024-09-17T09:11:21.298365+0000 mgr.y (mgr.14532) 749 : cluster [DBG] pgmap v1260: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: audit 2024-09-17T09:11:22.154515+0000 mon.a (mon.0) 3792 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: cluster 2024-09-17T09:11:22.154984+0000 mon.a (mon.0) 3793 : cluster [DBG] osdmap e771: 8 total, 8 up, 8 in 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: audit 2024-09-17T09:11:22.483085+0000 mon.c (mon.2) 326 : audit [INF] from='client.? 172.21.15.78:0/2504795012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: audit 2024-09-17T09:11:22.483644+0000 mon.a (mon.0) 3794 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: cluster 2024-09-17T09:11:22.920514+0000 mon.a (mon.0) 3795 : cluster [INF] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' no longer out of quota; removing NO_QUOTA flag 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: cluster 2024-09-17T09:11:22.920986+0000 mon.a (mon.0) 3796 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: audit 2024-09-17T09:11:22.934113+0000 mon.a (mon.0) 3797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: cluster 2024-09-17T09:11:22.934803+0000 mon.a (mon.0) 3798 : cluster [DBG] osdmap e772: 8 total, 8 up, 8 in 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: audit 2024-09-17T09:11:23.044210+0000 mon.c (mon.2) 327 : audit [INF] from='client.? 172.21.15.78:0/2504795012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:23 smithi136 bash[24812]: audit 2024-09-17T09:11:23.044932+0000 mon.a (mon.0) 3799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: cluster 2024-09-17T09:11:21.298365+0000 mgr.y (mgr.14532) 749 : cluster [DBG] pgmap v1260: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:11:23.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: audit 2024-09-17T09:11:22.154515+0000 mon.a (mon.0) 3792 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:11:23.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: cluster 2024-09-17T09:11:22.154984+0000 mon.a (mon.0) 3793 : cluster [DBG] osdmap e771: 8 total, 8 up, 8 in 2024-09-17T09:11:23.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: audit 2024-09-17T09:11:22.483085+0000 mon.c (mon.2) 326 : audit [INF] from='client.? 172.21.15.78:0/2504795012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: audit 2024-09-17T09:11:22.483644+0000 mon.a (mon.0) 3794 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: cluster 2024-09-17T09:11:22.920514+0000 mon.a (mon.0) 3795 : cluster [INF] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' no longer out of quota; removing NO_QUOTA flag 2024-09-17T09:11:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: cluster 2024-09-17T09:11:22.920986+0000 mon.a (mon.0) 3796 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:11:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: audit 2024-09-17T09:11:22.934113+0000 mon.a (mon.0) 3797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:11:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: cluster 2024-09-17T09:11:22.934803+0000 mon.a (mon.0) 3798 : cluster [DBG] osdmap e772: 8 total, 8 up, 8 in 2024-09-17T09:11:23.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: audit 2024-09-17T09:11:23.044210+0000 mon.c (mon.2) 327 : audit [INF] from='client.? 172.21.15.78:0/2504795012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.606 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[22670]: audit 2024-09-17T09:11:23.044932+0000 mon.a (mon.0) 3799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: cluster 2024-09-17T09:11:21.298365+0000 mgr.y (mgr.14532) 749 : cluster [DBG] pgmap v1260: 176 pgs: 176 active+clean; 736 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:11:23.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: audit 2024-09-17T09:11:22.154515+0000 mon.a (mon.0) 3792 : audit [INF] from='client.? 172.21.15.78:0/1128942921' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:11:23.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: cluster 2024-09-17T09:11:22.154984+0000 mon.a (mon.0) 3793 : cluster [DBG] osdmap e771: 8 total, 8 up, 8 in 2024-09-17T09:11:23.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: audit 2024-09-17T09:11:22.483085+0000 mon.c (mon.2) 326 : audit [INF] from='client.? 172.21.15.78:0/2504795012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: audit 2024-09-17T09:11:22.483644+0000 mon.a (mon.0) 3794 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: cluster 2024-09-17T09:11:22.920514+0000 mon.a (mon.0) 3795 : cluster [INF] pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' no longer out of quota; removing NO_QUOTA flag 2024-09-17T09:11:23.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: cluster 2024-09-17T09:11:22.920986+0000 mon.a (mon.0) 3796 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:11:23.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: audit 2024-09-17T09:11:22.934113+0000 mon.a (mon.0) 3797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:11:23.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: cluster 2024-09-17T09:11:22.934803+0000 mon.a (mon.0) 3798 : cluster [DBG] osdmap e772: 8 total, 8 up, 8 in 2024-09-17T09:11:23.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: audit 2024-09-17T09:11:23.044210+0000 mon.c (mon.2) 327 : audit [INF] from='client.? 172.21.15.78:0/2504795012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.608 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:23 smithi078 bash[32124]: audit 2024-09-17T09:11:23.044932+0000 mon.a (mon.0) 3799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:11:23.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.929+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 9 ==== osd_map(773..773 src has 1..773) v4 ==== 628+0+0 (secure 0 0 0) 0x7f7c4c059c90 con 0x7f7c500feb20 2024-09-17T09:11:23.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.937+0000 7f7c45ffb640 1 -- 172.21.15.78:0/2504795012 <== mon.2 v2:172.21.15.78:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v773) v1 ==== 221+0+0 (secure 0 0 0) 0x7f7c4c06f0d0 con 0x7f7c500feb20 2024-09-17T09:11:23.939 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_objects = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:11:23.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7c3806ce30 msgr2=0x7f7c3806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:23.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7c3806ce30 0x7f7c3806f2f0 secure :-1 s=READY pgs=3625 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b0040 tx=0x7f7c400194c0 comp rx=0 tx=0).stop 2024-09-17T09:11:23.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500feb20 msgr2=0x7f7c50197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:23.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500feb20 0x7f7c50197fa0 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c3f0 tx=0x7f7c4c00c8b0 comp rx=0 tx=0).stop 2024-09-17T09:11:23.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 shutdown_connections 2024-09-17T09:11:23.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f7c3806ce30 0x7f7c3806f2f0 unknown :-1 s=CLOSED pgs=3625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:23.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c50106360 0x7f7c5019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:23.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c500ff4d0 0x7f7c501984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:23.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 --2- 172.21.15.78:0/2504795012 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c500feb20 0x7f7c50197fa0 unknown :-1 s=CLOSED pgs=3265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:23.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 >> 172.21.15.78:0/2504795012 conn(0x7f7c500741f0 msgr2=0x7f7c500fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:23.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 shutdown_connections 2024-09-17T09:11:23.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:23.941+0000 7f7c56e87640 1 -- 172.21.15.78:0/2504795012 wait complete. 2024-09-17T09:11:23.961 INFO:tasks.workunit.client.0.smithi078.stderr:+ wait 131567 2024-09-17T09:11:23.961 INFO:tasks.workunit.client.0.smithi078.stderr:+ [ 0 -ne 0 ] 2024-09-17T09:11:23.961 INFO:tasks.workunit.client.0.smithi078.stderr:+ true 2024-09-17T09:11:23.961 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put three /etc/passwd 2024-09-17T09:11:24.006 INFO:tasks.workunit.client.0.smithi078.stderr:+ uuidgen 2024-09-17T09:11:24.007 INFO:tasks.workunit.client.0.smithi078.stderr:+ pp=6ae626d6-c710-458c-be40-9658aa0f9d14 2024-09-17T09:11:24.007 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool create 6ae626d6-c710-458c-be40-9658aa0f9d14 12 2024-09-17T09:11:24.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3367659725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4102110 msgr2=0x7fe1b41024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3367659725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4102110 0x7fe1b41024f0 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009960 tx=0x7fe1ac01c7c0 comp rx=0 tx=0).stop 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3367659725 shutdown_connections 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3367659725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4107240 0x7fe1b410edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3367659725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1b4102ac0 0x7fe1b4106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3367659725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4102110 0x7fe1b41024f0 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3367659725 >> 172.21.15.78:0/3367659725 conn(0x7fe1b40fdbb0 msgr2=0x7fe1b40fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3367659725 shutdown_connections 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.121+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3367659725 wait complete. 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 Processor -- start 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 -- start start 2024-09-17T09:11:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1b4102110 0x7fe1b419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4102ac0 0x7fe1b419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4107240 0x7fe1b419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b419fd10 con 0x7fe1b4107240 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b419fe80 con 0x7fe1b4102110 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b419fff0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4102ac0 0x7fe1b419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4102ac0 0x7fe1b419b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35828/0 (socket says 172.21.15.78:35828) 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 -- 172.21.15.78:0/3140000866 learned_addr learned my addr 172.21.15.78:0/3140000866 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b37fe640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4107240 0x7fe1b419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b2ffd640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1b4102110 0x7fe1b419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 -- 172.21.15.78:0/3140000866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1b4102110 msgr2=0x7fe1b419add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1b4102110 0x7fe1b419add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 -- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4107240 msgr2=0x7fe1b419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4107240 0x7fe1b419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 -- 172.21.15.78:0/3140000866 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40094a0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b37fe640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4107240 0x7fe1b419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b2ffd640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1b4102110 0x7fe1b419add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b27fc640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4102ac0 0x7fe1b419b310 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009fd0 tx=0x7fe19c00c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c011470 con 0x7fe1b4102ac0 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac009560 con 0x7fe1b4102ac0 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fe19c011a20 con 0x7fe1b4102ac0 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c01a7a0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b41a79c0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b41035f0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7fe19c0115d0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b8a0b640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fe1a006ce30 0x7fe1a006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:24.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(773..773 src has 1..773) v4 ==== 9079+0+0 (secure 0 0 0) 0x7fe19c08d7b0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b2ffd640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fe1a006ce30 0x7fe1a006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:24.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.125+0000 7fe1b2ffd640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fe1a006ce30 0x7fe1a006f2f0 secure :-1 s=READY pgs=3627 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac01b040 tx=0x7fe1ac019560 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:24.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.129+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe19c056dc0 con 0x7fe1b4102ac0 2024-09-17T09:11:24.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:24.301+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12} v 0) v1 -- 0x7fe1b419c130 con 0x7fe1b4102ac0 2024-09-17T09:11:25.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.169+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]=0 pool '6ae626d6-c710-458c-be40-9658aa0f9d14' created v774) v1 ==== 176+0+0 (secure 0 0 0) 0x7fe19c011880 con 0x7fe1b4102ac0 2024-09-17T09:11:25.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.273+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12} v 0) v1 -- 0x7fe1b41024f0 con 0x7fe1b4102ac0 2024-09-17T09:11:25.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b8a0b640 1 -- 172.21.15.78:0/3140000866 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]=0 pool '6ae626d6-c710-458c-be40-9658aa0f9d14' already exists v774) v1 ==== 183+0+0 (secure 0 0 0) 0x7fe19c05a3e0 con 0x7fe1b4102ac0 2024-09-17T09:11:25.278 INFO:tasks.workunit.client.0.smithi078.stderr:pool '6ae626d6-c710-458c-be40-9658aa0f9d14' already exists 2024-09-17T09:11:25.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fe1a006ce30 msgr2=0x7fe1a006f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fe1a006ce30 0x7fe1a006f2f0 secure :-1 s=READY pgs=3627 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac01b040 tx=0x7fe1ac019560 comp rx=0 tx=0).stop 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4102ac0 msgr2=0x7fe1b419b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4102ac0 0x7fe1b419b310 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009fd0 tx=0x7fe19c00c270 comp rx=0 tx=0).stop 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 shutdown_connections 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7fe1a006ce30 0x7fe1a006f2f0 unknown :-1 s=CLOSED pgs=3627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b4107240 0x7fe1b419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b4102ac0 0x7fe1b419b310 unknown :-1 s=CLOSED pgs=3268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 --2- 172.21.15.78:0/3140000866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1b4102110 0x7fe1b419add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.277+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 >> 172.21.15.78:0/3140000866 conn(0x7fe1b40fdbb0 msgr2=0x7fe1b40fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.281+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 shutdown_connections 2024-09-17T09:11:25.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.281+0000 7fe1b9a0d640 1 -- 172.21.15.78:0/3140000866 wait complete. 2024-09-17T09:11:25.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:24 smithi136 bash[24812]: cluster 2024-09-17T09:11:23.300198+0000 mgr.y (mgr.14532) 750 : cluster [DBG] pgmap v1263: 176 pgs: 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-17T09:11:25.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:24 smithi136 bash[24812]: audit 2024-09-17T09:11:23.934840+0000 mon.a (mon.0) 3800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:11:25.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:24 smithi136 bash[24812]: cluster 2024-09-17T09:11:23.935082+0000 mon.a (mon.0) 3801 : cluster [DBG] osdmap e773: 8 total, 8 up, 8 in 2024-09-17T09:11:25.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:24 smithi136 bash[24812]: audit 2024-09-17T09:11:24.305917+0000 mon.c (mon.2) 328 : audit [INF] from='client.? 172.21.15.78:0/3140000866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:25.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:24 smithi136 bash[24812]: audit 2024-09-17T09:11:24.306464+0000 mon.a (mon.0) 3802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:25.295 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool application enable 6ae626d6-c710-458c-be40-9658aa0f9d14 rados 2024-09-17T09:11:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[32124]: cluster 2024-09-17T09:11:23.300198+0000 mgr.y (mgr.14532) 750 : cluster [DBG] pgmap v1263: 176 pgs: 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-17T09:11:25.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[32124]: audit 2024-09-17T09:11:23.934840+0000 mon.a (mon.0) 3800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[32124]: cluster 2024-09-17T09:11:23.935082+0000 mon.a (mon.0) 3801 : cluster [DBG] osdmap e773: 8 total, 8 up, 8 in 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[32124]: audit 2024-09-17T09:11:24.305917+0000 mon.c (mon.2) 328 : audit [INF] from='client.? 172.21.15.78:0/3140000866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[32124]: audit 2024-09-17T09:11:24.306464+0000 mon.a (mon.0) 3802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[22670]: cluster 2024-09-17T09:11:23.300198+0000 mgr.y (mgr.14532) 750 : cluster [DBG] pgmap v1263: 176 pgs: 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[22670]: audit 2024-09-17T09:11:23.934840+0000 mon.a (mon.0) 3800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[22670]: cluster 2024-09-17T09:11:23.935082+0000 mon.a (mon.0) 3801 : cluster [DBG] osdmap e773: 8 total, 8 up, 8 in 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[22670]: audit 2024-09-17T09:11:24.305917+0000 mon.c (mon.2) 328 : audit [INF] from='client.? 172.21.15.78:0/3140000866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:25.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:24 smithi078 bash[22670]: audit 2024-09-17T09:11:24.306464+0000 mon.a (mon.0) 3802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:25.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- 172.21.15.78:0/3542760408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 msgr2=0x7f06881130e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:25.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 --2- 172.21.15.78:0/3542760408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 0x7f06881130e0 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7f0680009bf0 tx=0x7f068001cb30 comp rx=0 tx=0).stop 2024-09-17T09:11:25.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- 172.21.15.78:0/3542760408 shutdown_connections 2024-09-17T09:11:25.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 --2- 172.21.15.78:0/3542760408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 0x7f06881130e0 unknown :-1 s=CLOSED pgs=3269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 --2- 172.21.15.78:0/3542760408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 0x7f06881107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 --2- 172.21.15.78:0/3542760408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0688072900 0x7f0688072ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- 172.21.15.78:0/3542760408 >> 172.21.15.78:0/3542760408 conn(0x7f06880fba00 msgr2=0x7f06880fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:25.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- 172.21.15.78:0/3542760408 shutdown_connections 2024-09-17T09:11:25.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- 172.21.15.78:0/3542760408 wait complete. 2024-09-17T09:11:25.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 Processor -- start 2024-09-17T09:11:25.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- start start 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0688072900 0x7f06881a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 0x7f06881a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 0x7f068819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068819ef60 con 0x7f0688073220 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068819f0d0 con 0x7f0688072900 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068c88f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068819f290 con 0x7f0688110cf0 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0685d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 0x7f06881a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0685d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 0x7f06881a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53402/0 (socket says 172.21.15.78:53402) 2024-09-17T09:11:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0685d9b640 1 -- 172.21.15.78:0/2700267677 learned_addr learned my addr 172.21.15.78:0/2700267677 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0686d9d640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 0x7f068819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f068659c640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0688072900 0x7f06881a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0686d9d640 1 -- 172.21.15.78:0/2700267677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0688072900 msgr2=0x7f06881a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0686d9d640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0688072900 0x7f06881a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0686d9d640 1 -- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 msgr2=0x7f06881a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0686d9d640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 0x7f06881a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0686d9d640 1 -- 172.21.15.78:0/2700267677 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009560 con 0x7f0688110cf0 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0685d9b640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 0x7f06881a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.425+0000 7f0686d9d640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 0x7f068819e910 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7f068001d010 tx=0x7f0680009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800ad640 con 0x7f0688110cf0 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f06800adbf0 con 0x7f0688110cf0 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0680009820 con 0x7f0688110cf0 2024-09-17T09:11:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800046e0 con 0x7f0688110cf0 2024-09-17T09:11:25.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06881ab640 con 0x7f0688110cf0 2024-09-17T09:11:25.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0688074040 con 0x7f0688110cf0 2024-09-17T09:11:25.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f06800b4040 con 0x7f0688110cf0 2024-09-17T09:11:25.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f06777fe640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f067006ce30 0x7f067006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:25.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f068659c640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f067006ce30 0x7f067006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:25.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(774..774 src has 1..774) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f06801270e0 con 0x7f0688110cf0 2024-09-17T09:11:25.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.429+0000 7f068659c640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f067006ce30 0x7f067006f2f0 secure :-1 s=READY pgs=3628 cs=0 l=1 rev1=1 crypto rx=0x7f067c005fd0 tx=0x7f067c005db0 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:25.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.433+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f06800f0600 con 0x7f0688110cf0 2024-09-17T09:11:25.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:25.609+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"} v 0) v1 -- 0x7f068819fe20 con 0x7f0688110cf0 2024-09-17T09:11:26.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:26.169+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]=0 enabled application 'rados' on pool '6ae626d6-c710-458c-be40-9658aa0f9d14' v775) v1 ==== 213+0+0 (secure 0 0 0) 0x7f06800f3c20 con 0x7f0688110cf0 2024-09-17T09:11:26.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:26.285+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"} v 0) v1 -- 0x7f0688072ce0 con 0x7f0688110cf0 2024-09-17T09:11:26.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:26 smithi136 bash[24812]: audit 2024-09-17T09:11:25.165764+0000 mon.a (mon.0) 3803 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]': finished 2024-09-17T09:11:26.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:26 smithi136 bash[24812]: cluster 2024-09-17T09:11:25.165971+0000 mon.a (mon.0) 3804 : cluster [DBG] osdmap e774: 8 total, 8 up, 8 in 2024-09-17T09:11:26.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:26 smithi136 bash[24812]: audit 2024-09-17T09:11:25.278519+0000 mon.c (mon.2) 329 : audit [INF] from='client.? 172.21.15.78:0/3140000866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:26.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:26 smithi136 bash[24812]: audit 2024-09-17T09:11:25.279237+0000 mon.a (mon.0) 3805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:26.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:26 smithi136 bash[24812]: audit 2024-09-17T09:11:25.612918+0000 mon.c (mon.2) 330 : audit [INF] from='client.? 172.21.15.78:0/2700267677' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:26.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:26 smithi136 bash[24812]: audit 2024-09-17T09:11:25.613475+0000 mon.a (mon.0) 3806 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[22670]: audit 2024-09-17T09:11:25.165764+0000 mon.a (mon.0) 3803 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]': finished 2024-09-17T09:11:26.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[22670]: cluster 2024-09-17T09:11:25.165971+0000 mon.a (mon.0) 3804 : cluster [DBG] osdmap e774: 8 total, 8 up, 8 in 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[22670]: audit 2024-09-17T09:11:25.278519+0000 mon.c (mon.2) 329 : audit [INF] from='client.? 172.21.15.78:0/3140000866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[22670]: audit 2024-09-17T09:11:25.279237+0000 mon.a (mon.0) 3805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[22670]: audit 2024-09-17T09:11:25.612918+0000 mon.c (mon.2) 330 : audit [INF] from='client.? 172.21.15.78:0/2700267677' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[22670]: audit 2024-09-17T09:11:25.613475+0000 mon.a (mon.0) 3806 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[32124]: audit 2024-09-17T09:11:25.165764+0000 mon.a (mon.0) 3803 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]': finished 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[32124]: cluster 2024-09-17T09:11:25.165971+0000 mon.a (mon.0) 3804 : cluster [DBG] osdmap e774: 8 total, 8 up, 8 in 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[32124]: audit 2024-09-17T09:11:25.278519+0000 mon.c (mon.2) 329 : audit [INF] from='client.? 172.21.15.78:0/3140000866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[32124]: audit 2024-09-17T09:11:25.279237+0000 mon.a (mon.0) 3805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pg_num": 12}]: dispatch 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[32124]: audit 2024-09-17T09:11:25.612918+0000 mon.c (mon.2) 330 : audit [INF] from='client.? 172.21.15.78:0/2700267677' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:26.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:26 smithi078 bash[32124]: audit 2024-09-17T09:11:25.613475+0000 mon.a (mon.0) 3806 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:27.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.165+0000 7f06777fe640 1 -- 172.21.15.78:0/2700267677 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]=0 enabled application 'rados' on pool '6ae626d6-c710-458c-be40-9658aa0f9d14' v776) v1 ==== 213+0+0 (secure 0 0 0) 0x7f06800b20d0 con 0x7f0688110cf0 2024-09-17T09:11:27.169 INFO:tasks.workunit.client.0.smithi078.stderr:enabled application 'rados' on pool '6ae626d6-c710-458c-be40-9658aa0f9d14' 2024-09-17T09:11:27.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f067006ce30 msgr2=0x7f067006f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:27.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f067006ce30 0x7f067006f2f0 secure :-1 s=READY pgs=3628 cs=0 l=1 rev1=1 crypto rx=0x7f067c005fd0 tx=0x7f067c005db0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 msgr2=0x7f068819e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:27.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 0x7f068819e910 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7f068001d010 tx=0x7f0680009280 comp rx=0 tx=0).stop 2024-09-17T09:11:27.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 shutdown_connections 2024-09-17T09:11:27.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f067006ce30 0x7f067006f2f0 unknown :-1 s=CLOSED pgs=3628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0688110cf0 0x7f068819e910 unknown :-1 s=CLOSED pgs=3270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0688073220 0x7f06881a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 --2- 172.21.15.78:0/2700267677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0688072900 0x7f06881a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 >> 172.21.15.78:0/2700267677 conn(0x7f06880fba00 msgr2=0x7f06880ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 shutdown_connections 2024-09-17T09:11:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.169+0000 7f068c88f640 1 -- 172.21.15.78:0/2700267677 wait complete. 2024-09-17T09:11:27.193 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 6ae626d6-c710-458c-be40-9658aa0f9d14 max_objects 10 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- 172.21.15.78:0/618496004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8100910 msgr2=0x7f48c8104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 --2- 172.21.15.78:0/618496004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8100910 0x7f48c8104960 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009930 tx=0x7f48b801c7e0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- 172.21.15.78:0/618496004 shutdown_connections 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 --2- 172.21.15.78:0/618496004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c8105090 0x7f48c810cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 --2- 172.21.15.78:0/618496004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8100910 0x7f48c8104960 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 --2- 172.21.15.78:0/618496004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c80fff60 0x7f48c8100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- 172.21.15.78:0/618496004 >> 172.21.15.78:0/618496004 conn(0x7f48c80fba00 msgr2=0x7f48c80fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- 172.21.15.78:0/618496004 shutdown_connections 2024-09-17T09:11:27.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- 172.21.15.78:0/618496004 wait complete. 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 Processor -- start 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- start start 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c80fff60 0x7f48c8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c8100910 0x7f48c8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8105090 0x7f48c819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c819ce80 con 0x7f48c80fff60 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c819cff0 con 0x7f48c8100910 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cffa3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c819d160 con 0x7f48c8105090 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cdd3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c80fff60 0x7f48c8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48ce540640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8105090 0x7f48c819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:27.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48ce540640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8105090 0x7f48c819c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35866/0 (socket says 172.21.15.78:35866) 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48ce540640 1 -- 172.21.15.78:0/240399184 learned_addr learned my addr 172.21.15.78:0/240399184 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48cdd3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c80fff60 0x7f48c8197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53418/0 (socket says 172.21.15.78:53418) 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48ce540640 1 -- 172.21.15.78:0/240399184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c8100910 msgr2=0x7f48c8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48ce540640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c8100910 0x7f48c8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.309+0000 7f48ce540640 1 -- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c80fff60 msgr2=0x7f48c8197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48ce540640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c80fff60 0x7f48c8197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48ce540640 1 -- 172.21.15.78:0/240399184 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c00094a0 con 0x7f48c8105090 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48ce540640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8105090 0x7f48c819c880 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009fd0 tx=0x7f48c000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000cd80 con 0x7f48c8105090 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f48c0004470 con 0x7f48c8105090 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b8009560 con 0x7f48c8105090 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0003de0 con 0x7f48c8105090 2024-09-17T09:11:27.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c81a4b30 con 0x7f48c8105090 2024-09-17T09:11:27.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c8101440 con 0x7f48c8105090 2024-09-17T09:11:27.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f48c0003f60 con 0x7f48c8105090 2024-09-17T09:11:27.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48beffd640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f48b406ce30 0x7f48b406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:11:27.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(776..776 src has 1..776) v4 ==== 9467+0+0 (secure 0 0 0) 0x7f48c0014070 con 0x7f48c8105090 2024-09-17T09:11:27.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48cdd3f640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f48b406ce30 0x7f48b406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:11:27.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.313+0000 7f48cdd3f640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f48b406ce30 0x7f48b406f2f0 secure :-1 s=READY pgs=3629 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005fd0 tx=0x7f48c4007600 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:11:27.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.317+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f48c0056ad0 con 0x7f48c8105090 2024-09-17T09:11:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:27.477+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f48c81119b0 con 0x7f48c8105090 2024-09-17T09:11:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: cluster 2024-09-17T09:11:25.300880+0000 mgr.y (mgr.14532) 751 : cluster [DBG] pgmap v1266: 188 pgs: 12 unknown, 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:11:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: cluster 2024-09-17T09:11:26.155420+0000 mon.a (mon.0) 3807 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: audit 2024-09-17T09:11:26.169626+0000 mon.a (mon.0) 3808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]': finished 2024-09-17T09:11:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: cluster 2024-09-17T09:11:26.169814+0000 mon.a (mon.0) 3809 : cluster [DBG] osdmap e775: 8 total, 8 up, 8 in 2024-09-17T09:11:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: audit 2024-09-17T09:11:26.288189+0000 mon.c (mon.2) 331 : audit [INF] from='client.? 172.21.15.78:0/2700267677' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: audit 2024-09-17T09:11:26.288867+0000 mon.a (mon.0) 3810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: audit 2024-09-17T09:11:27.067773+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:11:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: audit 2024-09-17T09:11:27.070003+0000 mon.a (mon.0) 3812 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: audit 2024-09-17T09:11:27.165512+0000 mon.a (mon.0) 3813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]': finished 2024-09-17T09:11:27.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:27 smithi136 bash[24812]: cluster 2024-09-17T09:11:27.165744+0000 mon.a (mon.0) 3814 : cluster [DBG] osdmap e776: 8 total, 8 up, 8 in 2024-09-17T09:11:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: cluster 2024-09-17T09:11:25.300880+0000 mgr.y (mgr.14532) 751 : cluster [DBG] pgmap v1266: 188 pgs: 12 unknown, 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:11:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: cluster 2024-09-17T09:11:26.155420+0000 mon.a (mon.0) 3807 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: audit 2024-09-17T09:11:26.169626+0000 mon.a (mon.0) 3808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]': finished 2024-09-17T09:11:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: cluster 2024-09-17T09:11:26.169814+0000 mon.a (mon.0) 3809 : cluster [DBG] osdmap e775: 8 total, 8 up, 8 in 2024-09-17T09:11:27.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: audit 2024-09-17T09:11:26.288189+0000 mon.c (mon.2) 331 : audit [INF] from='client.? 172.21.15.78:0/2700267677' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:27.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: audit 2024-09-17T09:11:26.288867+0000 mon.a (mon.0) 3810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:27.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: audit 2024-09-17T09:11:27.067773+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:11:27.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: audit 2024-09-17T09:11:27.070003+0000 mon.a (mon.0) 3812 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:27.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: audit 2024-09-17T09:11:27.165512+0000 mon.a (mon.0) 3813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]': finished 2024-09-17T09:11:27.605 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22670]: cluster 2024-09-17T09:11:27.165744+0000 mon.a (mon.0) 3814 : cluster [DBG] osdmap e776: 8 total, 8 up, 8 in 2024-09-17T09:11:27.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: cluster 2024-09-17T09:11:25.300880+0000 mgr.y (mgr.14532) 751 : cluster [DBG] pgmap v1266: 188 pgs: 12 unknown, 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:11:27.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: cluster 2024-09-17T09:11:26.155420+0000 mon.a (mon.0) 3807 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:27.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: audit 2024-09-17T09:11:26.169626+0000 mon.a (mon.0) 3808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]': finished 2024-09-17T09:11:27.606 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: cluster 2024-09-17T09:11:26.169814+0000 mon.a (mon.0) 3809 : cluster [DBG] osdmap e775: 8 total, 8 up, 8 in 2024-09-17T09:11:27.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: audit 2024-09-17T09:11:26.288189+0000 mon.c (mon.2) 331 : audit [INF] from='client.? 172.21.15.78:0/2700267677' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:27.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: audit 2024-09-17T09:11:26.288867+0000 mon.a (mon.0) 3810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]: dispatch 2024-09-17T09:11:27.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: audit 2024-09-17T09:11:27.067773+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:11:27.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: audit 2024-09-17T09:11:27.070003+0000 mon.a (mon.0) 3812 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:27.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: audit 2024-09-17T09:11:27.165512+0000 mon.a (mon.0) 3813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "app": "rados"}]': finished 2024-09-17T09:11:27.607 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[32124]: cluster 2024-09-17T09:11:27.165744+0000 mon.a (mon.0) 3814 : cluster [DBG] osdmap e776: 8 total, 8 up, 8 in 2024-09-17T09:11:28.183 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:11:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:11:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:11:28.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:28.201+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6ae626d6-c710-458c-be40-9658aa0f9d14 v777) v1 ==== 223+0+0 (secure 0 0 0) 0x7f48c005a0f0 con 0x7f48c8105090 2024-09-17T09:11:28.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:28.313+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f48c8111bc0 con 0x7f48c8105090 2024-09-17T09:11:28.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:28 smithi136 bash[24812]: audit 2024-09-17T09:11:27.480640+0000 mon.c (mon.2) 332 : audit [INF] from='client.? 172.21.15.78:0/240399184' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:28.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:28 smithi136 bash[24812]: audit 2024-09-17T09:11:27.481073+0000 mon.a (mon.0) 3815 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:28 smithi078 bash[32124]: audit 2024-09-17T09:11:27.480640+0000 mon.c (mon.2) 332 : audit [INF] from='client.? 172.21.15.78:0/240399184' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:28.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:28 smithi078 bash[32124]: audit 2024-09-17T09:11:27.481073+0000 mon.a (mon.0) 3815 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:28.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:28 smithi078 bash[22670]: audit 2024-09-17T09:11:27.480640+0000 mon.c (mon.2) 332 : audit [INF] from='client.? 172.21.15.78:0/240399184' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:28.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:28 smithi078 bash[22670]: audit 2024-09-17T09:11:27.481073+0000 mon.a (mon.0) 3815 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:29.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.205+0000 7f48beffd640 1 -- 172.21.15.78:0/240399184 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6ae626d6-c710-458c-be40-9658aa0f9d14 v778) v1 ==== 223+0+0 (secure 0 0 0) 0x7f48c005a2d0 con 0x7f48c8105090 2024-09-17T09:11:29.206 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_objects = 10 for pool 6ae626d6-c710-458c-be40-9658aa0f9d14 2024-09-17T09:11:29.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f48b406ce30 msgr2=0x7f48b406f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:29.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f48b406ce30 0x7f48b406f2f0 secure :-1 s=READY pgs=3629 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005fd0 tx=0x7f48c4007600 comp rx=0 tx=0).stop 2024-09-17T09:11:29.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8105090 msgr2=0x7f48c819c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:11:29.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8105090 0x7f48c819c880 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009fd0 tx=0x7f48c000ee40 comp rx=0 tx=0).stop 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 shutdown_connections 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f48b406ce30 0x7f48b406f2f0 unknown :-1 s=CLOSED pgs=3629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c8105090 0x7f48c819c880 unknown :-1 s=CLOSED pgs=3272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c8100910 0x7f48c8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 --2- 172.21.15.78:0/240399184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c80fff60 0x7f48c8197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 >> 172.21.15.78:0/240399184 conn(0x7f48c80fba00 msgr2=0x7f48c80fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 shutdown_connections 2024-09-17T09:11:29.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:11:29.209+0000 7f48cffa3640 1 -- 172.21.15.78:0/240399184 wait complete. 2024-09-17T09:11:29.232 INFO:tasks.workunit.client.0.smithi078.stderr:+ sleep 30 2024-09-17T09:11:29.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:29 smithi136 bash[24812]: cluster 2024-09-17T09:11:27.301565+0000 mgr.y (mgr.14532) 752 : cluster [DBG] pgmap v1269: 188 pgs: 12 unknown, 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:11:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:29 smithi136 bash[24812]: audit 2024-09-17T09:11:28.199506+0000 mon.a (mon.0) 3816 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:11:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:29 smithi136 bash[24812]: cluster 2024-09-17T09:11:28.199710+0000 mon.a (mon.0) 3817 : cluster [DBG] osdmap e777: 8 total, 8 up, 8 in 2024-09-17T09:11:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:29 smithi136 bash[24812]: audit 2024-09-17T09:11:28.316203+0000 mon.c (mon.2) 333 : audit [INF] from='client.? 172.21.15.78:0/240399184' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:29 smithi136 bash[24812]: audit 2024-09-17T09:11:28.316724+0000 mon.a (mon.0) 3818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[22670]: cluster 2024-09-17T09:11:27.301565+0000 mgr.y (mgr.14532) 752 : cluster [DBG] pgmap v1269: 188 pgs: 12 unknown, 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[22670]: audit 2024-09-17T09:11:28.199506+0000 mon.a (mon.0) 3816 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[22670]: cluster 2024-09-17T09:11:28.199710+0000 mon.a (mon.0) 3817 : cluster [DBG] osdmap e777: 8 total, 8 up, 8 in 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[22670]: audit 2024-09-17T09:11:28.316203+0000 mon.c (mon.2) 333 : audit [INF] from='client.? 172.21.15.78:0/240399184' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[22670]: audit 2024-09-17T09:11:28.316724+0000 mon.a (mon.0) 3818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[32124]: cluster 2024-09-17T09:11:27.301565+0000 mgr.y (mgr.14532) 752 : cluster [DBG] pgmap v1269: 188 pgs: 12 unknown, 176 active+clean; 749 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[32124]: audit 2024-09-17T09:11:28.199506+0000 mon.a (mon.0) 3816 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[32124]: cluster 2024-09-17T09:11:28.199710+0000 mon.a (mon.0) 3817 : cluster [DBG] osdmap e777: 8 total, 8 up, 8 in 2024-09-17T09:11:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[32124]: audit 2024-09-17T09:11:28.316203+0000 mon.c (mon.2) 333 : audit [INF] from='client.? 172.21.15.78:0/240399184' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:29.605 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:29 smithi078 bash[32124]: audit 2024-09-17T09:11:28.316724+0000 mon.a (mon.0) 3818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]: dispatch 2024-09-17T09:11:30.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:11:30 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:11:30.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:30 smithi136 bash[24812]: audit 2024-09-17T09:11:29.206154+0000 mon.a (mon.0) 3819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:11:30.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:30 smithi136 bash[24812]: cluster 2024-09-17T09:11:29.206364+0000 mon.a (mon.0) 3820 : cluster [DBG] osdmap e778: 8 total, 8 up, 8 in 2024-09-17T09:11:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:30 smithi078 bash[22670]: audit 2024-09-17T09:11:29.206154+0000 mon.a (mon.0) 3819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:11:30.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:30 smithi078 bash[22670]: cluster 2024-09-17T09:11:29.206364+0000 mon.a (mon.0) 3820 : cluster [DBG] osdmap e778: 8 total, 8 up, 8 in 2024-09-17T09:11:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:30 smithi078 bash[32124]: audit 2024-09-17T09:11:29.206154+0000 mon.a (mon.0) 3819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "field": "max_objects", "val": "10"}]': finished 2024-09-17T09:11:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:30 smithi078 bash[32124]: cluster 2024-09-17T09:11:29.206364+0000 mon.a (mon.0) 3820 : cluster [DBG] osdmap e778: 8 total, 8 up, 8 in 2024-09-17T09:11:31.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:31 smithi136 bash[24812]: cluster 2024-09-17T09:11:29.302271+0000 mgr.y (mgr.14532) 753 : cluster [DBG] pgmap v1272: 188 pgs: 188 active+clean; 761 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:11:31.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:31 smithi136 bash[24812]: audit 2024-09-17T09:11:30.223200+0000 mgr.y (mgr.14532) 754 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:31 smithi078 bash[22670]: cluster 2024-09-17T09:11:29.302271+0000 mgr.y (mgr.14532) 753 : cluster [DBG] pgmap v1272: 188 pgs: 188 active+clean; 761 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:11:31.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:31 smithi078 bash[22670]: audit 2024-09-17T09:11:30.223200+0000 mgr.y (mgr.14532) 754 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:31 smithi078 bash[32124]: cluster 2024-09-17T09:11:29.302271+0000 mgr.y (mgr.14532) 753 : cluster [DBG] pgmap v1272: 188 pgs: 188 active+clean; 761 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:11:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:31 smithi078 bash[32124]: audit 2024-09-17T09:11:30.223200+0000 mgr.y (mgr.14532) 754 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:33.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:33 smithi136 bash[24812]: cluster 2024-09-17T09:11:31.303042+0000 mgr.y (mgr.14532) 755 : cluster [DBG] pgmap v1273: 188 pgs: 188 active+clean; 761 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 996 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-17T09:11:33.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:33 smithi136 bash[24812]: cluster 2024-09-17T09:11:32.923832+0000 mon.a (mon.0) 3821 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:33 smithi078 bash[22670]: cluster 2024-09-17T09:11:31.303042+0000 mgr.y (mgr.14532) 755 : cluster [DBG] pgmap v1273: 188 pgs: 188 active+clean; 761 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 996 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-17T09:11:33.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:33 smithi078 bash[22670]: cluster 2024-09-17T09:11:32.923832+0000 mon.a (mon.0) 3821 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:33.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:33 smithi078 bash[32124]: cluster 2024-09-17T09:11:31.303042+0000 mgr.y (mgr.14532) 755 : cluster [DBG] pgmap v1273: 188 pgs: 188 active+clean; 761 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 996 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-17T09:11:33.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:33 smithi078 bash[32124]: cluster 2024-09-17T09:11:32.923832+0000 mon.a (mon.0) 3821 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:34.542 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:34 smithi136 bash[24812]: cluster 2024-09-17T09:11:33.305098+0000 mgr.y (mgr.14532) 756 : cluster [DBG] pgmap v1274: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2024-09-17T09:11:34.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:34 smithi078 bash[22670]: cluster 2024-09-17T09:11:33.305098+0000 mgr.y (mgr.14532) 756 : cluster [DBG] pgmap v1274: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2024-09-17T09:11:34.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:34 smithi078 bash[32124]: cluster 2024-09-17T09:11:33.305098+0000 mgr.y (mgr.14532) 756 : cluster [DBG] pgmap v1274: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2024-09-17T09:11:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:36 smithi136 bash[24812]: cluster 2024-09-17T09:11:35.305904+0000 mgr.y (mgr.14532) 757 : cluster [DBG] pgmap v1275: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-17T09:11:36.792 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:36 smithi136 bash[24812]: audit 2024-09-17T09:11:36.349261+0000 mon.a (mon.0) 3822 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:36 smithi078 bash[32124]: cluster 2024-09-17T09:11:35.305904+0000 mgr.y (mgr.14532) 757 : cluster [DBG] pgmap v1275: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-17T09:11:36.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:36 smithi078 bash[32124]: audit 2024-09-17T09:11:36.349261+0000 mon.a (mon.0) 3822 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:36 smithi078 bash[22670]: cluster 2024-09-17T09:11:35.305904+0000 mgr.y (mgr.14532) 757 : cluster [DBG] pgmap v1275: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-17T09:11:36.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:36 smithi078 bash[22670]: audit 2024-09-17T09:11:36.349261+0000 mon.a (mon.0) 3822 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:37 smithi136 bash[24812]: audit 2024-09-17T09:11:36.885555+0000 mon.a (mon.0) 3823 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:37 smithi136 bash[24812]: audit 2024-09-17T09:11:36.887225+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:37.794 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:37 smithi136 bash[24812]: audit 2024-09-17T09:11:36.896959+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:11:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:37 smithi078 bash[32124]: audit 2024-09-17T09:11:36.885555+0000 mon.a (mon.0) 3823 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:37 smithi078 bash[32124]: audit 2024-09-17T09:11:36.887225+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:37.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:37 smithi078 bash[32124]: audit 2024-09-17T09:11:36.896959+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:11:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:37 smithi078 bash[22670]: audit 2024-09-17T09:11:36.885555+0000 mon.a (mon.0) 3823 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:37 smithi078 bash[22670]: audit 2024-09-17T09:11:36.887225+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:37.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:37 smithi078 bash[22670]: audit 2024-09-17T09:11:36.896959+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:11:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:11:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:11:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:11:39.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:38 smithi136 bash[24812]: cluster 2024-09-17T09:11:37.306820+0000 mgr.y (mgr.14532) 758 : cluster [DBG] pgmap v1276: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 561 B/s rd, 0 op/s 2024-09-17T09:11:39.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:38 smithi078 bash[22670]: cluster 2024-09-17T09:11:37.306820+0000 mgr.y (mgr.14532) 758 : cluster [DBG] pgmap v1276: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 561 B/s rd, 0 op/s 2024-09-17T09:11:39.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:38 smithi078 bash[32124]: cluster 2024-09-17T09:11:37.306820+0000 mgr.y (mgr.14532) 758 : cluster [DBG] pgmap v1276: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 561 B/s rd, 0 op/s 2024-09-17T09:11:40.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:11:40 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:11:41.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:40 smithi136 bash[24812]: cluster 2024-09-17T09:11:39.308838+0000 mgr.y (mgr.14532) 759 : cluster [DBG] pgmap v1277: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-09-17T09:11:41.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:40 smithi078 bash[22670]: cluster 2024-09-17T09:11:39.308838+0000 mgr.y (mgr.14532) 759 : cluster [DBG] pgmap v1277: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-09-17T09:11:41.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:40 smithi078 bash[32124]: cluster 2024-09-17T09:11:39.308838+0000 mgr.y (mgr.14532) 759 : cluster [DBG] pgmap v1277: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-09-17T09:11:42.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:41 smithi136 bash[24812]: audit 2024-09-17T09:11:40.234688+0000 mgr.y (mgr.14532) 760 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:42.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:41 smithi078 bash[22670]: audit 2024-09-17T09:11:40.234688+0000 mgr.y (mgr.14532) 760 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:42.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:41 smithi078 bash[32124]: audit 2024-09-17T09:11:40.234688+0000 mgr.y (mgr.14532) 760 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:43.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:42 smithi136 bash[24812]: cluster 2024-09-17T09:11:41.309603+0000 mgr.y (mgr.14532) 761 : cluster [DBG] pgmap v1278: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:43.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:42 smithi136 bash[24812]: audit 2024-09-17T09:11:42.098259+0000 mon.a (mon.0) 3826 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:42 smithi078 bash[32124]: cluster 2024-09-17T09:11:41.309603+0000 mgr.y (mgr.14532) 761 : cluster [DBG] pgmap v1278: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:43.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:42 smithi078 bash[32124]: audit 2024-09-17T09:11:42.098259+0000 mon.a (mon.0) 3826 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:42 smithi078 bash[22670]: cluster 2024-09-17T09:11:41.309603+0000 mgr.y (mgr.14532) 761 : cluster [DBG] pgmap v1278: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:43.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:42 smithi078 bash[22670]: audit 2024-09-17T09:11:42.098259+0000 mon.a (mon.0) 3826 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:45.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:44 smithi136 bash[24812]: cluster 2024-09-17T09:11:43.311477+0000 mgr.y (mgr.14532) 762 : cluster [DBG] pgmap v1279: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:45.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:44 smithi078 bash[22670]: cluster 2024-09-17T09:11:43.311477+0000 mgr.y (mgr.14532) 762 : cluster [DBG] pgmap v1279: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:45.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:44 smithi078 bash[32124]: cluster 2024-09-17T09:11:43.311477+0000 mgr.y (mgr.14532) 762 : cluster [DBG] pgmap v1279: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:47.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:46 smithi136 bash[24812]: cluster 2024-09-17T09:11:45.312238+0000 mgr.y (mgr.14532) 763 : cluster [DBG] pgmap v1280: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:47.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:46 smithi078 bash[32124]: cluster 2024-09-17T09:11:45.312238+0000 mgr.y (mgr.14532) 763 : cluster [DBG] pgmap v1280: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:47.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:46 smithi078 bash[22670]: cluster 2024-09-17T09:11:45.312238+0000 mgr.y (mgr.14532) 763 : cluster [DBG] pgmap v1280: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:48.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:11:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:11:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:11:49.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:48 smithi136 bash[24812]: cluster 2024-09-17T09:11:47.313030+0000 mgr.y (mgr.14532) 764 : cluster [DBG] pgmap v1281: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:49.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:48 smithi078 bash[22670]: cluster 2024-09-17T09:11:47.313030+0000 mgr.y (mgr.14532) 764 : cluster [DBG] pgmap v1281: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:49.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:48 smithi078 bash[32124]: cluster 2024-09-17T09:11:47.313030+0000 mgr.y (mgr.14532) 764 : cluster [DBG] pgmap v1281: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:50.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:11:50 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:11:51.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:50 smithi136 bash[24812]: cluster 2024-09-17T09:11:49.315007+0000 mgr.y (mgr.14532) 765 : cluster [DBG] pgmap v1282: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:51.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:50 smithi078 bash[22670]: cluster 2024-09-17T09:11:49.315007+0000 mgr.y (mgr.14532) 765 : cluster [DBG] pgmap v1282: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:51.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:50 smithi078 bash[32124]: cluster 2024-09-17T09:11:49.315007+0000 mgr.y (mgr.14532) 765 : cluster [DBG] pgmap v1282: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:11:52.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:51 smithi136 bash[24812]: audit 2024-09-17T09:11:50.243295+0000 mgr.y (mgr.14532) 766 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:52.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:51 smithi078 bash[32124]: audit 2024-09-17T09:11:50.243295+0000 mgr.y (mgr.14532) 766 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:52.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:51 smithi078 bash[22670]: audit 2024-09-17T09:11:50.243295+0000 mgr.y (mgr.14532) 766 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:11:53.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:52 smithi136 bash[24812]: cluster 2024-09-17T09:11:51.315731+0000 mgr.y (mgr.14532) 767 : cluster [DBG] pgmap v1283: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:53.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:52 smithi078 bash[32124]: cluster 2024-09-17T09:11:51.315731+0000 mgr.y (mgr.14532) 767 : cluster [DBG] pgmap v1283: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:53.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:52 smithi078 bash[22670]: cluster 2024-09-17T09:11:51.315731+0000 mgr.y (mgr.14532) 767 : cluster [DBG] pgmap v1283: 188 pgs: 188 active+clean; 761 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:11:55.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:54 smithi136 bash[24812]: cluster 2024-09-17T09:11:53.317687+0000 mgr.y (mgr.14532) 768 : cluster [DBG] pgmap v1284: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:55.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:54 smithi078 bash[32124]: cluster 2024-09-17T09:11:53.317687+0000 mgr.y (mgr.14532) 768 : cluster [DBG] pgmap v1284: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:55.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:54 smithi078 bash[22670]: cluster 2024-09-17T09:11:53.317687+0000 mgr.y (mgr.14532) 768 : cluster [DBG] pgmap v1284: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:57.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:56 smithi136 bash[24812]: cluster 2024-09-17T09:11:55.318661+0000 mgr.y (mgr.14532) 769 : cluster [DBG] pgmap v1285: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:57.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:56 smithi078 bash[32124]: cluster 2024-09-17T09:11:55.318661+0000 mgr.y (mgr.14532) 769 : cluster [DBG] pgmap v1285: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:57.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:56 smithi078 bash[22670]: cluster 2024-09-17T09:11:55.318661+0000 mgr.y (mgr.14532) 769 : cluster [DBG] pgmap v1285: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:58.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:57 smithi136 bash[24812]: audit 2024-09-17T09:11:57.128076+0000 mon.a (mon.0) 3827 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:58.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:11:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:11:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:11:58.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:57 smithi078 bash[32124]: audit 2024-09-17T09:11:57.128076+0000 mon.a (mon.0) 3827 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:58.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:57 smithi078 bash[22670]: audit 2024-09-17T09:11:57.128076+0000 mon.a (mon.0) 3827 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:11:59.234 INFO:tasks.workunit.client.0.smithi078.stderr:+ seq 1 10 2024-09-17T09:11:59.235 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj1 /etc/passwd 2024-09-17T09:11:59.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj2 /etc/passwd 2024-09-17T09:11:59.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:11:58 smithi136 bash[24812]: cluster 2024-09-17T09:11:57.319518+0000 mgr.y (mgr.14532) 770 : cluster [DBG] pgmap v1286: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:59.321 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj3 /etc/passwd 2024-09-17T09:11:59.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:11:58 smithi078 bash[32124]: cluster 2024-09-17T09:11:57.319518+0000 mgr.y (mgr.14532) 770 : cluster [DBG] pgmap v1286: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:59.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:11:58 smithi078 bash[22670]: cluster 2024-09-17T09:11:57.319518+0000 mgr.y (mgr.14532) 770 : cluster [DBG] pgmap v1286: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:11:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj4 /etc/passwd 2024-09-17T09:11:59.397 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj5 /etc/passwd 2024-09-17T09:11:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj6 /etc/passwd 2024-09-17T09:11:59.472 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj7 /etc/passwd 2024-09-17T09:11:59.510 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj8 /etc/passwd 2024-09-17T09:11:59.548 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj9 /etc/passwd 2024-09-17T09:11:59.584 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 6ae626d6-c710-458c-be40-9658aa0f9d14 put obj10 /etc/passwd 2024-09-17T09:11:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:+ sleep 30 2024-09-17T09:12:00.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:12:00 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:12:01.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:00 smithi136 bash[24812]: cluster 2024-09-17T09:11:59.320623+0000 mgr.y (mgr.14532) 771 : cluster [DBG] pgmap v1287: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:12:01.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:00 smithi078 bash[32124]: cluster 2024-09-17T09:11:59.320623+0000 mgr.y (mgr.14532) 771 : cluster [DBG] pgmap v1287: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:12:01.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:00 smithi078 bash[22670]: cluster 2024-09-17T09:11:59.320623+0000 mgr.y (mgr.14532) 771 : cluster [DBG] pgmap v1287: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:12:02.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:01 smithi136 bash[24812]: audit 2024-09-17T09:12:00.253520+0000 mgr.y (mgr.14532) 772 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:02.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:01 smithi078 bash[32124]: audit 2024-09-17T09:12:00.253520+0000 mgr.y (mgr.14532) 772 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:02.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:01 smithi078 bash[22670]: audit 2024-09-17T09:12:00.253520+0000 mgr.y (mgr.14532) 772 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:03.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:02 smithi136 bash[24812]: cluster 2024-09-17T09:12:01.321356+0000 mgr.y (mgr.14532) 773 : cluster [DBG] pgmap v1288: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:12:03.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:02 smithi078 bash[32124]: cluster 2024-09-17T09:12:01.321356+0000 mgr.y (mgr.14532) 773 : cluster [DBG] pgmap v1288: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:12:03.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:02 smithi078 bash[22670]: cluster 2024-09-17T09:12:01.321356+0000 mgr.y (mgr.14532) 773 : cluster [DBG] pgmap v1288: 188 pgs: 188 active+clean; 761 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-17T09:12:05.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:04 smithi136 bash[24812]: cluster 2024-09-17T09:12:03.323276+0000 mgr.y (mgr.14532) 774 : cluster [DBG] pgmap v1289: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 11 KiB/s wr, 61 op/s 2024-09-17T09:12:05.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:04 smithi078 bash[22670]: cluster 2024-09-17T09:12:03.323276+0000 mgr.y (mgr.14532) 774 : cluster [DBG] pgmap v1289: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 11 KiB/s wr, 61 op/s 2024-09-17T09:12:05.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:04 smithi078 bash[32124]: cluster 2024-09-17T09:12:03.323276+0000 mgr.y (mgr.14532) 774 : cluster [DBG] pgmap v1289: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 11 KiB/s wr, 61 op/s 2024-09-17T09:12:07.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:06 smithi136 bash[24812]: cluster 2024-09-17T09:12:05.324051+0000 mgr.y (mgr.14532) 775 : cluster [DBG] pgmap v1290: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-17T09:12:07.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:06 smithi078 bash[22670]: cluster 2024-09-17T09:12:05.324051+0000 mgr.y (mgr.14532) 775 : cluster [DBG] pgmap v1290: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-17T09:12:07.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:06 smithi078 bash[32124]: cluster 2024-09-17T09:12:05.324051+0000 mgr.y (mgr.14532) 775 : cluster [DBG] pgmap v1290: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-17T09:12:08.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:07 smithi136 bash[24812]: cluster 2024-09-17T09:12:07.932295+0000 mon.a (mon.0) 3828 : cluster [WRN] pool '6ae626d6-c710-458c-be40-9658aa0f9d14' is full (reached quota's max_objects: 10) 2024-09-17T09:12:08.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:07 smithi136 bash[24812]: cluster 2024-09-17T09:12:07.932929+0000 mon.a (mon.0) 3829 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:12:08.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:07 smithi136 bash[24812]: cluster 2024-09-17T09:12:07.941481+0000 mon.a (mon.0) 3830 : cluster [DBG] osdmap e779: 8 total, 8 up, 8 in 2024-09-17T09:12:08.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:12:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:12:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:07 smithi078 bash[22670]: cluster 2024-09-17T09:12:07.932295+0000 mon.a (mon.0) 3828 : cluster [WRN] pool '6ae626d6-c710-458c-be40-9658aa0f9d14' is full (reached quota's max_objects: 10) 2024-09-17T09:12:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:07 smithi078 bash[22670]: cluster 2024-09-17T09:12:07.932929+0000 mon.a (mon.0) 3829 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:12:08.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:07 smithi078 bash[22670]: cluster 2024-09-17T09:12:07.941481+0000 mon.a (mon.0) 3830 : cluster [DBG] osdmap e779: 8 total, 8 up, 8 in 2024-09-17T09:12:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:07 smithi078 bash[32124]: cluster 2024-09-17T09:12:07.932295+0000 mon.a (mon.0) 3828 : cluster [WRN] pool '6ae626d6-c710-458c-be40-9658aa0f9d14' is full (reached quota's max_objects: 10) 2024-09-17T09:12:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:07 smithi078 bash[32124]: cluster 2024-09-17T09:12:07.932929+0000 mon.a (mon.0) 3829 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-17T09:12:08.354 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:07 smithi078 bash[32124]: cluster 2024-09-17T09:12:07.941481+0000 mon.a (mon.0) 3830 : cluster [DBG] osdmap e779: 8 total, 8 up, 8 in 2024-09-17T09:12:09.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:08 smithi136 bash[24812]: cluster 2024-09-17T09:12:07.324828+0000 mgr.y (mgr.14532) 776 : cluster [DBG] pgmap v1291: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-17T09:12:09.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:08 smithi078 bash[32124]: cluster 2024-09-17T09:12:07.324828+0000 mgr.y (mgr.14532) 776 : cluster [DBG] pgmap v1291: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-17T09:12:09.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:08 smithi078 bash[22670]: cluster 2024-09-17T09:12:07.324828+0000 mgr.y (mgr.14532) 776 : cluster [DBG] pgmap v1291: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-17T09:12:10.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:12:10 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:12:11.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:11 smithi136 bash[24812]: cluster 2024-09-17T09:12:09.326839+0000 mgr.y (mgr.14532) 777 : cluster [DBG] pgmap v1293: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:12:11.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:11 smithi078 bash[32124]: cluster 2024-09-17T09:12:09.326839+0000 mgr.y (mgr.14532) 777 : cluster [DBG] pgmap v1293: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:12:11.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:11 smithi078 bash[22670]: cluster 2024-09-17T09:12:09.326839+0000 mgr.y (mgr.14532) 777 : cluster [DBG] pgmap v1293: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:12:12.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:12 smithi136 bash[24812]: audit 2024-09-17T09:12:10.265007+0000 mgr.y (mgr.14532) 778 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:12.353 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:12 smithi078 bash[22670]: audit 2024-09-17T09:12:10.265007+0000 mgr.y (mgr.14532) 778 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:12.353 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:12 smithi078 bash[32124]: audit 2024-09-17T09:12:10.265007+0000 mgr.y (mgr.14532) 778 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:13.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:13 smithi136 bash[24812]: cluster 2024-09-17T09:12:11.327624+0000 mgr.y (mgr.14532) 779 : cluster [DBG] pgmap v1294: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:12:13.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:13 smithi136 bash[24812]: audit 2024-09-17T09:12:12.162277+0000 mon.a (mon.0) 3831 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:12:13.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:13 smithi136 bash[24812]: audit 2024-09-17T09:12:12.164443+0000 mon.a (mon.0) 3832 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:13.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:13 smithi078 bash[22670]: cluster 2024-09-17T09:12:11.327624+0000 mgr.y (mgr.14532) 779 : cluster [DBG] pgmap v1294: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:12:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:13 smithi078 bash[22670]: audit 2024-09-17T09:12:12.162277+0000 mon.a (mon.0) 3831 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:12:13.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:13 smithi078 bash[22670]: audit 2024-09-17T09:12:12.164443+0000 mon.a (mon.0) 3832 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:13.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:13 smithi078 bash[32124]: cluster 2024-09-17T09:12:11.327624+0000 mgr.y (mgr.14532) 779 : cluster [DBG] pgmap v1294: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-17T09:12:13.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:13 smithi078 bash[32124]: audit 2024-09-17T09:12:12.162277+0000 mon.a (mon.0) 3831 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:12:13.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:13 smithi078 bash[32124]: audit 2024-09-17T09:12:12.164443+0000 mon.a (mon.0) 3832 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:15.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:15 smithi136 bash[24812]: cluster 2024-09-17T09:12:13.329562+0000 mgr.y (mgr.14532) 780 : cluster [DBG] pgmap v1295: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:15.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:15 smithi078 bash[22670]: cluster 2024-09-17T09:12:13.329562+0000 mgr.y (mgr.14532) 780 : cluster [DBG] pgmap v1295: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:15.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:15 smithi078 bash[32124]: cluster 2024-09-17T09:12:13.329562+0000 mgr.y (mgr.14532) 780 : cluster [DBG] pgmap v1295: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:17.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:17 smithi136 bash[24812]: cluster 2024-09-17T09:12:15.330324+0000 mgr.y (mgr.14532) 781 : cluster [DBG] pgmap v1296: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:17.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:17 smithi078 bash[22670]: cluster 2024-09-17T09:12:15.330324+0000 mgr.y (mgr.14532) 781 : cluster [DBG] pgmap v1296: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:17.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:17 smithi078 bash[32124]: cluster 2024-09-17T09:12:15.330324+0000 mgr.y (mgr.14532) 781 : cluster [DBG] pgmap v1296: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:18.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:12:17 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:12:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:19.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:19 smithi136 bash[24812]: cluster 2024-09-17T09:12:17.331131+0000 mgr.y (mgr.14532) 782 : cluster [DBG] pgmap v1297: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:19.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:19 smithi078 bash[22670]: cluster 2024-09-17T09:12:17.331131+0000 mgr.y (mgr.14532) 782 : cluster [DBG] pgmap v1297: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:19.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:19 smithi078 bash[32124]: cluster 2024-09-17T09:12:17.331131+0000 mgr.y (mgr.14532) 782 : cluster [DBG] pgmap v1297: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:12:20.543 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:12:20 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:12:21.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:21 smithi136 bash[24812]: cluster 2024-09-17T09:12:19.333058+0000 mgr.y (mgr.14532) 783 : cluster [DBG] pgmap v1298: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:12:21.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:21 smithi078 bash[22670]: cluster 2024-09-17T09:12:19.333058+0000 mgr.y (mgr.14532) 783 : cluster [DBG] pgmap v1298: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:12:21.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:21 smithi078 bash[32124]: cluster 2024-09-17T09:12:19.333058+0000 mgr.y (mgr.14532) 783 : cluster [DBG] pgmap v1298: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T09:12:22.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:22 smithi136 bash[24812]: audit 2024-09-17T09:12:20.267564+0000 mgr.y (mgr.14532) 784 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:22.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:22 smithi078 bash[22670]: audit 2024-09-17T09:12:20.267564+0000 mgr.y (mgr.14532) 784 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:22.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:22 smithi078 bash[32124]: audit 2024-09-17T09:12:20.267564+0000 mgr.y (mgr.14532) 784 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:23.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:23 smithi136 bash[24812]: cluster 2024-09-17T09:12:21.333773+0000 mgr.y (mgr.14532) 785 : cluster [DBG] pgmap v1299: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:23.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:23 smithi078 bash[22670]: cluster 2024-09-17T09:12:21.333773+0000 mgr.y (mgr.14532) 785 : cluster [DBG] pgmap v1299: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:23.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:23 smithi078 bash[32124]: cluster 2024-09-17T09:12:21.333773+0000 mgr.y (mgr.14532) 785 : cluster [DBG] pgmap v1299: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:25.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:25 smithi136 bash[24812]: cluster 2024-09-17T09:12:23.335747+0000 mgr.y (mgr.14532) 786 : cluster [DBG] pgmap v1300: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:25.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:25 smithi078 bash[32124]: cluster 2024-09-17T09:12:23.335747+0000 mgr.y (mgr.14532) 786 : cluster [DBG] pgmap v1300: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:25.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:25 smithi078 bash[22670]: cluster 2024-09-17T09:12:23.335747+0000 mgr.y (mgr.14532) 786 : cluster [DBG] pgmap v1300: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:27 smithi136 bash[24812]: cluster 2024-09-17T09:12:25.336526+0000 mgr.y (mgr.14532) 787 : cluster [DBG] pgmap v1301: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:27.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:27 smithi136 bash[24812]: audit 2024-09-17T09:12:27.192611+0000 mon.a (mon.0) 3833 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:27 smithi078 bash[32124]: cluster 2024-09-17T09:12:25.336526+0000 mgr.y (mgr.14532) 787 : cluster [DBG] pgmap v1301: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:27.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:27 smithi078 bash[32124]: audit 2024-09-17T09:12:27.192611+0000 mon.a (mon.0) 3833 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:27 smithi078 bash[22670]: cluster 2024-09-17T09:12:25.336526+0000 mgr.y (mgr.14532) 787 : cluster [DBG] pgmap v1301: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:27.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:27 smithi078 bash[22670]: audit 2024-09-17T09:12:27.192611+0000 mon.a (mon.0) 3833 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:28.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:12:27 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:12:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:29.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:29 smithi136 bash[24812]: cluster 2024-09-17T09:12:27.337279+0000 mgr.y (mgr.14532) 788 : cluster [DBG] pgmap v1302: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:29.603 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:29 smithi078 bash[22670]: cluster 2024-09-17T09:12:27.337279+0000 mgr.y (mgr.14532) 788 : cluster [DBG] pgmap v1302: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:29.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:29 smithi078 bash[32124]: cluster 2024-09-17T09:12:27.337279+0000 mgr.y (mgr.14532) 788 : cluster [DBG] pgmap v1302: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:29.623 INFO:tasks.workunit.client.0.smithi078.stderr:+ rados -p 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 put threemore /etc/passwd 2024-09-17T09:12:29.670 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 max_bytes 0 2024-09-17T09:12:29.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3228153691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0fed30 msgr2=0x7f771c0ff110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 --2- 172.21.15.78:0/3228153691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0fed30 0x7f771c0ff110 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f7714009bf0 tx=0x7f771401cad0 comp rx=0 tx=0).stop 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3228153691 shutdown_connections 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 --2- 172.21.15.78:0/3228153691 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c104140 0x7f771c1045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 --2- 172.21.15.78:0/3228153691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f771c0ff650 0x7f771c103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 --2- 172.21.15.78:0/3228153691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0fed30 0x7f771c0ff110 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3228153691 >> 172.21.15.78:0/3228153691 conn(0x7f771c0fa9c0 msgr2=0x7f771c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3228153691 shutdown_connections 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3228153691 wait complete. 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 Processor -- start 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- start start 2024-09-17T09:12:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c0ff650 0x7f771c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f771c104140 0x7f771c19f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c1a3800 0x7f771c1a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c1a41f0 con 0x7f771c1a3800 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c1a4360 con 0x7f771c104140 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c1a4520 con 0x7f771c0ff650 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c0ff650 0x7f771c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7722741640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c1a3800 0x7f771c1a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c0ff650 0x7f771c19eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49768/0 (socket says 172.21.15.78:49768) 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 -- 172.21.15.78:0/3256282644 learned_addr learned my addr 172.21.15.78:0/3256282644 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7722741640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c1a3800 0x7f771c1a3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60140/0 (socket says 172.21.15.78:60140) 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f772173f640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f771c104140 0x7f771c19f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:12:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 -- 172.21.15.78:0/3256282644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f771c104140 msgr2=0x7f771c19f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f771c104140 0x7f771c19f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 -- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c1a3800 msgr2=0x7f771c1a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c1a3800 0x7f771c1a3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009560 con 0x7f771c0ff650 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7722741640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c1a3800 0x7f771c1a3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f772173f640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f771c104140 0x7f771c19f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f7721f40640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c0ff650 0x7f771c19eec0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f7714000f90 tx=0x7f77140aee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140ad640 con 0x7f771c0ff650 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f77140adbf0 con 0x7f771c0ff650 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7714009820 con 0x7f771c0ff650 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714004670 con 0x7f771c0ff650 2024-09-17T09:12:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c1abc80 con 0x7f771c0ff650 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.788+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c068f70 con 0x7f771c0ff650 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.792+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f77140b4040 con 0x7f771c0ff650 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.792+0000 7f771affd640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f770406ce30 0x7f770406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.792+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(779..779 src has 1..779) v4 ==== 9467+0+0 (secure 0 0 0) 0x7f7714127b50 con 0x7f771c0ff650 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.792+0000 7f772173f640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f770406ce30 0x7f770406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.792+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=780}) v3 -- 0x7f7704078fd0 con 0x7f771c0ff650 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.792+0000 7f772173f640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f770406ce30 0x7f770406f2f0 secure :-1 s=READY pgs=3641 cs=0 l=1 rev1=1 crypto rx=0x7f771c1a0470 tx=0x7f7710005f90 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:12:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.796+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f77140c4060 con 0x7f771c0ff650 2024-09-17T09:12:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:29.968+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f771c1a0220 con 0x7f771c0ff650 2024-09-17T09:12:30.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:30.208+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 7 ==== osd_map(780..780 src has 1..780) v4 ==== 628+0+0 (secure 0 0 0) 0x7f77140f8b20 con 0x7f771c0ff650 2024-09-17T09:12:30.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:30.208+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=781}) v3 -- 0x7f7704079b70 con 0x7f771c0ff650 2024-09-17T09:12:30.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:30.220+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v780) v1 ==== 217+0+0 (secure 0 0 0) 0x7f77140b2070 con 0x7f771c0ff650 2024-09-17T09:12:30.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:30.328+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f771c1a0220 con 0x7f771c0ff650 2024-09-17T09:12:30.543 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:12:30 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:12:30.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:30 smithi136 bash[24812]: audit 2024-09-17T09:12:29.972121+0000 mon.c (mon.2) 334 : audit [INF] from='client.? 172.21.15.78:0/3256282644' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:30.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:30 smithi136 bash[24812]: audit 2024-09-17T09:12:29.972620+0000 mon.a (mon.0) 3834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:30.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:30 smithi078 bash[32124]: audit 2024-09-17T09:12:29.972121+0000 mon.c (mon.2) 334 : audit [INF] from='client.? 172.21.15.78:0/3256282644' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:30.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:30 smithi078 bash[32124]: audit 2024-09-17T09:12:29.972620+0000 mon.a (mon.0) 3834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:30.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:30 smithi078 bash[22670]: audit 2024-09-17T09:12:29.972121+0000 mon.c (mon.2) 334 : audit [INF] from='client.? 172.21.15.78:0/3256282644' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:30.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:30 smithi078 bash[22670]: audit 2024-09-17T09:12:29.972620+0000 mon.a (mon.0) 3834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:31.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.208+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 9 ==== osd_map(781..781 src has 1..781) v4 ==== 628+0+0 (secure 0 0 0) 0x7f77140fd0e0 con 0x7f771c0ff650 2024-09-17T09:12:31.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.208+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=782}) v3 -- 0x7f7704079da0 con 0x7f771c0ff650 2024-09-17T09:12:31.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.216+0000 7f771affd640 1 -- 172.21.15.78:0/3256282644 <== mon.2 v2:172.21.15.78:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v781) v1 ==== 217+0+0 (secure 0 0 0) 0x7f77140ba020 con 0x7f771c0ff650 2024-09-17T09:12:31.218 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_bytes = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f770406ce30 msgr2=0x7f770406f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f770406ce30 0x7f770406f2f0 secure :-1 s=READY pgs=3641 cs=0 l=1 rev1=1 crypto rx=0x7f771c1a0470 tx=0x7f7710005f90 comp rx=0 tx=0).stop 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c0ff650 msgr2=0x7f771c19eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c0ff650 0x7f771c19eec0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f7714000f90 tx=0x7f77140aee20 comp rx=0 tx=0).stop 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 shutdown_connections 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f770406ce30 0x7f770406f2f0 unknown :-1 s=CLOSED pgs=3641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c1a3800 0x7f771c1a3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f771c104140 0x7f771c19f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 --2- 172.21.15.78:0/3256282644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f771c0ff650 0x7f771c19eec0 unknown :-1 s=CLOSED pgs=3287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 >> 172.21.15.78:0/3256282644 conn(0x7f771c0fa9c0 msgr2=0x7f771c101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:12:31.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 shutdown_connections 2024-09-17T09:12:31.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.220+0000 7f77241a4640 1 -- 172.21.15.78:0/3256282644 wait complete. 2024-09-17T09:12:31.246 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool set-quota 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 max_objects 0 2024-09-17T09:12:31.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/2171915792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102160 msgr2=0x7f9ce0102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 --2- 172.21.15.78:0/2171915792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102160 0x7f9ce0102540 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009ce0 tx=0x7f9cd801cc80 comp rx=0 tx=0).stop 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/2171915792 shutdown_connections 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 --2- 172.21.15.78:0/2171915792 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0107290 0x7f9ce010ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 --2- 172.21.15.78:0/2171915792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0102b10 0x7f9ce0106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 --2- 172.21.15.78:0/2171915792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102160 0x7f9ce0102540 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/2171915792 >> 172.21.15.78:0/2171915792 conn(0x7f9ce00fdbe0 msgr2=0x7f9ce0100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/2171915792 shutdown_connections 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/2171915792 wait complete. 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 Processor -- start 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- start start 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0102160 0x7f9ce019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:31.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102b10 0x7f9ce019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0107290 0x7f9ce019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce019fe00 con 0x7f9ce0102b10 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce019ff70 con 0x7f9ce0107290 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce01a00e0 con 0x7f9ce0102160 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce56e3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0102160 0x7f9ce019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce4ee2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102b10 0x7f9ce019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce56e3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0102160 0x7f9ce019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49784/0 (socket says 172.21.15.78:49784) 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce56e3640 1 -- 172.21.15.78:0/146095832 learned_addr learned my addr 172.21.15.78:0/146095832 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce4ee2640 1 -- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0102160 msgr2=0x7f9ce019aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce4ee2640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0102160 0x7f9ce019aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce4ee2640 1 -- 172.21.15.78:0/146095832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0107290 msgr2=0x7f9ce019f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:31.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce4ee2640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0107290 0x7f9ce019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce4ee2640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80098e0 con 0x7f9ce0102b10 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce56e3640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0102160 0x7f9ce019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce4ee2640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102b10 0x7f9ce019b400 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400b3f0 tx=0x7f9cd400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4011830 con 0x7f9ce0102b10 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce01a03c0 con 0x7f9ce0102b10 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f9cd4011de0 con 0x7f9ce0102b10 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4010ca0 con 0x7f9ce0102b10 2024-09-17T09:12:31.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce01a7c80 con 0x7f9ce0102b10 2024-09-17T09:12:31.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.364+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce0103640 con 0x7f9ce0102b10 2024-09-17T09:12:31.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.368+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f9cd4010380 con 0x7f9ce0102b10 2024-09-17T09:12:31.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.368+0000 7f9cde7fc640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9cc806ce30 0x7f9cc806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:12:31.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.368+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(781..781 src has 1..781) v4 ==== 9467+0+0 (secure 0 0 0) 0x7f9cd408d310 con 0x7f9ce0102b10 2024-09-17T09:12:31.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.368+0000 7f9ce56e3640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9cc806ce30 0x7f9cc806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:12:31.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.368+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=782}) v3 -- 0x7f9cc8078f50 con 0x7f9ce0102b10 2024-09-17T09:12:31.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.368+0000 7f9ce56e3640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9cc806ce30 0x7f9cc806f2f0 secure :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80987b0 tx=0x7f9cd8019a20 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:12:31.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.372+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9cd4015060 con 0x7f9ce0102b10 2024-09-17T09:12:31.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:31.540+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f9ce019c220 con 0x7f9ce0102b10 2024-09-17T09:12:31.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:31 smithi136 bash[24812]: cluster 2024-09-17T09:12:29.339252+0000 mgr.y (mgr.14532) 789 : cluster [DBG] pgmap v1303: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:31.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:31 smithi136 bash[24812]: audit 2024-09-17T09:12:30.215591+0000 mon.a (mon.0) 3835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:12:31.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:31 smithi136 bash[24812]: cluster 2024-09-17T09:12:30.215775+0000 mon.a (mon.0) 3836 : cluster [DBG] osdmap e780: 8 total, 8 up, 8 in 2024-09-17T09:12:31.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:31 smithi136 bash[24812]: audit 2024-09-17T09:12:30.331217+0000 mon.c (mon.2) 335 : audit [INF] from='client.? 172.21.15.78:0/3256282644' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:31.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:31 smithi136 bash[24812]: audit 2024-09-17T09:12:30.331849+0000 mon.a (mon.0) 3837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[32124]: cluster 2024-09-17T09:12:29.339252+0000 mgr.y (mgr.14532) 789 : cluster [DBG] pgmap v1303: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:31.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[32124]: audit 2024-09-17T09:12:30.215591+0000 mon.a (mon.0) 3835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[32124]: cluster 2024-09-17T09:12:30.215775+0000 mon.a (mon.0) 3836 : cluster [DBG] osdmap e780: 8 total, 8 up, 8 in 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[32124]: audit 2024-09-17T09:12:30.331217+0000 mon.c (mon.2) 335 : audit [INF] from='client.? 172.21.15.78:0/3256282644' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[32124]: audit 2024-09-17T09:12:30.331849+0000 mon.a (mon.0) 3837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[22670]: cluster 2024-09-17T09:12:29.339252+0000 mgr.y (mgr.14532) 789 : cluster [DBG] pgmap v1303: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[22670]: audit 2024-09-17T09:12:30.215591+0000 mon.a (mon.0) 3835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[22670]: cluster 2024-09-17T09:12:30.215775+0000 mon.a (mon.0) 3836 : cluster [DBG] osdmap e780: 8 total, 8 up, 8 in 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[22670]: audit 2024-09-17T09:12:30.331217+0000 mon.c (mon.2) 335 : audit [INF] from='client.? 172.21.15.78:0/3256282644' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:31.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:31 smithi078 bash[22670]: audit 2024-09-17T09:12:30.331849+0000 mon.a (mon.0) 3837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-17T09:12:32.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:32.240+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 7 ==== osd_map(782..782 src has 1..782) v4 ==== 628+0+0 (secure 0 0 0) 0x7f9cd405ab30 con 0x7f9ce0102b10 2024-09-17T09:12:32.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:32.240+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=783}) v3 -- 0x7f9cc8079af0 con 0x7f9ce0102b10 2024-09-17T09:12:32.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:32.248+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v782) v1 ==== 221+0+0 (secure 0 0 0) 0x7f9cd4056770 con 0x7f9ce0102b10 2024-09-17T09:12:32.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:32.356+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f9ce0114810 con 0x7f9ce0102b10 2024-09-17T09:12:32.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:32 smithi136 bash[24812]: audit 2024-09-17T09:12:30.278994+0000 mgr.y (mgr.14532) 790 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:32.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:32 smithi136 bash[24812]: audit 2024-09-17T09:12:31.219438+0000 mon.a (mon.0) 3838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:12:32.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:32 smithi136 bash[24812]: cluster 2024-09-17T09:12:31.219639+0000 mon.a (mon.0) 3839 : cluster [DBG] osdmap e781: 8 total, 8 up, 8 in 2024-09-17T09:12:32.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:32 smithi136 bash[24812]: audit 2024-09-17T09:12:31.543512+0000 mon.a (mon.0) 3840 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:12:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[32124]: audit 2024-09-17T09:12:30.278994+0000 mgr.y (mgr.14532) 790 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:32.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[32124]: audit 2024-09-17T09:12:31.219438+0000 mon.a (mon.0) 3838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:12:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[32124]: cluster 2024-09-17T09:12:31.219639+0000 mon.a (mon.0) 3839 : cluster [DBG] osdmap e781: 8 total, 8 up, 8 in 2024-09-17T09:12:32.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[32124]: audit 2024-09-17T09:12:31.543512+0000 mon.a (mon.0) 3840 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:12:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[22670]: audit 2024-09-17T09:12:30.278994+0000 mgr.y (mgr.14532) 790 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[22670]: audit 2024-09-17T09:12:31.219438+0000 mon.a (mon.0) 3838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_bytes", "val": "0"}]': finished 2024-09-17T09:12:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[22670]: cluster 2024-09-17T09:12:31.219639+0000 mon.a (mon.0) 3839 : cluster [DBG] osdmap e781: 8 total, 8 up, 8 in 2024-09-17T09:12:32.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:32 smithi078 bash[22670]: audit 2024-09-17T09:12:31.543512+0000 mon.a (mon.0) 3840 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:12:33.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.252+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 9 ==== osd_map(783..783 src has 1..783) v4 ==== 628+0+0 (secure 0 0 0) 0x7f9cd405e260 con 0x7f9ce0102b10 2024-09-17T09:12:33.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.252+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=784}) v3 -- 0x7f9cc807a0b0 con 0x7f9ce0102b10 2024-09-17T09:12:33.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.260+0000 7f9cde7fc640 1 -- 172.21.15.78:0/146095832 <== mon.0 v2:172.21.15.78:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 v783) v1 ==== 221+0+0 (secure 0 0 0) 0x7f9cd4059d90 con 0x7f9ce0102b10 2024-09-17T09:12:33.261 INFO:tasks.workunit.client.0.smithi078.stderr:set-quota max_objects = 0 for pool 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 2024-09-17T09:12:33.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9cc806ce30 msgr2=0x7f9cc806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:33.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9cc806ce30 0x7f9cc806f2f0 secure :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80987b0 tx=0x7f9cd8019a20 comp rx=0 tx=0).stop 2024-09-17T09:12:33.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102b10 msgr2=0x7f9ce019b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:12:33.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102b10 0x7f9ce019b400 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400b3f0 tx=0x7f9cd400b8b0 comp rx=0 tx=0).stop 2024-09-17T09:12:33.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 shutdown_connections 2024-09-17T09:12:33.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f9cc806ce30 0x7f9cc806f2f0 unknown :-1 s=CLOSED pgs=3642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:33.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0107290 0x7f9ce019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:33.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0102b10 0x7f9ce019b400 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:33.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 --2- 172.21.15.78:0/146095832 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ce0102160 0x7f9ce019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:12:33.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 >> 172.21.15.78:0/146095832 conn(0x7f9ce00fdbe0 msgr2=0x7f9ce00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:12:33.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 shutdown_connections 2024-09-17T09:12:33.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:12:33.264+0000 7f9ce7947640 1 -- 172.21.15.78:0/146095832 wait complete. 2024-09-17T09:12:33.285 INFO:tasks.workunit.client.0.smithi078.stderr:+ sleep 30 2024-09-17T09:12:33.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:33 smithi136 bash[24812]: cluster 2024-09-17T09:12:31.340105+0000 mgr.y (mgr.14532) 791 : cluster [DBG] pgmap v1306: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:12:33.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:33 smithi136 bash[24812]: audit 2024-09-17T09:12:32.251073+0000 mon.a (mon.0) 3841 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:12:33.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:33 smithi136 bash[24812]: cluster 2024-09-17T09:12:32.251254+0000 mon.a (mon.0) 3842 : cluster [DBG] osdmap e782: 8 total, 8 up, 8 in 2024-09-17T09:12:33.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:33 smithi136 bash[24812]: audit 2024-09-17T09:12:32.362239+0000 mon.a (mon.0) 3843 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:12:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[32124]: cluster 2024-09-17T09:12:31.340105+0000 mgr.y (mgr.14532) 791 : cluster [DBG] pgmap v1306: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:12:33.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[32124]: audit 2024-09-17T09:12:32.251073+0000 mon.a (mon.0) 3841 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:12:33.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[32124]: cluster 2024-09-17T09:12:32.251254+0000 mon.a (mon.0) 3842 : cluster [DBG] osdmap e782: 8 total, 8 up, 8 in 2024-09-17T09:12:33.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[32124]: audit 2024-09-17T09:12:32.362239+0000 mon.a (mon.0) 3843 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:12:33.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[22670]: cluster 2024-09-17T09:12:31.340105+0000 mgr.y (mgr.14532) 791 : cluster [DBG] pgmap v1306: 188 pgs: 188 active+clean; 889 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T09:12:33.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[22670]: audit 2024-09-17T09:12:32.251073+0000 mon.a (mon.0) 3841 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:12:33.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[22670]: cluster 2024-09-17T09:12:32.251254+0000 mon.a (mon.0) 3842 : cluster [DBG] osdmap e782: 8 total, 8 up, 8 in 2024-09-17T09:12:33.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:33 smithi078 bash[22670]: audit 2024-09-17T09:12:32.362239+0000 mon.a (mon.0) 3843 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]: dispatch 2024-09-17T09:12:34.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:34 smithi136 bash[24812]: audit 2024-09-17T09:12:33.262289+0000 mon.a (mon.0) 3844 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:12:34.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:34 smithi136 bash[24812]: cluster 2024-09-17T09:12:33.262468+0000 mon.a (mon.0) 3845 : cluster [DBG] osdmap e783: 8 total, 8 up, 8 in 2024-09-17T09:12:34.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:34 smithi136 bash[24812]: cluster 2024-09-17T09:12:33.340924+0000 mgr.y (mgr.14532) 792 : cluster [DBG] pgmap v1309: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:12:34.603 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:34 smithi078 bash[32124]: audit 2024-09-17T09:12:33.262289+0000 mon.a (mon.0) 3844 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:12:34.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:34 smithi078 bash[32124]: cluster 2024-09-17T09:12:33.262468+0000 mon.a (mon.0) 3845 : cluster [DBG] osdmap e783: 8 total, 8 up, 8 in 2024-09-17T09:12:34.604 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:34 smithi078 bash[32124]: cluster 2024-09-17T09:12:33.340924+0000 mgr.y (mgr.14532) 792 : cluster [DBG] pgmap v1309: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:12:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:34 smithi078 bash[22670]: audit 2024-09-17T09:12:33.262289+0000 mon.a (mon.0) 3844 : audit [INF] from='client.? 172.21.15.78:0/146095832' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "field": "max_objects", "val": "0"}]': finished 2024-09-17T09:12:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:34 smithi078 bash[22670]: cluster 2024-09-17T09:12:33.262468+0000 mon.a (mon.0) 3845 : cluster [DBG] osdmap e783: 8 total, 8 up, 8 in 2024-09-17T09:12:34.604 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:34 smithi078 bash[22670]: cluster 2024-09-17T09:12:33.340924+0000 mgr.y (mgr.14532) 792 : cluster [DBG] pgmap v1309: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-17T09:12:36.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:36 smithi136 bash[24812]: cluster 2024-09-17T09:12:35.341723+0000 mgr.y (mgr.14532) 793 : cluster [DBG] pgmap v1310: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-17T09:12:36.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:36 smithi078 bash[22670]: cluster 2024-09-17T09:12:35.341723+0000 mgr.y (mgr.14532) 793 : cluster [DBG] pgmap v1310: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-17T09:12:36.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:36 smithi078 bash[32124]: cluster 2024-09-17T09:12:35.341723+0000 mgr.y (mgr.14532) 793 : cluster [DBG] pgmap v1310: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 2.5 KiB/s wr, 1 op/s 2024-09-17T09:12:37.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:37 smithi136 bash[24812]: audit 2024-09-17T09:12:37.020654+0000 mon.a (mon.0) 3846 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:12:37.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:37 smithi078 bash[22670]: audit 2024-09-17T09:12:37.020654+0000 mon.a (mon.0) 3846 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:12:37.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:37 smithi078 bash[32124]: audit 2024-09-17T09:12:37.020654+0000 mon.a (mon.0) 3846 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:12:38.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:12:37 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:12:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:38.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:38 smithi136 bash[24812]: cluster 2024-09-17T09:12:37.342409+0000 mgr.y (mgr.14532) 794 : cluster [DBG] pgmap v1311: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 2.1 KiB/s wr, 0 op/s 2024-09-17T09:12:38.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:38 smithi136 bash[24812]: audit 2024-09-17T09:12:37.611157+0000 mon.a (mon.0) 3847 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:12:38.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:38 smithi136 bash[24812]: audit 2024-09-17T09:12:37.612589+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:12:38.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:38 smithi136 bash[24812]: audit 2024-09-17T09:12:37.622946+0000 mon.a (mon.0) 3849 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:12:38.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[32124]: cluster 2024-09-17T09:12:37.342409+0000 mgr.y (mgr.14532) 794 : cluster [DBG] pgmap v1311: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 2.1 KiB/s wr, 0 op/s 2024-09-17T09:12:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[32124]: audit 2024-09-17T09:12:37.611157+0000 mon.a (mon.0) 3847 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:12:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[32124]: audit 2024-09-17T09:12:37.612589+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:12:38.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[32124]: audit 2024-09-17T09:12:37.622946+0000 mon.a (mon.0) 3849 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:12:38.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[22670]: cluster 2024-09-17T09:12:37.342409+0000 mgr.y (mgr.14532) 794 : cluster [DBG] pgmap v1311: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 2.1 KiB/s wr, 0 op/s 2024-09-17T09:12:38.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[22670]: audit 2024-09-17T09:12:37.611157+0000 mon.a (mon.0) 3847 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:12:38.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[22670]: audit 2024-09-17T09:12:37.612589+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:12:38.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:38 smithi078 bash[22670]: audit 2024-09-17T09:12:37.622946+0000 mon.a (mon.0) 3849 : audit [INF] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' 2024-09-17T09:12:40.543 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:12:40 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:12:40.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:40 smithi136 bash[24812]: cluster 2024-09-17T09:12:39.344419+0000 mgr.y (mgr.14532) 795 : cluster [DBG] pgmap v1312: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-17T09:12:40.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:40 smithi078 bash[22670]: cluster 2024-09-17T09:12:39.344419+0000 mgr.y (mgr.14532) 795 : cluster [DBG] pgmap v1312: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-17T09:12:40.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:40 smithi078 bash[32124]: cluster 2024-09-17T09:12:39.344419+0000 mgr.y (mgr.14532) 795 : cluster [DBG] pgmap v1312: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-17T09:12:41.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:41 smithi136 bash[24812]: audit 2024-09-17T09:12:40.290358+0000 mgr.y (mgr.14532) 796 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:41.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:41 smithi078 bash[22670]: audit 2024-09-17T09:12:40.290358+0000 mgr.y (mgr.14532) 796 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:41.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:41 smithi078 bash[32124]: audit 2024-09-17T09:12:40.290358+0000 mgr.y (mgr.14532) 796 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:42.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:42 smithi136 bash[24812]: cluster 2024-09-17T09:12:41.345242+0000 mgr.y (mgr.14532) 797 : cluster [DBG] pgmap v1313: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-17T09:12:42.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:42 smithi136 bash[24812]: audit 2024-09-17T09:12:42.222959+0000 mon.a (mon.0) 3850 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:42.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:42 smithi078 bash[22670]: cluster 2024-09-17T09:12:41.345242+0000 mgr.y (mgr.14532) 797 : cluster [DBG] pgmap v1313: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-17T09:12:42.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:42 smithi078 bash[22670]: audit 2024-09-17T09:12:42.222959+0000 mon.a (mon.0) 3850 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:42.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:42 smithi078 bash[32124]: cluster 2024-09-17T09:12:41.345242+0000 mgr.y (mgr.14532) 797 : cluster [DBG] pgmap v1313: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-17T09:12:42.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:42 smithi078 bash[32124]: audit 2024-09-17T09:12:42.222959+0000 mon.a (mon.0) 3850 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:44.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:44 smithi136 bash[24812]: cluster 2024-09-17T09:12:43.347088+0000 mgr.y (mgr.14532) 798 : cluster [DBG] pgmap v1314: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1014 B/s rd, 0 op/s 2024-09-17T09:12:44.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:44 smithi078 bash[32124]: cluster 2024-09-17T09:12:43.347088+0000 mgr.y (mgr.14532) 798 : cluster [DBG] pgmap v1314: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1014 B/s rd, 0 op/s 2024-09-17T09:12:44.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:44 smithi078 bash[22670]: cluster 2024-09-17T09:12:43.347088+0000 mgr.y (mgr.14532) 798 : cluster [DBG] pgmap v1314: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1014 B/s rd, 0 op/s 2024-09-17T09:12:46.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:46 smithi136 bash[24812]: cluster 2024-09-17T09:12:45.347817+0000 mgr.y (mgr.14532) 799 : cluster [DBG] pgmap v1315: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:46.853 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:46 smithi078 bash[32124]: cluster 2024-09-17T09:12:45.347817+0000 mgr.y (mgr.14532) 799 : cluster [DBG] pgmap v1315: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:46.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:46 smithi078 bash[22670]: cluster 2024-09-17T09:12:45.347817+0000 mgr.y (mgr.14532) 799 : cluster [DBG] pgmap v1315: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:48.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:12:47 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:12:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:48.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:48 smithi136 bash[24812]: cluster 2024-09-17T09:12:47.348562+0000 mgr.y (mgr.14532) 800 : cluster [DBG] pgmap v1316: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:48.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:48 smithi078 bash[22670]: cluster 2024-09-17T09:12:47.348562+0000 mgr.y (mgr.14532) 800 : cluster [DBG] pgmap v1316: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:48.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:48 smithi078 bash[32124]: cluster 2024-09-17T09:12:47.348562+0000 mgr.y (mgr.14532) 800 : cluster [DBG] pgmap v1316: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:50.793 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:12:50 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:12:50.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:50 smithi136 bash[24812]: cluster 2024-09-17T09:12:49.350476+0000 mgr.y (mgr.14532) 801 : cluster [DBG] pgmap v1317: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:50.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:50 smithi078 bash[22670]: cluster 2024-09-17T09:12:49.350476+0000 mgr.y (mgr.14532) 801 : cluster [DBG] pgmap v1317: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:50.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:50 smithi078 bash[32124]: cluster 2024-09-17T09:12:49.350476+0000 mgr.y (mgr.14532) 801 : cluster [DBG] pgmap v1317: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:51.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:51 smithi136 bash[24812]: audit 2024-09-17T09:12:50.301909+0000 mgr.y (mgr.14532) 802 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:51.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:51 smithi078 bash[22670]: audit 2024-09-17T09:12:50.301909+0000 mgr.y (mgr.14532) 802 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:51.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:51 smithi078 bash[32124]: audit 2024-09-17T09:12:50.301909+0000 mgr.y (mgr.14532) 802 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:12:52.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:52 smithi136 bash[24812]: cluster 2024-09-17T09:12:51.351214+0000 mgr.y (mgr.14532) 803 : cluster [DBG] pgmap v1318: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:52.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:52 smithi078 bash[22670]: cluster 2024-09-17T09:12:51.351214+0000 mgr.y (mgr.14532) 803 : cluster [DBG] pgmap v1318: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:52.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:52 smithi078 bash[32124]: cluster 2024-09-17T09:12:51.351214+0000 mgr.y (mgr.14532) 803 : cluster [DBG] pgmap v1318: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:54.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:54 smithi136 bash[24812]: cluster 2024-09-17T09:12:53.353219+0000 mgr.y (mgr.14532) 804 : cluster [DBG] pgmap v1319: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:54.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:54 smithi078 bash[22670]: cluster 2024-09-17T09:12:53.353219+0000 mgr.y (mgr.14532) 804 : cluster [DBG] pgmap v1319: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:54.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:54 smithi078 bash[32124]: cluster 2024-09-17T09:12:53.353219+0000 mgr.y (mgr.14532) 804 : cluster [DBG] pgmap v1319: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:12:56.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:56 smithi136 bash[24812]: cluster 2024-09-17T09:12:55.354000+0000 mgr.y (mgr.14532) 805 : cluster [DBG] pgmap v1320: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:56.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:56 smithi078 bash[22670]: cluster 2024-09-17T09:12:55.354000+0000 mgr.y (mgr.14532) 805 : cluster [DBG] pgmap v1320: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:56.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:56 smithi078 bash[32124]: cluster 2024-09-17T09:12:55.354000+0000 mgr.y (mgr.14532) 805 : cluster [DBG] pgmap v1320: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:57.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:57 smithi136 bash[24812]: audit 2024-09-17T09:12:57.251554+0000 mon.a (mon.0) 3851 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:57.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:57 smithi078 bash[22670]: audit 2024-09-17T09:12:57.251554+0000 mon.a (mon.0) 3851 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:57.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:57 smithi078 bash[32124]: audit 2024-09-17T09:12:57.251554+0000 mon.a (mon.0) 3851 : audit [DBG] from='mgr.14532 172.21.15.78:0/3330266747' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:58.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:12:57 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:12:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:58.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:12:58 smithi136 bash[24812]: cluster 2024-09-17T09:12:57.354769+0000 mgr.y (mgr.14532) 806 : cluster [DBG] pgmap v1321: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:58.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:12:58 smithi078 bash[22670]: cluster 2024-09-17T09:12:57.354769+0000 mgr.y (mgr.14532) 806 : cluster [DBG] pgmap v1321: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:12:58.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:12:58 smithi078 bash[32124]: cluster 2024-09-17T09:12:57.354769+0000 mgr.y (mgr.14532) 806 : cluster [DBG] pgmap v1321: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:13:00.793 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:13:00 smithi136 bash[49406]: debug there is no tcmu-runner data available 2024-09-17T09:13:00.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:00 smithi136 bash[24812]: cluster 2024-09-17T09:12:59.356680+0000 mgr.y (mgr.14532) 807 : cluster [DBG] pgmap v1322: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:13:00.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:00 smithi078 bash[22670]: cluster 2024-09-17T09:12:59.356680+0000 mgr.y (mgr.14532) 807 : cluster [DBG] pgmap v1322: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:13:00.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:00 smithi078 bash[32124]: cluster 2024-09-17T09:12:59.356680+0000 mgr.y (mgr.14532) 807 : cluster [DBG] pgmap v1322: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:13:01.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:01 smithi136 bash[24812]: audit 2024-09-17T09:13:00.313389+0000 mgr.y (mgr.14532) 808 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:13:01.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:01 smithi078 bash[22670]: audit 2024-09-17T09:13:00.313389+0000 mgr.y (mgr.14532) 808 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:13:01.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:01 smithi078 bash[32124]: audit 2024-09-17T09:13:00.313389+0000 mgr.y (mgr.14532) 808 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T09:13:02.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:02 smithi136 bash[24812]: cluster 2024-09-17T09:13:01.357482+0000 mgr.y (mgr.14532) 809 : cluster [DBG] pgmap v1323: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:13:02.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:02 smithi078 bash[22670]: cluster 2024-09-17T09:13:01.357482+0000 mgr.y (mgr.14532) 809 : cluster [DBG] pgmap v1323: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:13:02.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:02 smithi078 bash[32124]: cluster 2024-09-17T09:13:01.357482+0000 mgr.y (mgr.14532) 809 : cluster [DBG] pgmap v1323: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-17T09:13:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool delete 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218 --yes-i-really-really-mean-it 2024-09-17T09:13:03.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- 172.21.15.78:0/148374548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc1072a0 msgr2=0x7f8bbc10ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:03.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/148374548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc1072a0 0x7f8bbc10ee20 secure :-1 s=READY pgs=3288 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009bf0 tx=0x7f8bb401caa0 comp rx=0 tx=0).stop 2024-09-17T09:13:03.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- 172.21.15.78:0/148374548 shutdown_connections 2024-09-17T09:13:03.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/148374548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc1072a0 0x7f8bbc10ee20 unknown :-1 s=CLOSED pgs=3288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/148374548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bbc102b20 0x7f8bbc106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/148374548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bbc102170 0x7f8bbc102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- 172.21.15.78:0/148374548 >> 172.21.15.78:0/148374548 conn(0x7f8bbc0fdc10 msgr2=0x7f8bbc100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:13:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- 172.21.15.78:0/148374548 shutdown_connections 2024-09-17T09:13:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- 172.21.15.78:0/148374548 wait complete. 2024-09-17T09:13:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 Processor -- start 2024-09-17T09:13:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- start start 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bbc102170 0x7f8bbc19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc102b20 0x7f8bbc19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bbc1072a0 0x7f8bbc19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19fd00 con 0x7f8bbc1072a0 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19fe70 con 0x7f8bbc102170 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bc10ea640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19ffe0 con 0x7f8bbc102b20 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc102b20 0x7f8bbc19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:13:03.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc102b20 0x7f8bbc19b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:50640/0 (socket says 172.21.15.78:50640) 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bbb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bbc1072a0 0x7f8bbc19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 -- 172.21.15.78:0/2093162682 learned_addr learned my addr 172.21.15.78:0/2093162682 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 -- 172.21.15.78:0/2093162682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bbc102170 msgr2=0x7f8bbc19adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bbc102170 0x7f8bbc19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 -- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bbc1072a0 msgr2=0x7f8bbc19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bbc1072a0 0x7f8bbc19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4009560 con 0x7f8bbc102b20 2024-09-17T09:13:03.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bbb59e640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bbc1072a0 0x7f8bbc19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T09:13:03.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bba59c640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc102b20 0x7f8bbc19b300 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c970 tx=0x7f8bac00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:13:03.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.412+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac007bb0 con 0x7f8bbc102b20 2024-09-17T09:13:03.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f8bac007d10 con 0x7f8bbc102b20 2024-09-17T09:13:03.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb4009820 con 0x7f8bbc102b20 2024-09-17T09:13:03.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac004c90 con 0x7f8bbc102b20 2024-09-17T09:13:03.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc1a79b0 con 0x7f8bbc102b20 2024-09-17T09:13:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc103650 con 0x7f8bbc102b20 2024-09-17T09:13:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7f8bac004e10 con 0x7f8bbc102b20 2024-09-17T09:13:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bb3fff640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f8ba806ce30 0x7f8ba806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(783..783 src has 1..783) v4 ==== 9467+0+0 (secure 0 0 0) 0x7f8bac08cf30 con 0x7f8bbc102b20 2024-09-17T09:13:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bbad9d640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f8ba806ce30 0x7f8ba806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:13:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=784}) v3 -- 0x7f8ba8078f50 con 0x7f8bbc102b20 2024-09-17T09:13:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.416+0000 7f8bbad9d640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f8ba806ce30 0x7f8ba806f2f0 secure :-1 s=READY pgs=3643 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4005dd0 tx=0x7f8ba4005d20 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:13:03.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.420+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8bac01d060 con 0x7f8bbc102b20 2024-09-17T09:13:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:03.596+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8bbc19c120 con 0x7f8bbc102b20 2024-09-17T09:13:04.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.520+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 7 ==== osd_map(784..784 src has 1..784) v4 ==== 296+0+0 (secure 0 0 0) 0x7f8bac0600d0 con 0x7f8bbc102b20 2024-09-17T09:13:04.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.520+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=785}) v3 -- 0x7f8ba80797e0 con 0x7f8bbc102b20 2024-09-17T09:13:04.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.520+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]=0 pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' removed v784) v1 ==== 248+0+0 (secure 0 0 0) 0x7f8bac059e50 con 0x7f8bbc102b20 2024-09-17T09:13:04.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.628+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8bbc114920 con 0x7f8bbc102b20 2024-09-17T09:13:04.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bb3fff640 1 -- 172.21.15.78:0/2093162682 <== mon.2 v2:172.21.15.78:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]=0 pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' does not exist v784) v1 ==== 255+0+0 (secure 0 0 0) 0x7f8bac05de00 con 0x7f8bbc102b20 2024-09-17T09:13:04.633 INFO:tasks.workunit.client.0.smithi078.stderr:pool '9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218' does not exist 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f8ba806ce30 msgr2=0x7f8ba806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f8ba806ce30 0x7f8ba806f2f0 secure :-1 s=READY pgs=3643 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4005dd0 tx=0x7f8ba4005d20 comp rx=0 tx=0).stop 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc102b20 msgr2=0x7f8bbc19b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc102b20 0x7f8bbc19b300 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c970 tx=0x7f8bac00ce30 comp rx=0 tx=0).stop 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 shutdown_connections 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7f8ba806ce30 0x7f8ba806f2f0 unknown :-1 s=CLOSED pgs=3643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bbc1072a0 0x7f8bbc19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bbc102b20 0x7f8bbc19b300 unknown :-1 s=CLOSED pgs=3289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 --2- 172.21.15.78:0/2093162682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bbc102170 0x7f8bbc19adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 >> 172.21.15.78:0/2093162682 conn(0x7f8bbc0fdc10 msgr2=0x7f8bbc0fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:13:04.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 shutdown_connections 2024-09-17T09:13:04.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.632+0000 7f8bc10ea640 1 -- 172.21.15.78:0/2093162682 wait complete. 2024-09-17T09:13:04.650 INFO:tasks.workunit.client.0.smithi078.stderr:+ ceph osd pool delete 6ae626d6-c710-458c-be40-9658aa0f9d14 6ae626d6-c710-458c-be40-9658aa0f9d14 --yes-i-really-really-mean-it 2024-09-17T09:13:04.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 -- 172.21.15.78:0/2932175175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd04103fb0 msgr2=0x7efd0410bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:04.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/2932175175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd04103fb0 0x7efd0410bb30 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009ce0 tx=0x7efcfc01cc80 comp rx=0 tx=0).stop 2024-09-17T09:13:04.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 -- 172.21.15.78:0/2932175175 shutdown_connections 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/2932175175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd04103fb0 0x7efd0410bb30 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/2932175175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd040ff830 0x7efd04103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/2932175175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd040fee80 0x7efd040ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 -- 172.21.15.78:0/2932175175 >> 172.21.15.78:0/2932175175 conn(0x7efd040fa980 msgr2=0x7efd040fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 -- 172.21.15.78:0/2932175175 shutdown_connections 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 -- 172.21.15.78:0/2932175175 wait complete. 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 Processor -- start 2024-09-17T09:13:04.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.768+0000 7efd0ba6e640 1 -- start start 2024-09-17T09:13:04.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd040fee80 0x7efd04197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:04.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd040ff830 0x7efd041983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:04.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd04103fb0 0x7efd0419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:04.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0419cde0 con 0x7efd040fee80 2024-09-17T09:13:04.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0419cf50 con 0x7efd04103fb0 2024-09-17T09:13:04.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0419d0c0 con 0x7efd040ff830 2024-09-17T09:13:04.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd040fee80 0x7efd04197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd040fee80 0x7efd04197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43984/0 (socket says 172.21.15.78:43984) 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd09009640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd040ff830 0x7efd041983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 -- 172.21.15.78:0/3851104681 learned_addr learned my addr 172.21.15.78:0/3851104681 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0a00b640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd04103fb0 0x7efd0419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 -- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd040ff830 msgr2=0x7efd041983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd040ff830 0x7efd041983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 -- 172.21.15.78:0/3851104681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd04103fb0 msgr2=0x7efd0419c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd04103fb0 0x7efd0419c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0098e0 con 0x7efd040fee80 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0980a640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd040fee80 0x7efd04197ea0 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7efcf400e9f0 tx=0x7efcf400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4009710 con 0x7efd040fee80 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0419d3a0 con 0x7efd040fee80 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(23 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7efcf400cd80 con 0x7efd040fee80 2024-09-17T09:13:04.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4018680 con 0x7efd040fee80 2024-09-17T09:13:04.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd041a4c60 con 0x7efd040fee80 2024-09-17T09:13:04.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd04100360 con 0x7efd040fee80 2024-09-17T09:13:04.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) v1 ==== 90820+0+0 (secure 0 0 0) 0x7efcf4010430 con 0x7efd040fee80 2024-09-17T09:13:04.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efcfaffd640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7efcf006ce30 0x7efcf006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T09:13:04.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(784..784 src has 1..784) v4 ==== 9079+0+0 (secure 0 0 0) 0x7efcf4014070 con 0x7efd040fee80 2024-09-17T09:13:04.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efd09009640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7efcf006ce30 0x7efcf006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T09:13:04.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.772+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=785}) v3 -- 0x7efcf0078730 con 0x7efd040fee80 2024-09-17T09:13:04.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.776+0000 7efd09009640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7efcf006ce30 0x7efcf006f2f0 secure :-1 s=READY pgs=3644 cs=0 l=1 rev1=1 crypto rx=0x7efd04199450 tx=0x7efd0000a2d0 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T09:13:04.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.780+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efcf4052e20 con 0x7efd040fee80 2024-09-17T09:13:04.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:04 smithi136 bash[24812]: cluster 2024-09-17T09:13:03.359434+0000 mgr.y (mgr.14532) 810 : cluster [DBG] pgmap v1324: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:13:04.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:04 smithi136 bash[24812]: audit 2024-09-17T09:13:03.599092+0000 mon.c (mon.2) 336 : audit [INF] from='client.? 172.21.15.78:0/2093162682' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:04.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:04 smithi136 bash[24812]: audit 2024-09-17T09:13:03.599781+0000 mon.a (mon.0) 3852 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:04.853 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:04 smithi078 bash[22670]: cluster 2024-09-17T09:13:03.359434+0000 mgr.y (mgr.14532) 810 : cluster [DBG] pgmap v1324: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:13:04.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:04 smithi078 bash[22670]: audit 2024-09-17T09:13:03.599092+0000 mon.c (mon.2) 336 : audit [INF] from='client.? 172.21.15.78:0/2093162682' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:04.854 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:04 smithi078 bash[22670]: audit 2024-09-17T09:13:03.599781+0000 mon.a (mon.0) 3852 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:04.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:04 smithi078 bash[32124]: cluster 2024-09-17T09:13:03.359434+0000 mgr.y (mgr.14532) 810 : cluster [DBG] pgmap v1324: 188 pgs: 188 active+clean; 902 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T09:13:04.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:04 smithi078 bash[32124]: audit 2024-09-17T09:13:03.599092+0000 mon.c (mon.2) 336 : audit [INF] from='client.? 172.21.15.78:0/2093162682' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:04.854 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:04 smithi078 bash[32124]: audit 2024-09-17T09:13:03.599781+0000 mon.a (mon.0) 3852 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:04.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:04.948+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd04199200 con 0x7efd040fee80 2024-09-17T09:13:05.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.520+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 7 ==== osd_map(785..785 src has 1..785) v4 ==== 296+0+0 (secure 0 0 0) 0x7efcf40109f0 con 0x7efd040fee80 2024-09-17T09:13:05.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.520+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=786}) v3 -- 0x7efcf0078f80 con 0x7efd040fee80 2024-09-17T09:13:05.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.536+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]=0 pool '6ae626d6-c710-458c-be40-9658aa0f9d14' removed v785) v1 ==== 248+0+0 (secure 0 0 0) 0x7efcf408d070 con 0x7efd040fee80 2024-09-17T09:13:05.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd040ff260 con 0x7efd040fee80 2024-09-17T09:13:05.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efcfaffd640 1 -- 172.21.15.78:0/3851104681 <== mon.0 v2:172.21.15.78:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]=0 pool '6ae626d6-c710-458c-be40-9658aa0f9d14' does not exist v785) v1 ==== 255+0+0 (secure 0 0 0) 0x7efcf405a600 con 0x7efd040fee80 2024-09-17T09:13:05.650 INFO:tasks.workunit.client.0.smithi078.stderr:pool '6ae626d6-c710-458c-be40-9658aa0f9d14' does not exist 2024-09-17T09:13:05.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7efcf006ce30 msgr2=0x7efcf006f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:05.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7efcf006ce30 0x7efcf006f2f0 secure :-1 s=READY pgs=3644 cs=0 l=1 rev1=1 crypto rx=0x7efd04199450 tx=0x7efd0000a2d0 comp rx=0 tx=0).stop 2024-09-17T09:13:05.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd040fee80 msgr2=0x7efd04197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T09:13:05.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd040fee80 0x7efd04197ea0 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7efcf400e9f0 tx=0x7efcf400eeb0 comp rx=0 tx=0).stop 2024-09-17T09:13:05.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 shutdown_connections 2024-09-17T09:13:05.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:6800/1209266769,v1:172.21.15.78:6801/1209266769] conn(0x7efcf006ce30 0x7efcf006f2f0 unknown :-1 s=CLOSED pgs=3644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:05.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd04103fb0 0x7efd0419c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:05.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd040ff830 0x7efd041983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:05.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 --2- 172.21.15.78:0/3851104681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd040fee80 0x7efd04197ea0 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T09:13:05.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 >> 172.21.15.78:0/3851104681 conn(0x7efd040fa980 msgr2=0x7efd040fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T09:13:05.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 shutdown_connections 2024-09-17T09:13:05.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-17T09:13:05.648+0000 7efd0ba6e640 1 -- 172.21.15.78:0/3851104681 wait complete. 2024-09-17T09:13:05.668 INFO:tasks.workunit.client.0.smithi078.stdout:OK 2024-09-17T09:13:05.669 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK 2024-09-17T09:13:05.670 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T09:13:05.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T09:13:05.724 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-09-17T09:13:05.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T09:13:05.777 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[22670]: audit 2024-09-17T09:13:04.516025+0000 mon.a (mon.0) 3853 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T09:13:05.778 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[22670]: cluster 2024-09-17T09:13:04.516240+0000 mon.a (mon.0) 3854 : cluster [DBG] osdmap e784: 8 total, 8 up, 8 in 2024-09-17T09:13:05.778 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[22670]: audit 2024-09-17T09:13:04.633509+0000 mon.c (mon.2) 337 : audit [INF] from='client.? 172.21.15.78:0/2093162682' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.778 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[22670]: audit 2024-09-17T09:13:04.634235+0000 mon.a (mon.0) 3855 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.778 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[22670]: audit 2024-09-17T09:13:04.952156+0000 mon.a (mon.0) 3856 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.778 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[32124]: audit 2024-09-17T09:13:04.516025+0000 mon.a (mon.0) 3853 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T09:13:05.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[32124]: cluster 2024-09-17T09:13:04.516240+0000 mon.a (mon.0) 3854 : cluster [DBG] osdmap e784: 8 total, 8 up, 8 in 2024-09-17T09:13:05.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[32124]: audit 2024-09-17T09:13:04.633509+0000 mon.c (mon.2) 337 : audit [INF] from='client.? 172.21.15.78:0/2093162682' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[32124]: audit 2024-09-17T09:13:04.634235+0000 mon.a (mon.0) 3855 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:05 smithi078 bash[32124]: audit 2024-09-17T09:13:04.952156+0000 mon.a (mon.0) 3856 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:05 smithi136 bash[24812]: audit 2024-09-17T09:13:04.516025+0000 mon.a (mon.0) 3853 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T09:13:05.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:05 smithi136 bash[24812]: cluster 2024-09-17T09:13:04.516240+0000 mon.a (mon.0) 3854 : cluster [DBG] osdmap e784: 8 total, 8 up, 8 in 2024-09-17T09:13:05.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:05 smithi136 bash[24812]: audit 2024-09-17T09:13:04.633509+0000 mon.c (mon.2) 337 : audit [INF] from='client.? 172.21.15.78:0/2093162682' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:05 smithi136 bash[24812]: audit 2024-09-17T09:13:04.634235+0000 mon.a (mon.0) 3855 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "pool2": "9c7fb9b8-eeb6-4656-9d45-0fcb8bba8218", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:05.793 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:05 smithi136 bash[24812]: audit 2024-09-17T09:13:04.952156+0000 mon.a (mon.0) 3856 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:06.079 DEBUG:teuthology.parallel:result is None 2024-09-17T09:13:06.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T09:13:06.133 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T09:13:06.133 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-17T09:13:06.208 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T09:13:06.208 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T09:13:06.218 INFO:tasks.cephadm:Teardown begin 2024-09-17T09:13:06.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:13:06.266 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:13:06.281 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T09:13:06.281 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T09:13:06.313 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T09:13:06.330 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T09:13:06.330 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-17T09:13:06.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a 2024-09-17T09:13:06.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:06 smithi136 bash[24812]: cluster 2024-09-17T09:13:05.360216+0000 mgr.y (mgr.14532) 811 : cluster [DBG] pgmap v1326: 176 pgs: 176 active+clean; 710 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:13:06.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:06 smithi136 bash[24812]: cluster 2024-09-17T09:13:05.510669+0000 mon.a (mon.0) 3857 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:13:06.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:06 smithi136 bash[24812]: audit 2024-09-17T09:13:05.538714+0000 mon.a (mon.0) 3858 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T09:13:06.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:06 smithi136 bash[24812]: cluster 2024-09-17T09:13:05.539376+0000 mon.a (mon.0) 3859 : cluster [DBG] osdmap e785: 8 total, 8 up, 8 in 2024-09-17T09:13:06.544 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:06 smithi136 bash[24812]: audit 2024-09-17T09:13:05.651450+0000 mon.a (mon.0) 3860 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:06.622 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 systemd[1]: Stopping Ceph mon.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:06.622 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22670]: cluster 2024-09-17T09:13:05.360216+0000 mgr.y (mgr.14532) 811 : cluster [DBG] pgmap v1326: 176 pgs: 176 active+clean; 710 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:13:06.622 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22670]: cluster 2024-09-17T09:13:05.510669+0000 mon.a (mon.0) 3857 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:13:06.622 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22670]: audit 2024-09-17T09:13:05.538714+0000 mon.a (mon.0) 3858 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T09:13:06.622 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22670]: cluster 2024-09-17T09:13:05.539376+0000 mon.a (mon.0) 3859 : cluster [DBG] osdmap e785: 8 total, 8 up, 8 in 2024-09-17T09:13:06.622 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22670]: audit 2024-09-17T09:13:05.651450+0000 mon.a (mon.0) 3860 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:06.623 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22670]: debug 2024-09-17T09:13:06.540+0000 7f921174c640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-17T09:13:06.623 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22670]: debug 2024-09-17T09:13:06.540+0000 7f921174c640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T09:13:06.623 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22923]: [17/Sep/2024:09:13:06] ENGINE Bus STOPPING 2024-09-17T09:13:06.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[32124]: cluster 2024-09-17T09:13:05.360216+0000 mgr.y (mgr.14532) 811 : cluster [DBG] pgmap v1326: 176 pgs: 176 active+clean; 710 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T09:13:06.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[32124]: cluster 2024-09-17T09:13:05.510669+0000 mon.a (mon.0) 3857 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-17T09:13:06.623 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[32124]: audit 2024-09-17T09:13:05.538714+0000 mon.a (mon.0) 3858 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T09:13:06.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[32124]: cluster 2024-09-17T09:13:05.539376+0000 mon.a (mon.0) 3859 : cluster [DBG] osdmap e785: 8 total, 8 up, 8 in 2024-09-17T09:13:06.624 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[32124]: audit 2024-09-17T09:13:05.651450+0000 mon.a (mon.0) 3860 : audit [INF] from='client.? 172.21.15.78:0/3851104681' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6ae626d6-c710-458c-be40-9658aa0f9d14", "pool2": "6ae626d6-c710-458c-be40-9658aa0f9d14", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T09:13:07.043 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22923]: [17/Sep/2024:09:13:06] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T09:13:07.043 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22923]: [17/Sep/2024:09:13:06] ENGINE Bus STOPPED 2024-09-17T09:13:07.044 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:06 smithi078 bash[22923]: [17/Sep/2024:09:13:06] ENGINE Bus STARTING 2024-09-17T09:13:07.044 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:07 smithi078 bash[22923]: [17/Sep/2024:09:13:07] ENGINE Serving on http://:::9283 2024-09-17T09:13:07.353 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:07 smithi078 bash[22923]: [17/Sep/2024:09:13:07] ENGINE Bus STARTED 2024-09-17T09:13:07.675 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a.service' 2024-09-17T09:13:07.683 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:07 smithi078 bash[132105]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-mon-a 2024-09-17T09:13:07.683 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:07 smithi078 bash[132182]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-mon-a 2024-09-17T09:13:07.683 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:07 smithi078 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T09:13:07.683 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 17 09:13:07 smithi078 systemd[1]: Stopped Ceph mon.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T09:13:07.697 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:07.697 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-17T09:13:07.698 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-17T09:13:07.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.c 2024-09-17T09:13:07.973 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:07 smithi078 bash[22923]: ::ffff:172.21.15.136 - - [17/Sep/2024:09:13:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:13:07.973 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:07 smithi078 systemd[1]: Stopping Ceph mon.c for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:07.973 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:07 smithi078 bash[32124]: debug 2024-09-17T09:13:07.868+0000 7f419d3fc640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-17T09:13:07.974 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 17 09:13:07 smithi078 bash[32124]: debug 2024-09-17T09:13:07.868+0000 7f419d3fc640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-17T09:13:08.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.c.service' 2024-09-17T09:13:08.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:08.816 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-17T09:13:08.816 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-17T09:13:08.816 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.b 2024-09-17T09:13:09.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:08 smithi136 systemd[1]: Stopping Ceph mon.b for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:09.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:09 smithi136 bash[24812]: debug 2024-09-17T09:13:09.046+0000 7f6ae5593640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-17T09:13:09.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 17 09:13:09 smithi136 bash[24812]: debug 2024-09-17T09:13:09.046+0000 7f6ae5593640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T09:13:10.137 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mon.b.service' 2024-09-17T09:13:10.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:10.170 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-17T09:13:10.170 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-17T09:13:10.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y 2024-09-17T09:13:10.535 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:10 smithi078 systemd[1]: Stopping Ceph mgr.y for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:10.535 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:10 smithi078 bash[22923]: debug 2024-09-17T09:13:10.312+0000 7ffbebfa7640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:13:10.535 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:10 smithi078 bash[22923]: debug 2024-09-17T09:13:10.312+0000 7ffbebfa7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-17T09:13:11.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-17T09:13:11.225 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:10 smithi078 bash[132322]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-mgr-y 2024-09-17T09:13:11.225 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:11 smithi078 bash[132383]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-mgr-y 2024-09-17T09:13:11.225 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:11 smithi078 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.y.service: Deactivated successfully. 2024-09-17T09:13:11.226 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Sep 17 09:13:11 smithi078 systemd[1]: Stopped Ceph mgr.y for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T09:13:11.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:11.242 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-17T09:13:11.242 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-17T09:13:11.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.x 2024-09-17T09:13:11.543 INFO:journalctl@ceph.mgr.x.smithi136.stdout:Sep 17 09:13:11 smithi136 systemd[1]: Stopping Ceph mgr.x for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:12.193 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-17T09:13:12.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:12.220 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-17T09:13:12.220 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T09:13:12.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.0 2024-09-17T09:13:12.603 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:13:12 smithi078 systemd[1]: Stopping Ceph osd.0 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:12.604 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:13:12 smithi078 bash[35112]: debug 2024-09-17T09:13:12.364+0000 7fce945c9640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:13:12.604 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:13:12 smithi078 bash[35112]: debug 2024-09-17T09:13:12.364+0000 7fce945c9640 -1 osd.0 785 *** Got signal Terminated *** 2024-09-17T09:13:12.604 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:13:12 smithi078 bash[35112]: debug 2024-09-17T09:13:12.364+0000 7fce945c9640 -1 osd.0 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:18.853 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:13:18 smithi078 bash[132423]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-0 2024-09-17T09:13:18.854 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 17 09:13:18 smithi078 bash[132487]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-0 2024-09-17T09:13:20.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T09:13:20.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:20.987 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T09:13:20.987 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T09:13:20.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.1 2024-09-17T09:13:21.353 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:13:21 smithi078 systemd[1]: Stopping Ceph osd.1 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:21.354 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:13:21 smithi078 bash[40803]: debug 2024-09-17T09:13:21.152+0000 7f39f92df640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:13:21.354 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:13:21 smithi078 bash[40803]: debug 2024-09-17T09:13:21.152+0000 7f39f92df640 -1 osd.1 785 *** Got signal Terminated *** 2024-09-17T09:13:21.354 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:13:21 smithi078 bash[40803]: debug 2024-09-17T09:13:21.152+0000 7f39f92df640 -1 osd.1 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:27.550 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:13:27 smithi078 bash[132621]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-1 2024-09-17T09:13:27.551 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 17 09:13:27 smithi078 bash[132686]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-1 2024-09-17T09:13:29.521 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T09:13:29.549 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:29.549 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T09:13:29.549 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T09:13:29.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.2 2024-09-17T09:13:29.853 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:13:29 smithi078 systemd[1]: Stopping Ceph osd.2 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:29.854 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:13:29 smithi078 bash[46309]: debug 2024-09-17T09:13:29.727+0000 7f3f386d5640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:13:29.854 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:13:29 smithi078 bash[46309]: debug 2024-09-17T09:13:29.727+0000 7f3f386d5640 -1 osd.2 785 *** Got signal Terminated *** 2024-09-17T09:13:29.854 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:13:29 smithi078 bash[46309]: debug 2024-09-17T09:13:29.727+0000 7f3f386d5640 -1 osd.2 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:36.109 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:13:35 smithi078 bash[132816]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-2 2024-09-17T09:13:36.110 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 17 09:13:35 smithi078 bash[132880]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-2 2024-09-17T09:13:38.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T09:13:38.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:38.091 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T09:13:38.091 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T09:13:38.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.3 2024-09-17T09:13:38.353 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:13:38 smithi078 systemd[1]: Stopping Ceph osd.3 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:38.354 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:13:38 smithi078 bash[51921]: debug 2024-09-17T09:13:38.263+0000 7f8d5aceb640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:13:38.354 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:13:38 smithi078 bash[51921]: debug 2024-09-17T09:13:38.263+0000 7f8d5aceb640 -1 osd.3 785 *** Got signal Terminated *** 2024-09-17T09:13:38.354 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:13:38 smithi078 bash[51921]: debug 2024-09-17T09:13:38.263+0000 7f8d5aceb640 -1 osd.3 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:38.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:38 smithi136 bash[33798]: debug 2024-09-17T09:13:38.246+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:39.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:39 smithi136 bash[33798]: debug 2024-09-17T09:13:39.294+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:39.544 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:39 smithi136 bash[45001]: debug 2024-09-17T09:13:39.146+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:40.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:40 smithi136 bash[33798]: debug 2024-09-17T09:13:40.290+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:40.543 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:40 smithi136 bash[45001]: debug 2024-09-17T09:13:40.162+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:41.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:41 smithi136 bash[33798]: debug 2024-09-17T09:13:41.334+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:41.543 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:41 smithi136 bash[45001]: debug 2024-09-17T09:13:41.178+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:42.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:41 smithi136 bash[39365]: debug 2024-09-17T09:13:41.590+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:42.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:42 smithi136 bash[33798]: debug 2024-09-17T09:13:42.298+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:42.543 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:42 smithi136 bash[45001]: debug 2024-09-17T09:13:42.142+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:42.853 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:13:42 smithi078 bash[51921]: debug 2024-09-17T09:13:42.439+0000 7f8d532f7640 -1 osd.3 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:14.934689+0000 front 2024-09-17T09:13:14.934559+0000 (oldest deadline 2024-09-17T09:13:41.935414+0000) 2024-09-17T09:13:43.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:42 smithi136 bash[39365]: debug 2024-09-17T09:13:42.610+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:43.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:43 smithi136 bash[33798]: debug 2024-09-17T09:13:43.318+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:43.543 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:43 smithi136 bash[45001]: debug 2024-09-17T09:13:43.114+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:44.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:43 smithi136 bash[39365]: debug 2024-09-17T09:13:43.638+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:44.044 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:43 smithi136 bash[28251]: debug 2024-09-17T09:13:43.730+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:44.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:44 smithi136 bash[33798]: debug 2024-09-17T09:13:44.334+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:44.543 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:44 smithi136 bash[45001]: debug 2024-09-17T09:13:44.138+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:44.603 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:13:44 smithi078 bash[133015]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-3 2024-09-17T09:13:44.603 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 17 09:13:44 smithi078 bash[133079]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-3 2024-09-17T09:13:45.043 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:44 smithi136 bash[28251]: debug 2024-09-17T09:13:44.730+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:45.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:44 smithi136 bash[39365]: debug 2024-09-17T09:13:44.622+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:45.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:45 smithi136 bash[33798]: debug 2024-09-17T09:13:45.338+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:45.543 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:45 smithi136 bash[45001]: debug 2024-09-17T09:13:45.094+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:46.043 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:45 smithi136 bash[28251]: debug 2024-09-17T09:13:45.682+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:46.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:45 smithi136 bash[39365]: debug 2024-09-17T09:13:45.618+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:46.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T09:13:46.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:46.275 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T09:13:46.275 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T09:13:46.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.4 2024-09-17T09:13:46.356 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:46 smithi136 systemd[1]: Stopping Ceph osd.4 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:46.356 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:46 smithi136 bash[45001]: debug 2024-09-17T09:13:46.058+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:46.543 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:46 smithi136 bash[28251]: debug 2024-09-17T09:13:46.497+0000 7fae01a0a640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:13:46.543 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:46 smithi136 bash[28251]: debug 2024-09-17T09:13:46.497+0000 7fae01a0a640 -1 osd.4 785 *** Got signal Terminated *** 2024-09-17T09:13:46.543 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:46 smithi136 bash[28251]: debug 2024-09-17T09:13:46.497+0000 7fae01a0a640 -1 osd.4 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:46.544 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:46 smithi136 bash[33798]: debug 2024-09-17T09:13:46.354+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:47.026 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:46 smithi136 bash[28251]: debug 2024-09-17T09:13:46.669+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:47.027 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:46 smithi136 bash[39365]: debug 2024-09-17T09:13:46.645+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:47.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:47 smithi136 bash[45001]: debug 2024-09-17T09:13:47.025+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:47.651 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:47 smithi136 bash[33798]: debug 2024-09-17T09:13:47.361+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:47.651 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:47 smithi136 bash[39365]: debug 2024-09-17T09:13:47.609+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:47.651 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:47 smithi136 bash[39365]: debug 2024-09-17T09:13:47.609+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:47.985 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:47 smithi136 bash[28251]: debug 2024-09-17T09:13:47.649+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:48.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:47 smithi136 bash[45001]: debug 2024-09-17T09:13:47.981+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:48.687 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:48 smithi136 bash[33798]: debug 2024-09-17T09:13:48.385+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:48.688 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:48 smithi136 bash[39365]: debug 2024-09-17T09:13:48.613+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:48.688 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:48 smithi136 bash[39365]: debug 2024-09-17T09:13:48.613+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:48.954 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:48 smithi136 bash[28251]: debug 2024-09-17T09:13:48.685+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:48.955 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:13:48 smithi136 bash[52309]: logger=cleanup t=2024-09-17T09:13:48.7294898Z level=info msg="Completed cleanup jobs" duration=47.996583ms 2024-09-17T09:13:49.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:48 smithi136 bash[45001]: debug 2024-09-17T09:13:48.953+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:49.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:48 smithi136 bash[45001]: debug 2024-09-17T09:13:48.953+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:49.726 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:49 smithi136 bash[39365]: debug 2024-09-17T09:13:49.649+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:49.726 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:49 smithi136 bash[39365]: debug 2024-09-17T09:13:49.649+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:49.726 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:49 smithi136 bash[33798]: debug 2024-09-17T09:13:49.413+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:49.989 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:49 smithi136 bash[28251]: debug 2024-09-17T09:13:49.725+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:50.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:49 smithi136 bash[45001]: debug 2024-09-17T09:13:49.985+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:50.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:49 smithi136 bash[45001]: debug 2024-09-17T09:13:49.985+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:50.675 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:50 smithi136 bash[33798]: debug 2024-09-17T09:13:50.373+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:50.675 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:50 smithi136 bash[33798]: debug 2024-09-17T09:13:50.373+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:50.981 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:50 smithi136 bash[28251]: debug 2024-09-17T09:13:50.761+0000 7fadfe01e640 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.916817+0000 front 2024-09-17T09:13:16.917137+0000 (oldest deadline 2024-09-17T09:13:42.816527+0000) 2024-09-17T09:13:50.981 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:50 smithi136 bash[39365]: debug 2024-09-17T09:13:50.673+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:50.981 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:50 smithi136 bash[39365]: debug 2024-09-17T09:13:50.673+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:51.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:50 smithi136 bash[45001]: debug 2024-09-17T09:13:50.977+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:51.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:50 smithi136 bash[45001]: debug 2024-09-17T09:13:50.977+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:51.665 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:51 smithi136 bash[33798]: debug 2024-09-17T09:13:51.377+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:51.665 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:51 smithi136 bash[33798]: debug 2024-09-17T09:13:51.377+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:51.985 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:51 smithi136 bash[39365]: debug 2024-09-17T09:13:51.661+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:51.986 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:51 smithi136 bash[39365]: debug 2024-09-17T09:13:51.661+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:52.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:51 smithi136 bash[45001]: debug 2024-09-17T09:13:51.981+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:52.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:51 smithi136 bash[45001]: debug 2024-09-17T09:13:51.981+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:52.725 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[33798]: debug 2024-09-17T09:13:52.357+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:52.725 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[33798]: debug 2024-09-17T09:13:52.357+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:53.043 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[54394]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-4 2024-09-17T09:13:53.043 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[54459]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-4 2024-09-17T09:13:53.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[39365]: debug 2024-09-17T09:13:52.705+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:53.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[39365]: debug 2024-09-17T09:13:52.705+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:53.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[45001]: debug 2024-09-17T09:13:52.941+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:53.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:52 smithi136 bash[45001]: debug 2024-09-17T09:13:52.941+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:53.698 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:53 smithi136 bash[33798]: debug 2024-09-17T09:13:53.385+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:53.699 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:53 smithi136 bash[33798]: debug 2024-09-17T09:13:53.385+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:53.986 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:53 smithi136 bash[39365]: debug 2024-09-17T09:13:53.697+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:53.986 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:53 smithi136 bash[39365]: debug 2024-09-17T09:13:53.697+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:54.281 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:53 smithi136 bash[45001]: debug 2024-09-17T09:13:53.985+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:54.282 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:53 smithi136 bash[45001]: debug 2024-09-17T09:13:53.985+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:54.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:54 smithi136 bash[33798]: debug 2024-09-17T09:13:54.393+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:54.543 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:54 smithi136 bash[33798]: debug 2024-09-17T09:13:54.393+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:54.906 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:54 smithi136 bash[39365]: debug 2024-09-17T09:13:54.653+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:54.907 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:54 smithi136 bash[39365]: debug 2024-09-17T09:13:54.653+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:54.910 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T09:13:54.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:54.940 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T09:13:54.941 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T09:13:54.941 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.5 2024-09-17T09:13:55.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:54 smithi136 bash[45001]: debug 2024-09-17T09:13:54.993+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:55.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:54 smithi136 bash[45001]: debug 2024-09-17T09:13:54.993+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:55.294 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:54 smithi136 systemd[1]: Stopping Ceph osd.5 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:13:55.294 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:55 smithi136 bash[33798]: debug 2024-09-17T09:13:55.113+0000 7fcd77f4d640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:13:55.294 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:55 smithi136 bash[33798]: debug 2024-09-17T09:13:55.113+0000 7fcd77f4d640 -1 osd.5 785 *** Got signal Terminated *** 2024-09-17T09:13:55.294 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:55 smithi136 bash[33798]: debug 2024-09-17T09:13:55.113+0000 7fcd77f4d640 -1 osd.5 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:55.793 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:55 smithi136 bash[33798]: debug 2024-09-17T09:13:55.409+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:55.793 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:55 smithi136 bash[33798]: debug 2024-09-17T09:13:55.409+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:55.793 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:55 smithi136 bash[39365]: debug 2024-09-17T09:13:55.657+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:55.793 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:55 smithi136 bash[39365]: debug 2024-09-17T09:13:55.657+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:56.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[45001]: debug 2024-09-17T09:13:56.005+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:56.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[45001]: debug 2024-09-17T09:13:56.005+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:56.695 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[33798]: debug 2024-09-17T09:13:56.397+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:56.695 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[33798]: debug 2024-09-17T09:13:56.397+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:56.997 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[39365]: debug 2024-09-17T09:13:56.693+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:56.997 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[39365]: debug 2024-09-17T09:13:56.693+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:57.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[45001]: debug 2024-09-17T09:13:56.993+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:57.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:56 smithi136 bash[45001]: debug 2024-09-17T09:13:56.993+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:57.721 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:57 smithi136 bash[33798]: debug 2024-09-17T09:13:57.385+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:57.721 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:57 smithi136 bash[33798]: debug 2024-09-17T09:13:57.385+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:57.721 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:57 smithi136 bash[33798]: debug 2024-09-17T09:13:57.385+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:33.038987+0000 front 2024-09-17T09:13:33.039121+0000 (oldest deadline 2024-09-17T09:13:56.538856+0000) 2024-09-17T09:13:58.009 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:57 smithi136 bash[39365]: debug 2024-09-17T09:13:57.721+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:58.009 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:57 smithi136 bash[39365]: debug 2024-09-17T09:13:57.721+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:58.009 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:57 smithi136 bash[39365]: debug 2024-09-17T09:13:57.721+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:13:58.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[45001]: debug 2024-09-17T09:13:58.009+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:58.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[45001]: debug 2024-09-17T09:13:58.009+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:58.702 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[33798]: debug 2024-09-17T09:13:58.405+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:58.702 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[33798]: debug 2024-09-17T09:13:58.405+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:58.702 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[33798]: debug 2024-09-17T09:13:58.405+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:33.038987+0000 front 2024-09-17T09:13:33.039121+0000 (oldest deadline 2024-09-17T09:13:56.538856+0000) 2024-09-17T09:13:59.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[39365]: debug 2024-09-17T09:13:58.701+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:59.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[39365]: debug 2024-09-17T09:13:58.701+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:59.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:58 smithi136 bash[39365]: debug 2024-09-17T09:13:58.701+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:13:59.453 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[45001]: debug 2024-09-17T09:13:59.045+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:13:59.453 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[45001]: debug 2024-09-17T09:13:59.045+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:13:59.454 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[45001]: debug 2024-09-17T09:13:59.045+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:13:59.793 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[33798]: debug 2024-09-17T09:13:59.453+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:12.034976+0000 front 2024-09-17T09:13:12.035202+0000 (oldest deadline 2024-09-17T09:13:37.934842+0000) 2024-09-17T09:13:59.793 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[33798]: debug 2024-09-17T09:13:59.453+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:26.136860+0000 front 2024-09-17T09:13:26.136820+0000 (oldest deadline 2024-09-17T09:13:49.636630+0000) 2024-09-17T09:13:59.793 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[33798]: debug 2024-09-17T09:13:59.453+0000 7fcd74561640 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:33.038987+0000 front 2024-09-17T09:13:33.039121+0000 (oldest deadline 2024-09-17T09:13:56.538856+0000) 2024-09-17T09:13:59.794 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[39365]: debug 2024-09-17T09:13:59.685+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:13:59.794 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[39365]: debug 2024-09-17T09:13:59.685+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:13:59.794 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:13:59 smithi136 bash[39365]: debug 2024-09-17T09:13:59.685+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:00.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[45001]: debug 2024-09-17T09:14:00.001+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:00.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[45001]: debug 2024-09-17T09:14:00.001+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:00.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[45001]: debug 2024-09-17T09:14:00.001+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:00.979 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[39365]: debug 2024-09-17T09:14:00.713+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:00.979 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[39365]: debug 2024-09-17T09:14:00.713+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:00.979 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[39365]: debug 2024-09-17T09:14:00.713+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:01.293 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[54588]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-5 2024-09-17T09:14:01.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[45001]: debug 2024-09-17T09:14:00.977+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:01.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[45001]: debug 2024-09-17T09:14:00.977+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:01.294 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:00 smithi136 bash[45001]: debug 2024-09-17T09:14:00.977+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:01.705 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[54651]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-5 2024-09-17T09:14:02.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[45001]: debug 2024-09-17T09:14:01.945+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:02.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[45001]: debug 2024-09-17T09:14:01.945+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:02.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[45001]: debug 2024-09-17T09:14:01.945+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:02.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[39365]: debug 2024-09-17T09:14:01.705+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:02.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[39365]: debug 2024-09-17T09:14:01.705+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:02.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:01 smithi136 bash[39365]: debug 2024-09-17T09:14:01.705+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:03.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:02 smithi136 bash[45001]: debug 2024-09-17T09:14:02.913+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:03.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:02 smithi136 bash[45001]: debug 2024-09-17T09:14:02.913+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:03.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:02 smithi136 bash[45001]: debug 2024-09-17T09:14:02.913+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:03.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:02 smithi136 bash[39365]: debug 2024-09-17T09:14:02.737+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:03.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:02 smithi136 bash[39365]: debug 2024-09-17T09:14:02.737+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:03.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:02 smithi136 bash[39365]: debug 2024-09-17T09:14:02.737+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:03.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T09:14:03.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:14:03.365 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T09:14:03.365 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-17T09:14:03.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.6 2024-09-17T09:14:03.787 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:03 smithi136 systemd[1]: Stopping Ceph osd.6 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:03.787 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[39365]: debug 2024-09-17T09:14:03.545+0000 7fdd4c2c9640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:14:03.787 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[39365]: debug 2024-09-17T09:14:03.545+0000 7fdd4c2c9640 -1 osd.6 785 *** Got signal Terminated *** 2024-09-17T09:14:03.787 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[39365]: debug 2024-09-17T09:14:03.545+0000 7fdd4c2c9640 -1 osd.6 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:14:04.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[39365]: debug 2024-09-17T09:14:03.785+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:04.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[39365]: debug 2024-09-17T09:14:03.785+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:04.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[39365]: debug 2024-09-17T09:14:03.785+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:04.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[45001]: debug 2024-09-17T09:14:03.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:04.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[45001]: debug 2024-09-17T09:14:03.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:04.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[45001]: debug 2024-09-17T09:14:03.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:04.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[53045]: ts=2024-09-17T09:14:03.937Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T09:14:04.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[53045]: ts=2024-09-17T09:14:03.940Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T09:14:04.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[53045]: ts=2024-09-17T09:14:03.940Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T09:14:04.045 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[53045]: ts=2024-09-17T09:14:03.943Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T09:14:04.045 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:03 smithi136 bash[53045]: ts=2024-09-17T09:14:03.943Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.78:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.78:8765: connect: connection refused" 2024-09-17T09:14:05.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[39365]: debug 2024-09-17T09:14:04.749+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:05.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[39365]: debug 2024-09-17T09:14:04.749+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:05.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[39365]: debug 2024-09-17T09:14:04.749+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:05.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[39365]: debug 2024-09-17T09:14:04.749+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:42.414497+0000 front 2024-09-17T09:13:42.414540+0000 (oldest deadline 2024-09-17T09:14:04.114177+0000) 2024-09-17T09:14:05.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[45001]: debug 2024-09-17T09:14:04.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:05.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[45001]: debug 2024-09-17T09:14:04.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:05.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[45001]: debug 2024-09-17T09:14:04.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:05.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:04 smithi136 bash[45001]: debug 2024-09-17T09:14:04.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:05.710 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[39365]: debug 2024-09-17T09:14:05.709+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:05.710 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[39365]: debug 2024-09-17T09:14:05.709+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:06.043 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[39365]: debug 2024-09-17T09:14:05.709+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:06.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[39365]: debug 2024-09-17T09:14:05.709+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:42.414497+0000 front 2024-09-17T09:13:42.414540+0000 (oldest deadline 2024-09-17T09:14:04.114177+0000) 2024-09-17T09:14:06.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[45001]: debug 2024-09-17T09:14:05.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:06.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[45001]: debug 2024-09-17T09:14:05.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:06.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[45001]: debug 2024-09-17T09:14:05.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:06.045 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:05 smithi136 bash[45001]: debug 2024-09-17T09:14:05.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:07.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[45001]: debug 2024-09-17T09:14:06.857+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:07.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[45001]: debug 2024-09-17T09:14:06.857+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:07.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[45001]: debug 2024-09-17T09:14:06.857+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:07.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[45001]: debug 2024-09-17T09:14:06.857+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:07.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[39365]: debug 2024-09-17T09:14:06.717+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:07.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[39365]: debug 2024-09-17T09:14:06.717+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:07.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[39365]: debug 2024-09-17T09:14:06.717+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:07.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:06 smithi136 bash[39365]: debug 2024-09-17T09:14:06.717+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:42.414497+0000 front 2024-09-17T09:13:42.414540+0000 (oldest deadline 2024-09-17T09:14:04.114177+0000) 2024-09-17T09:14:08.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[45001]: debug 2024-09-17T09:14:07.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:08.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[45001]: debug 2024-09-17T09:14:07.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:08.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[45001]: debug 2024-09-17T09:14:07.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:08.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[45001]: debug 2024-09-17T09:14:07.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:08.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[39365]: debug 2024-09-17T09:14:07.725+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.208762+0000 front 2024-09-17T09:13:16.208807+0000 (oldest deadline 2024-09-17T09:13:40.909009+0000) 2024-09-17T09:14:08.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[39365]: debug 2024-09-17T09:14:07.725+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:24.410939+0000 front 2024-09-17T09:13:24.410913+0000 (oldest deadline 2024-09-17T09:13:47.310483+0000) 2024-09-17T09:14:08.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[39365]: debug 2024-09-17T09:14:07.725+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:34.312818+0000 front 2024-09-17T09:13:34.312926+0000 (oldest deadline 2024-09-17T09:13:57.212516+0000) 2024-09-17T09:14:08.044 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:07 smithi136 bash[39365]: debug 2024-09-17T09:14:07.725+0000 7fdd488dd640 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:42.414497+0000 front 2024-09-17T09:13:42.414540+0000 (oldest deadline 2024-09-17T09:14:04.114177+0000) 2024-09-17T09:14:09.256 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:08 smithi136 bash[45001]: debug 2024-09-17T09:14:08.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:09.256 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:08 smithi136 bash[45001]: debug 2024-09-17T09:14:08.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:09.256 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:08 smithi136 bash[45001]: debug 2024-09-17T09:14:08.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:09.256 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:08 smithi136 bash[45001]: debug 2024-09-17T09:14:08.893+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:09.975 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:09 smithi136 bash[54782]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-6 2024-09-17T09:14:09.975 INFO:journalctl@ceph.osd.6.smithi136.stdout:Sep 17 09:14:09 smithi136 bash[54847]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-6 2024-09-17T09:14:09.975 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:09 smithi136 bash[45001]: debug 2024-09-17T09:14:09.913+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:09.975 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:09 smithi136 bash[45001]: debug 2024-09-17T09:14:09.913+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:09.975 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:09 smithi136 bash[45001]: debug 2024-09-17T09:14:09.913+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:09.975 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:09 smithi136 bash[45001]: debug 2024-09-17T09:14:09.913+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:11.152 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:10 smithi136 bash[45001]: debug 2024-09-17T09:14:10.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:11.153 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:10 smithi136 bash[45001]: debug 2024-09-17T09:14:10.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:11.153 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:10 smithi136 bash[45001]: debug 2024-09-17T09:14:10.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:11.153 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:10 smithi136 bash[45001]: debug 2024-09-17T09:14:10.897+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:11.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.6.service' 2024-09-17T09:14:11.712 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:14:11.713 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-17T09:14:11.713 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-17T09:14:11.713 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.7 2024-09-17T09:14:12.043 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 systemd[1]: Stopping Ceph osd.7 for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:12.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 bash[45001]: debug 2024-09-17T09:14:11.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:12.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 bash[45001]: debug 2024-09-17T09:14:11.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:12.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 bash[45001]: debug 2024-09-17T09:14:11.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:12.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 bash[45001]: debug 2024-09-17T09:14:11.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:12.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 bash[45001]: debug 2024-09-17T09:14:11.889+0000 7fc064d58640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:14:12.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 bash[45001]: debug 2024-09-17T09:14:11.889+0000 7fc064d58640 -1 osd.7 785 *** Got signal Terminated *** 2024-09-17T09:14:12.044 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:11 smithi136 bash[45001]: debug 2024-09-17T09:14:11.889+0000 7fc064d58640 -1 osd.7 785 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:14:13.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:12 smithi136 bash[45001]: debug 2024-09-17T09:14:12.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:13.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:12 smithi136 bash[45001]: debug 2024-09-17T09:14:12.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:13.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:12 smithi136 bash[45001]: debug 2024-09-17T09:14:12.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:13.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:12 smithi136 bash[45001]: debug 2024-09-17T09:14:12.861+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:14.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:13 smithi136 bash[45001]: debug 2024-09-17T09:14:13.901+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:14.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:13 smithi136 bash[45001]: debug 2024-09-17T09:14:13.901+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:14.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:13 smithi136 bash[45001]: debug 2024-09-17T09:14:13.901+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:14.294 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:13 smithi136 bash[45001]: debug 2024-09-17T09:14:13.901+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:14.294 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:13 smithi136 bash[45001]: debug 2024-09-17T09:14:13.901+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.136:6804 osd.4 since back 2024-09-17T09:13:51.326195+0000 front 2024-09-17T09:13:51.326034+0000 (oldest deadline 2024-09-17T09:14:13.625899+0000) 2024-09-17T09:14:15.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:14 smithi136 bash[45001]: debug 2024-09-17T09:14:14.917+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:15.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:14 smithi136 bash[45001]: debug 2024-09-17T09:14:14.917+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:15.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:14 smithi136 bash[45001]: debug 2024-09-17T09:14:14.917+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:15.294 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:14 smithi136 bash[45001]: debug 2024-09-17T09:14:14.917+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:15.294 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:14 smithi136 bash[45001]: debug 2024-09-17T09:14:14.917+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.136:6804 osd.4 since back 2024-09-17T09:13:51.326195+0000 front 2024-09-17T09:13:51.326034+0000 (oldest deadline 2024-09-17T09:14:13.625899+0000) 2024-09-17T09:14:16.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:15 smithi136 bash[45001]: debug 2024-09-17T09:14:15.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-17T09:13:16.419067+0000 front 2024-09-17T09:13:16.419260+0000 (oldest deadline 2024-09-17T09:13:38.719032+0000) 2024-09-17T09:14:16.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:15 smithi136 bash[45001]: debug 2024-09-17T09:14:15.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-17T09:13:23.221808+0000 front 2024-09-17T09:13:23.221690+0000 (oldest deadline 2024-09-17T09:13:48.521325+0000) 2024-09-17T09:14:16.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:15 smithi136 bash[45001]: debug 2024-09-17T09:14:15.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-17T09:13:32.523533+0000 front 2024-09-17T09:13:32.523514+0000 (oldest deadline 2024-09-17T09:13:58.423248+0000) 2024-09-17T09:14:16.294 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:15 smithi136 bash[45001]: debug 2024-09-17T09:14:15.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.78:6830 osd.3 since back 2024-09-17T09:13:38.424247+0000 front 2024-09-17T09:13:38.424290+0000 (oldest deadline 2024-09-17T09:14:04.324143+0000) 2024-09-17T09:14:16.294 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:15 smithi136 bash[45001]: debug 2024-09-17T09:14:15.933+0000 7fc05d364640 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.136:6804 osd.4 since back 2024-09-17T09:13:51.326195+0000 front 2024-09-17T09:13:51.326034+0000 (oldest deadline 2024-09-17T09:14:13.625899+0000) 2024-09-17T09:14:18.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:17 smithi136 bash[54980]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-7 2024-09-17T09:14:18.293 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 17 09:14:18 smithi136 bash[55046]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-osd-7 2024-09-17T09:14:19.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@osd.7.service' 2024-09-17T09:14:19.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:14:19.867 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-17T09:14:19.867 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-09-17T09:14:19.867 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@rgw.foo.a 2024-09-17T09:14:20.354 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 09:14:19 smithi078 systemd[1]: Stopping Ceph rgw.foo.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:20.354 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 09:14:20 smithi078 bash[56312]: debug 2024-09-17T09:14:19.995+0000 7f561c154640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T09:14:20.354 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 09:14:20 smithi078 bash[56312]: debug 2024-09-17T09:14:19.995+0000 7f561f9bf880 -1 shutting down 2024-09-17T09:14:30.603 INFO:journalctl@ceph.rgw.foo.a.smithi078.stdout:Sep 17 09:14:30 smithi078 bash[133209]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-rgw-foo-a 2024-09-17T09:14:30.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@rgw.foo.a.service' 2024-09-17T09:14:30.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:14:30.704 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-09-17T09:14:30.705 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-17T09:14:30.705 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-7121dba6-74d0-11ef-bceb-c7b262605968@prometheus.a 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 systemd[1]: Stopping Ceph prometheus.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T09:14:31.044 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-17T09:14:31.045 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.866Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-17T09:14:31.045 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.867Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T09:14:31.045 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.867Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-17T09:14:31.045 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:Sep 17 09:14:30 smithi136 bash[53045]: ts=2024-09-17T09:14:30.867Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-17T09:14:31.545 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7121dba6-74d0-11ef-bceb-c7b262605968@prometheus.a.service' 2024-09-17T09:14:31.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:14:31.567 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-17T09:14:31.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T09:14:31.688 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T09:14:36.521 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:36.522 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:36.786 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:36.787 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.103 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.103 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:36 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.409 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.409 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.409 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.687 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.688 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.688 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.961 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:37.961 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:37 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:38.336 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:38.337 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:38 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:38.337 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:38 smithi078 systemd[1]: Stopping Ceph node-exporter.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:39.198 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:38 smithi078 bash[133566]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-node-exporter-a 2024-09-17T09:14:39.198 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:39 smithi078 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-17T09:14:39.199 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:39 smithi078 bash[133626]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-node-exporter-a 2024-09-17T09:14:39.199 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:39 smithi078 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-17T09:14:39.199 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:39 smithi078 systemd[1]: Stopped Ceph node-exporter.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T09:14:39.468 INFO:journalctl@ceph.node-exporter.a.smithi078.stdout:Sep 17 09:14:39 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:39.469 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:39 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:39.469 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:39 smithi078 systemd[1]: Stopping Ceph alertmanager.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:39.469 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:39 smithi078 bash[62002]: ts=2024-09-17T09:14:39.408Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-17T09:14:40.303 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:39 smithi078 bash[133688]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-alertmanager-a 2024-09-17T09:14:40.303 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:40 smithi078 bash[133748]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-alertmanager-a 2024-09-17T09:14:40.303 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:40 smithi078 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-17T09:14:40.303 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:40 smithi078 systemd[1]: Stopped Ceph alertmanager.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T09:14:40.581 INFO:journalctl@ceph.alertmanager.a.smithi078.stdout:Sep 17 09:14:40 smithi078 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:40.842 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T09:14:40.963 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T09:14:45.825 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:45.825 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:45.826 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.156 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.157 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.157 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:45 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.450 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.450 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.451 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.451 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.782 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:46.783 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:47.043 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:47.044 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:47.044 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:47.044 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:46 smithi136 systemd[1]: Stopping Ceph iscsi.iscsi.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:47.044 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:47 smithi136 bash[49406]: debug Shutdown received 2024-09-17T09:14:57.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:57 smithi136 bash[55520]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-iscsi-iscsi-a 2024-09-17T09:14:58.044 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:57 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-09-17T09:14:58.044 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:57 smithi136 bash[55589]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-iscsi-iscsi-a 2024-09-17T09:14:58.629 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:58 smithi136 bash[55598]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-iscsi-iscsi-a-tcmu 2024-09-17T09:14:58.630 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:58 smithi136 bash[55631]: rm: cannot remove '/run/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@iscsi.iscsi.a.tcmu.service-pid': No such file or directory 2024-09-17T09:14:58.630 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:58 smithi136 bash[55632]: rm: cannot remove '/run/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@iscsi.iscsi.a.tcmu.service-cid': No such file or directory 2024-09-17T09:14:58.630 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-09-17T09:14:58.630 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@iscsi.iscsi.a.service: Unit process 49380 (docker) remains running after unit stopped. 2024-09-17T09:14:58.630 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: Stopped Ceph iscsi.iscsi.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T09:14:58.920 INFO:journalctl@ceph.iscsi.iscsi.a.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:58.921 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:58.921 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:58.921 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:58.921 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:14:59.294 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:58 smithi136 systemd[1]: Stopping Ceph node-exporter.b for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:14:59.950 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:59 smithi136 bash[55715]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-node-exporter-b 2024-09-17T09:14:59.950 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:59 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-17T09:14:59.950 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:59 smithi136 bash[55775]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-node-exporter-b 2024-09-17T09:14:59.950 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:59 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-17T09:14:59.950 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:14:59 smithi136 systemd[1]: Stopped Ceph node-exporter.b for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T09:15:00.203 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:Sep 17 09:15:00 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:15:00.204 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:14:59 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:15:00.204 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:15:00 smithi136 systemd[1]: Stopping Ceph grafana.a for 7121dba6-74d0-11ef-bceb-c7b262605968... 2024-09-17T09:15:00.990 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:15:00 smithi136 bash[55839]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-grafana-a 2024-09-17T09:15:00.990 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:15:00 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-09-17T09:15:00.990 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:15:00 smithi136 bash[55901]: Error response from daemon: No such container: ceph-7121dba6-74d0-11ef-bceb-c7b262605968-grafana-a 2024-09-17T09:15:00.991 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:15:00 smithi136 systemd[1]: ceph-7121dba6-74d0-11ef-bceb-c7b262605968@grafana.a.service: Failed with result 'exit-code'. 2024-09-17T09:15:00.991 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:15:00 smithi136 systemd[1]: Stopped Ceph grafana.a for 7121dba6-74d0-11ef-bceb-c7b262605968. 2024-09-17T09:15:00.991 INFO:journalctl@ceph.grafana.a.smithi136.stdout:Sep 17 09:15:00 smithi136 systemd[1]: /etc/systemd/system/ceph-7121dba6-74d0-11ef-bceb-c7b262605968@.service:24: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T09:15:01.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:15:01.542 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:15:01.555 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T09:15:01.557 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230/remote/smithi078/crash 2024-09-17T09:15:01.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/crash -- . 2024-09-17T09:15:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:tar: /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T09:15:01.595 INFO:teuthology.orchestra.run.smithi078.stderr:tar: Error is not recoverable: exiting now 2024-09-17T09:15:01.597 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230/remote/smithi136/crash 2024-09-17T09:15:01.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/crash -- . 2024-09-17T09:15:01.611 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T09:15:01.611 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2024-09-17T09:15:01.612 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T09:15:01.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-17T09:15:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:grep: /var/log/ceph/7121dba6-74d0-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-17T09:15:01.655 INFO:tasks.cephadm:Compressing logs... 2024-09-17T09:15:01.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:15:01.698 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:15:01.706 INFO:teuthology.orchestra.run.smithi078.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-17T09:15:01.713 INFO:teuthology.orchestra.run.smithi136.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-17T09:15:30.602 INFO:tasks.cephadm:Archiving logs... 2024-09-17T09:15:30.602 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230/remote/smithi078/log 2024-09-17T09:15:30.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T09:15:33.462 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230/remote/smithi136/log 2024-09-17T09:15:33.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T09:15:36.042 INFO:tasks.cephadm:Removing cluster... 2024-09-17T09:15:36.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 --force 2024-09-17T09:15:36.165 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T09:15:37.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7121dba6-74d0-11ef-bceb-c7b262605968 --force 2024-09-17T09:15:37.688 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 7121dba6-74d0-11ef-bceb-c7b262605968 2024-09-17T09:15:39.124 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T09:15:39.125 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T09:15:39.131 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T09:15:39.138 INFO:tasks.cephadm:Teardown complete 2024-09-17T09:15:39.138 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T09:15:39.148 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T09:15:39.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T09:15:39.174 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T09:15:39.241 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T09:15:39.249 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T09:15:39.249 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:15:39.252 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:15:39.262 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T09:15:39.262 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-09-17T09:15:39.262 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 67.205.162.81 3 u 67 128 377 0.094 -2.775 0.769 2024-09-17T09:15:39.262 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 96.245.170.99 3 u 61 128 377 0.094 -0.958 0.497 2024-09-17T09:15:39.262 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 72 128 377 0.086 -5.170 0.850 2024-09-17T09:15:39.262 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-17T09:15:39.265 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T09:15:39.266 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2024-09-17T09:15:39.266 INFO:teuthology.orchestra.run.smithi136.stdout:*hv01.front.sepi 67.205.162.81 3 u 63 64 377 0.100 -5.562 2.050 2024-09-17T09:15:39.266 INFO:teuthology.orchestra.run.smithi136.stdout:+hv02.front.sepi 96.245.170.99 3 u 13 64 377 0.095 -1.657 1.724 2024-09-17T09:15:39.266 INFO:teuthology.orchestra.run.smithi136.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.106 -7.649 1.978 2024-09-17T09:15:39.266 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-17T09:15:39.267 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T09:15:39.298 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T09:15:39.299 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T09:15:39.347 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T09:15:39.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T09:15:39.448 INFO:teuthology.task.internal:Duration was 2686.132533 seconds 2024-09-17T09:15:39.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T09:15:39.498 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T09:15:39.499 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T09:15:39.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T09:15:39.537 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T09:15:39.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T09:15:39.538 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T09:15:39.589 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-09-17T09:15:39.590 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T09:15:39.600 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T09:15:39.601 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:15:39.634 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:15:39.698 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T09:15:39.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T09:15:39.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T09:15:39.894 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T09:15:39.903 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T09:15:39.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T09:15:39.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T09:15:39.929 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T09:15:39.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:15:39.958 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:15:39.966 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-17T09:15:39.981 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-09-17T09:15:40.246 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:15:40.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:15:40.251 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:15:40.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:15:40.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T09:15:40.305 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T09:15:40.306 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230/remote/smithi078 2024-09-17T09:15:40.307 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T09:15:40.338 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908230/remote/smithi136 2024-09-17T09:15:40.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T09:15:40.366 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T09:15:40.366 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T09:15:40.378 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T09:15:40.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T09:15:40.426 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T09:15:40.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T09:15:40.456 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T09:15:40.456 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T09:15:40.459 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T09:15:40.463 INFO:teuthology.orchestra.run.smithi078.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 09:15 /home/ubuntu/cephtest 2024-09-17T09:15:40.467 INFO:teuthology.orchestra.run.smithi136.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 09:15 /home/ubuntu/cephtest 2024-09-17T09:15:40.468 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T09:15:40.512 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T09:15:40.609 INFO:teuthology.run:Summary data: description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} duration: 2686.1325328350067 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-17T09:15:40.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T09:15:40.695 INFO:teuthology.run:pass